python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 96089 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2766700'] with mtr_portfolio_ids : ['22477709'] and first list_photo_ids : [] new path : /proc/96089/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.1704013347625732 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Apr 29 00:30:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2743 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-29 00:30:34.796977: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-29 00:30:34.827310: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-29 00:30:34.829667: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7da4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-29 00:30:34.829735: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-29 00:30:34.834292: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-29 00:30:35.097006: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x21d0ec20 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-29 00:30:35.097080: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-29 00:30:35.098061: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-29 00:30:35.098576: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-29 00:30:35.102022: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-29 00:30:35.121995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-29 00:30:35.122494: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-29 00:30:35.151013: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-29 00:30:35.156099: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-29 00:30:35.193653: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-29 00:30:35.195106: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-29 00:30:35.195239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-29 00:30:35.196047: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-29 00:30:35.196080: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-29 00:30:35.196099: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-29 00:30:35.197636: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2291 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-29 00:30:35.541137: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-29 00:30:35.541252: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-29 00:30:35.541279: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-29 00:30:35.541302: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-29 00:30:35.541326: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-29 00:30:35.541349: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-29 00:30:35.541371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-29 00:30:35.541394: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-29 00:30:35.542477: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-29 00:30:35.543968: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-29 00:30:35.544036: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-29 00:30:35.544061: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-29 00:30:35.544083: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-29 00:30:35.544105: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-29 00:30:35.544127: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-29 00:30:35.544148: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-29 00:30:35.544171: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-29 00:30:35.545236: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-29 00:30:35.545271: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-29 00:30:35.545283: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-29 00:30:35.545293: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-29 00:30:35.546427: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2291 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-29 00:30:50.925970: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-29 00:30:51.116298: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-29 00:30:52.638504: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:30:52.638558: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:30:52.645203: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:30:52.645225: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:30:52.699369: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:30:52.699441: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:30:52.742892: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:30:52.742950: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:30:52.791962: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:30:52.792016: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:30:52.794527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.24G (1330511872 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.795425: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.11G (1197460736 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.795452: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-04-29 00:30:52.816305: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.817245: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.844630: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.845586: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.847663: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.848617: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.875585: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.876661: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.879243: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.880240: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.886602: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.887183: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.888814: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.889357: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.918482: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.919106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.919716: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.920322: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.924141: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.924735: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.941175: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.941805: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.942362: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.942944: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.955732: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.956422: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.957102: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.957782: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.962095: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.962621: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.967247: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.967807: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.980029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.980554: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.984710: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.985234: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.985916: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.986441: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.997324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.997872: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.998441: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.999012: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:52.999587: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.000142: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.078704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.079266: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.098613: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.099360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.100064: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.100708: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.104819: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.105361: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.105888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.106408: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.107785: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.107804: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-04-29 00:30:53.117799: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.118372: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.127492: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.128053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.128618: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.129143: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.129677: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:30:53.130238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.74G (1867382784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 62 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 Detection mask done ! Trying to reset tf kernel 96495 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 355 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1548 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0028107166290283203 nb_pixel_total : 37446 time to create 1 rle with old method : 0.047702789306640625 length of segment : 339 time for calcul the mask position with numpy : 0.0005991458892822266 nb_pixel_total : 16938 time to create 1 rle with old method : 0.01994919776916504 length of segment : 111 time for calcul the mask position with numpy : 0.00045680999755859375 nb_pixel_total : 13391 time to create 1 rle with old method : 0.01630544662475586 length of segment : 166 time for calcul the mask position with numpy : 0.0006206035614013672 nb_pixel_total : 13481 time to create 1 rle with old method : 0.016039609909057617 length of segment : 120 time for calcul the mask position with numpy : 0.03425025939941406 nb_pixel_total : 620687 time to create 1 rle with new method : 0.0476679801940918 length of segment : 810 time for calcul the mask position with numpy : 0.01246333122253418 nb_pixel_total : 527222 time to create 1 rle with new method : 0.04503655433654785 length of segment : 812 time for calcul the mask position with numpy : 0.0002474784851074219 nb_pixel_total : 6399 time to create 1 rle with old method : 0.007699251174926758 length of segment : 74 time for calcul the mask position with numpy : 0.003088712692260742 nb_pixel_total : 123101 time to create 1 rle with old method : 0.14467167854309082 length of segment : 369 time for calcul the mask position with numpy : 0.0021419525146484375 nb_pixel_total : 64025 time to create 1 rle with old method : 0.07312679290771484 length of segment : 273 time for calcul the mask position with numpy : 0.0008459091186523438 nb_pixel_total : 20831 time to create 1 rle with old method : 0.02465367317199707 length of segment : 144 time for calcul the mask position with numpy : 0.0029730796813964844 nb_pixel_total : 107031 time to create 1 rle with old method : 0.12203669548034668 length of segment : 236 time for calcul the mask position with numpy : 0.0007636547088623047 nb_pixel_total : 30556 time to create 1 rle with old method : 0.03642749786376953 length of segment : 211 time for calcul the mask position with numpy : 0.0005104541778564453 nb_pixel_total : 15448 time to create 1 rle with old method : 0.018137454986572266 length of segment : 143 time for calcul the mask position with numpy : 0.00081634521484375 nb_pixel_total : 19061 time to create 1 rle with old method : 0.022944927215576172 length of segment : 172 time for calcul the mask position with numpy : 0.0003628730773925781 nb_pixel_total : 5807 time to create 1 rle with old method : 0.007204532623291016 length of segment : 74 time for calcul the mask position with numpy : 0.0011241436004638672 nb_pixel_total : 37989 time to create 1 rle with old method : 0.04358339309692383 length of segment : 299 time for calcul the mask position with numpy : 0.0024330615997314453 nb_pixel_total : 123450 time to create 1 rle with old method : 0.1426689624786377 length of segment : 322 time for calcul the mask position with numpy : 0.0005688667297363281 nb_pixel_total : 11935 time to create 1 rle with old method : 0.014428138732910156 length of segment : 106 time for calcul the mask position with numpy : 0.0005843639373779297 nb_pixel_total : 19454 time to create 1 rle with old method : 0.02303934097290039 length of segment : 275 time for calcul the mask position with numpy : 0.0008919239044189453 nb_pixel_total : 29201 time to create 1 rle with old method : 0.03444981575012207 length of segment : 412 time for calcul the mask position with numpy : 0.0009436607360839844 nb_pixel_total : 32079 time to create 1 rle with old method : 0.037535905838012695 length of segment : 243 time for calcul the mask position with numpy : 0.004267454147338867 nb_pixel_total : 167041 time to create 1 rle with new method : 0.0074961185455322266 length of segment : 536 time for calcul the mask position with numpy : 0.0011107921600341797 nb_pixel_total : 40447 time to create 1 rle with old method : 0.046984195709228516 length of segment : 222 time for calcul the mask position with numpy : 0.0008816719055175781 nb_pixel_total : 44642 time to create 1 rle with old method : 0.05281710624694824 length of segment : 185 time for calcul the mask position with numpy : 0.0013823509216308594 nb_pixel_total : 36566 time to create 1 rle with old method : 0.043201446533203125 length of segment : 220 time for calcul the mask position with numpy : 0.0019614696502685547 nb_pixel_total : 69118 time to create 1 rle with old method : 0.08113670349121094 length of segment : 173 time for calcul the mask position with numpy : 0.001191854476928711 nb_pixel_total : 29820 time to create 1 rle with old method : 0.03531622886657715 length of segment : 248 time for calcul the mask position with numpy : 0.0034596920013427734 nb_pixel_total : 12704 time to create 1 rle with old method : 0.014887094497680664 length of segment : 301 time for calcul the mask position with numpy : 0.0016605854034423828 nb_pixel_total : 65108 time to create 1 rle with old method : 0.08220648765563965 length of segment : 276 time for calcul the mask position with numpy : 0.00467371940612793 nb_pixel_total : 132179 time to create 1 rle with old method : 0.15671324729919434 length of segment : 689 time for calcul the mask position with numpy : 0.0003066062927246094 nb_pixel_total : 6722 time to create 1 rle with old method : 0.0077822208404541016 length of segment : 152 time for calcul the mask position with numpy : 0.0015897750854492188 nb_pixel_total : 55553 time to create 1 rle with old method : 0.06359720230102539 length of segment : 358 time for calcul the mask position with numpy : 0.5370397567749023 nb_pixel_total : 1120095 time to create 1 rle with new method : 0.2731008529663086 length of segment : 1027 time for calcul the mask position with numpy : 0.0009276866912841797 nb_pixel_total : 22027 time to create 1 rle with old method : 0.02550339698791504 length of segment : 172 time for calcul the mask position with numpy : 0.004004955291748047 nb_pixel_total : 153193 time to create 1 rle with new method : 0.005655765533447266 length of segment : 273 time for calcul the mask position with numpy : 0.004453897476196289 nb_pixel_total : 130020 time to create 1 rle with old method : 0.1509721279144287 length of segment : 553 time for calcul the mask position with numpy : 0.0007808208465576172 nb_pixel_total : 22126 time to create 1 rle with old method : 0.044179677963256836 length of segment : 125 time for calcul the mask position with numpy : 0.0008003711700439453 nb_pixel_total : 11292 time to create 1 rle with old method : 0.015363693237304688 length of segment : 176 time for calcul the mask position with numpy : 0.0010991096496582031 nb_pixel_total : 23163 time to create 1 rle with old method : 0.027269601821899414 length of segment : 229 time for calcul the mask position with numpy : 0.007131338119506836 nb_pixel_total : 219691 time to create 1 rle with new method : 0.009997367858886719 length of segment : 704 time for calcul the mask position with numpy : 0.0011112689971923828 nb_pixel_total : 31894 time to create 1 rle with old method : 0.03734779357910156 length of segment : 215 time for calcul the mask position with numpy : 0.0021805763244628906 nb_pixel_total : 64520 time to create 1 rle with old method : 0.08927583694458008 length of segment : 317 time for calcul the mask position with numpy : 0.016676902770996094 nb_pixel_total : 570370 time to create 1 rle with new method : 0.03745675086975098 length of segment : 1013 time for calcul the mask position with numpy : 0.005698204040527344 nb_pixel_total : 162960 time to create 1 rle with new method : 0.007299661636352539 length of segment : 373 time for calcul the mask position with numpy : 0.0019392967224121094 nb_pixel_total : 66370 time to create 1 rle with old method : 0.07535862922668457 length of segment : 350 time for calcul the mask position with numpy : 0.0036101341247558594 nb_pixel_total : 91450 time to create 1 rle with old method : 0.10480260848999023 length of segment : 431 time for calcul the mask position with numpy : 0.0030379295349121094 nb_pixel_total : 124735 time to create 1 rle with old method : 0.14190959930419922 length of segment : 269 time for calcul the mask position with numpy : 0.0005850791931152344 nb_pixel_total : 20045 time to create 1 rle with old method : 0.02396678924560547 length of segment : 150 time for calcul the mask position with numpy : 0.0017099380493164062 nb_pixel_total : 55459 time to create 1 rle with old method : 0.08329463005065918 length of segment : 262 time for calcul the mask position with numpy : 0.014250040054321289 nb_pixel_total : 291669 time to create 1 rle with new method : 0.37335753440856934 length of segment : 1633 time for calcul the mask position with numpy : 0.0023958683013916016 nb_pixel_total : 50762 time to create 1 rle with old method : 0.05819249153137207 length of segment : 369 time for calcul the mask position with numpy : 0.0061702728271484375 nb_pixel_total : 191680 time to create 1 rle with new method : 0.012041330337524414 length of segment : 482 time for calcul the mask position with numpy : 0.0010640621185302734 nb_pixel_total : 51288 time to create 1 rle with old method : 0.06046271324157715 length of segment : 382 time for calcul the mask position with numpy : 0.002042531967163086 nb_pixel_total : 34312 time to create 1 rle with old method : 0.03900504112243652 length of segment : 258 time for calcul the mask position with numpy : 0.0017871856689453125 nb_pixel_total : 35676 time to create 1 rle with old method : 0.04188728332519531 length of segment : 224 time for calcul the mask position with numpy : 0.0005686283111572266 nb_pixel_total : 11713 time to create 1 rle with old method : 0.013996362686157227 length of segment : 126 time for calcul the mask position with numpy : 0.004446744918823242 nb_pixel_total : 89791 time to create 1 rle with old method : 0.12662720680236816 length of segment : 474 time for calcul the mask position with numpy : 0.001581430435180664 nb_pixel_total : 25453 time to create 1 rle with old method : 0.029463529586791992 length of segment : 176 time for calcul the mask position with numpy : 0.0027933120727539062 nb_pixel_total : 57036 time to create 1 rle with old method : 0.06553077697753906 length of segment : 297 time for calcul the mask position with numpy : 0.003316164016723633 nb_pixel_total : 53631 time to create 1 rle with old method : 0.06246805191040039 length of segment : 236 time for calcul the mask position with numpy : 0.0011069774627685547 nb_pixel_total : 20482 time to create 1 rle with old method : 0.024356365203857422 length of segment : 188 time for calcul the mask position with numpy : 0.0013456344604492188 nb_pixel_total : 17613 time to create 1 rle with old method : 0.020844459533691406 length of segment : 199 time for calcul the mask position with numpy : 0.0038559436798095703 nb_pixel_total : 61967 time to create 1 rle with old method : 0.07113146781921387 length of segment : 353 time for calcul the mask position with numpy : 0.0019958019256591797 nb_pixel_total : 29211 time to create 1 rle with old method : 0.033483028411865234 length of segment : 240 time for calcul the mask position with numpy : 0.003301382064819336 nb_pixel_total : 62353 time to create 1 rle with old method : 0.0703132152557373 length of segment : 296 time for calcul the mask position with numpy : 0.0008962154388427734 nb_pixel_total : 13516 time to create 1 rle with old method : 0.019159793853759766 length of segment : 168 time for calcul the mask position with numpy : 0.0015065670013427734 nb_pixel_total : 26960 time to create 1 rle with old method : 0.03180503845214844 length of segment : 251 time for calcul the mask position with numpy : 0.0054149627685546875 nb_pixel_total : 143807 time to create 1 rle with old method : 0.16217970848083496 length of segment : 392 time for calcul the mask position with numpy : 0.0017185211181640625 nb_pixel_total : 20381 time to create 1 rle with old method : 0.02394700050354004 length of segment : 421 time for calcul the mask position with numpy : 0.0025031566619873047 nb_pixel_total : 140707 time to create 1 rle with old method : 0.16287827491760254 length of segment : 498 time for calcul the mask position with numpy : 0.0018007755279541016 nb_pixel_total : 27584 time to create 1 rle with old method : 0.03183889389038086 length of segment : 230 time for calcul the mask position with numpy : 0.004637241363525391 nb_pixel_total : 66108 time to create 1 rle with old method : 0.08021235466003418 length of segment : 405 time for calcul the mask position with numpy : 0.0005340576171875 nb_pixel_total : 9165 time to create 1 rle with old method : 0.010889530181884766 length of segment : 87 time for calcul the mask position with numpy : 0.0034732818603515625 nb_pixel_total : 48473 time to create 1 rle with old method : 0.05801796913146973 length of segment : 503 time for calcul the mask position with numpy : 0.001708984375 nb_pixel_total : 22229 time to create 1 rle with old method : 0.026585102081298828 length of segment : 192 time for calcul the mask position with numpy : 0.0006706714630126953 nb_pixel_total : 21530 time to create 1 rle with old method : 0.025625944137573242 length of segment : 166 time for calcul the mask position with numpy : 0.0008225440979003906 nb_pixel_total : 15456 time to create 1 rle with old method : 0.018408536911010742 length of segment : 135 time for calcul the mask position with numpy : 0.0019121170043945312 nb_pixel_total : 33635 time to create 1 rle with old method : 0.04020881652832031 length of segment : 176 time for calcul the mask position with numpy : 0.0015075206756591797 nb_pixel_total : 29180 time to create 1 rle with old method : 0.03359484672546387 length of segment : 214 time for calcul the mask position with numpy : 0.001070261001586914 nb_pixel_total : 17334 time to create 1 rle with old method : 0.020696640014648438 length of segment : 137 time for calcul the mask position with numpy : 0.002315998077392578 nb_pixel_total : 44430 time to create 1 rle with old method : 0.0520327091217041 length of segment : 342 time for calcul the mask position with numpy : 0.002143383026123047 nb_pixel_total : 59621 time to create 1 rle with old method : 0.06821227073669434 length of segment : 243 time for calcul the mask position with numpy : 0.0018837451934814453 nb_pixel_total : 22147 time to create 1 rle with old method : 0.028095006942749023 length of segment : 180 time for calcul the mask position with numpy : 0.0006849765777587891 nb_pixel_total : 8635 time to create 1 rle with old method : 0.014029264450073242 length of segment : 115 time for calcul the mask position with numpy : 0.0007212162017822266 nb_pixel_total : 28777 time to create 1 rle with old method : 0.03759360313415527 length of segment : 211 time for calcul the mask position with numpy : 0.0011012554168701172 nb_pixel_total : 24544 time to create 1 rle with old method : 0.028337478637695312 length of segment : 192 time for calcul the mask position with numpy : 0.0013797283172607422 nb_pixel_total : 40018 time to create 1 rle with old method : 0.048306941986083984 length of segment : 182 time for calcul the mask position with numpy : 0.0030312538146972656 nb_pixel_total : 89317 time to create 1 rle with old method : 0.1008002758026123 length of segment : 379 time for calcul the mask position with numpy : 0.0013353824615478516 nb_pixel_total : 34154 time to create 1 rle with old method : 0.05254626274108887 length of segment : 185 time for calcul the mask position with numpy : 0.0018086433410644531 nb_pixel_total : 46491 time to create 1 rle with old method : 0.056366682052612305 length of segment : 241 time for calcul the mask position with numpy : 0.0011761188507080078 nb_pixel_total : 18273 time to create 1 rle with old method : 0.0258786678314209 length of segment : 192 time for calcul the mask position with numpy : 0.0003647804260253906 nb_pixel_total : 9918 time to create 1 rle with old method : 0.012090206146240234 length of segment : 75 time for calcul the mask position with numpy : 0.003401041030883789 nb_pixel_total : 91944 time to create 1 rle with old method : 0.10990309715270996 length of segment : 277 time for calcul the mask position with numpy : 0.0014355182647705078 nb_pixel_total : 38200 time to create 1 rle with old method : 0.04653191566467285 length of segment : 220 time for calcul the mask position with numpy : 0.0009491443634033203 nb_pixel_total : 20065 time to create 1 rle with old method : 0.027654409408569336 length of segment : 185 time for calcul the mask position with numpy : 0.0003063678741455078 nb_pixel_total : 4914 time to create 1 rle with old method : 0.006125450134277344 length of segment : 63 time for calcul the mask position with numpy : 0.0002579689025878906 nb_pixel_total : 5288 time to create 1 rle with old method : 0.006279945373535156 length of segment : 74 time for calcul the mask position with numpy : 0.0032143592834472656 nb_pixel_total : 87576 time to create 1 rle with old method : 0.10078120231628418 length of segment : 349 time for calcul the mask position with numpy : 0.0027642250061035156 nb_pixel_total : 72868 time to create 1 rle with old method : 0.08876872062683105 length of segment : 284 time for calcul the mask position with numpy : 0.0007708072662353516 nb_pixel_total : 25435 time to create 1 rle with old method : 0.029860734939575195 length of segment : 115 time for calcul the mask position with numpy : 0.0005788803100585938 nb_pixel_total : 21810 time to create 1 rle with old method : 0.025645732879638672 length of segment : 107 time for calcul the mask position with numpy : 0.00041174888610839844 nb_pixel_total : 6449 time to create 1 rle with old method : 0.007684230804443359 length of segment : 115 time for calcul the mask position with numpy : 0.0017271041870117188 nb_pixel_total : 57249 time to create 1 rle with old method : 0.0673067569732666 length of segment : 247 time for calcul the mask position with numpy : 0.00047850608825683594 nb_pixel_total : 17168 time to create 1 rle with old method : 0.024689674377441406 length of segment : 152 time for calcul the mask position with numpy : 0.0006659030914306641 nb_pixel_total : 24912 time to create 1 rle with old method : 0.029130220413208008 length of segment : 157 time for calcul the mask position with numpy : 0.0002522468566894531 nb_pixel_total : 6621 time to create 1 rle with old method : 0.008180856704711914 length of segment : 72 time for calcul the mask position with numpy : 0.0005557537078857422 nb_pixel_total : 21817 time to create 1 rle with old method : 0.02607417106628418 length of segment : 91 time for calcul the mask position with numpy : 0.0002815723419189453 nb_pixel_total : 8875 time to create 1 rle with old method : 0.010861396789550781 length of segment : 64 time for calcul the mask position with numpy : 0.00037026405334472656 nb_pixel_total : 8132 time to create 1 rle with old method : 0.009531021118164062 length of segment : 179 time for calcul the mask position with numpy : 0.0010020732879638672 nb_pixel_total : 29560 time to create 1 rle with old method : 0.04124283790588379 length of segment : 194 time for calcul the mask position with numpy : 0.0004901885986328125 nb_pixel_total : 12331 time to create 1 rle with old method : 0.014898538589477539 length of segment : 94 time for calcul the mask position with numpy : 0.0007386207580566406 nb_pixel_total : 14586 time to create 1 rle with old method : 0.01982855796813965 length of segment : 143 time for calcul the mask position with numpy : 0.0005528926849365234 nb_pixel_total : 10180 time to create 1 rle with old method : 0.012675762176513672 length of segment : 100 time for calcul the mask position with numpy : 0.002137899398803711 nb_pixel_total : 59087 time to create 1 rle with old method : 0.07161235809326172 length of segment : 397 time for calcul the mask position with numpy : 0.00026798248291015625 nb_pixel_total : 3927 time to create 1 rle with old method : 0.004692554473876953 length of segment : 63 time for calcul the mask position with numpy : 0.0006015300750732422 nb_pixel_total : 10665 time to create 1 rle with old method : 0.012934684753417969 length of segment : 109 time for calcul the mask position with numpy : 0.0004820823669433594 nb_pixel_total : 13047 time to create 1 rle with old method : 0.018190622329711914 length of segment : 82 time for calcul the mask position with numpy : 0.00038170814514160156 nb_pixel_total : 6789 time to create 1 rle with old method : 0.008301019668579102 length of segment : 101 time for calcul the mask position with numpy : 0.0006084442138671875 nb_pixel_total : 17643 time to create 1 rle with old method : 0.021583080291748047 length of segment : 93 time for calcul the mask position with numpy : 0.0020172595977783203 nb_pixel_total : 51810 time to create 1 rle with old method : 0.058817148208618164 length of segment : 402 time for calcul the mask position with numpy : 0.0008571147918701172 nb_pixel_total : 12906 time to create 1 rle with old method : 0.017893314361572266 length of segment : 150 time for calcul the mask position with numpy : 0.0040149688720703125 nb_pixel_total : 155846 time to create 1 rle with new method : 0.005536317825317383 length of segment : 441 time for calcul the mask position with numpy : 0.0005772113800048828 nb_pixel_total : 12933 time to create 1 rle with old method : 0.014948129653930664 length of segment : 133 time for calcul the mask position with numpy : 0.0009355545043945312 nb_pixel_total : 35006 time to create 1 rle with old method : 0.03958320617675781 length of segment : 241 time for calcul the mask position with numpy : 0.0005023479461669922 nb_pixel_total : 14332 time to create 1 rle with old method : 0.016326189041137695 length of segment : 179 time for calcul the mask position with numpy : 0.0035271644592285156 nb_pixel_total : 175177 time to create 1 rle with new method : 0.004105806350708008 length of segment : 505 time for calcul the mask position with numpy : 0.002850055694580078 nb_pixel_total : 132995 time to create 1 rle with old method : 0.1588459014892578 length of segment : 343 time for calcul the mask position with numpy : 0.003851652145385742 nb_pixel_total : 148330 time to create 1 rle with old method : 0.16845035552978516 length of segment : 388 time for calcul the mask position with numpy : 0.0004534721374511719 nb_pixel_total : 15212 time to create 1 rle with old method : 0.017688751220703125 length of segment : 120 time for calcul the mask position with numpy : 0.0003292560577392578 nb_pixel_total : 8520 time to create 1 rle with old method : 0.010369062423706055 length of segment : 121 time for calcul the mask position with numpy : 0.0003349781036376953 nb_pixel_total : 6862 time to create 1 rle with old method : 0.00800180435180664 length of segment : 103 time for calcul the mask position with numpy : 0.0018122196197509766 nb_pixel_total : 65398 time to create 1 rle with old method : 0.07172536849975586 length of segment : 315 time for calcul the mask position with numpy : 0.0016641616821289062 nb_pixel_total : 33153 time to create 1 rle with old method : 0.05713057518005371 length of segment : 243 time for calcul the mask position with numpy : 0.0008504390716552734 nb_pixel_total : 25575 time to create 1 rle with old method : 0.030173301696777344 length of segment : 202 time for calcul the mask position with numpy : 0.0004165172576904297 nb_pixel_total : 10422 time to create 1 rle with old method : 0.01246190071105957 length of segment : 91 time for calcul the mask position with numpy : 0.0010976791381835938 nb_pixel_total : 25029 time to create 1 rle with old method : 0.029031753540039062 length of segment : 312 time for calcul the mask position with numpy : 0.00029015541076660156 nb_pixel_total : 5420 time to create 1 rle with old method : 0.006329059600830078 length of segment : 94 time spent for convertir_results : 14.902689933776855 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 137 chid ids of type : 3594 Number RLEs to save : 36665 save missing photos in datou_result : time spend for datou_step_exec : 80.71104454994202 time spend to save output : 8.302743673324585 total time spend for step 1 : 89.0137882232666 step2:crop_condition Tue Apr 29 00:31:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 137 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 95 About to insert : list_path_to_insert length 95 new photo from crops ! About to upload 95 photos upload in portfolio : 3736932 init cache_photo without model_param we have 95 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745879552_96089 we have uploaded 95 photos in the portfolio 3736932 time of upload the photos Elapsed time : 26.975581169128418 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3736932 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745879587_96089 we have uploaded 17 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.392781972885132 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745879600_96089 we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.673914909362793 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745879607_96089 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.4661431312561035 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745879609_96089 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8926775455474854 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1354057194, 1354057134, 1354056792, 1354056763, 1354056760, 1354056757, 1354056753, 1354056748] Looping around the photos to save general results len do output : 137 /1354070207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354070450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354057194', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354057134', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056792', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056763', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056760', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056757', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056753', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056748', None, None, None, None, None, '2766700') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 419 time used for this insertion : 0.044319868087768555 save_final save missing photos in datou_result : time spend for datou_step_exec : 90.58129286766052 time spend to save output : 0.05175352096557617 total time spend for step 2 : 90.6330463886261 step3:rle_unique_nms_with_priority Tue Apr 29 00:33:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 137 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 21 nb_hashtags : 5 time to prepare the origin masks : 17.176987886428833 time for calcul the mask position with numpy : 0.744652509689331 nb_pixel_total : 5202124 time to create 1 rle with new method : 2.3170325756073 time for calcul the mask position with numpy : 0.03510475158691406 nb_pixel_total : 21926 time to create 1 rle with old method : 0.025242328643798828 time for calcul the mask position with numpy : 0.023033857345581055 nb_pixel_total : 19909 time to create 1 rle with old method : 0.022264957427978516 time for calcul the mask position with numpy : 0.020622968673706055 nb_pixel_total : 18448 time to create 1 rle with old method : 0.020964384078979492 time for calcul the mask position with numpy : 0.020913362503051758 nb_pixel_total : 11935 time to create 1 rle with old method : 0.013573646545410156 time for calcul the mask position with numpy : 0.022022008895874023 nb_pixel_total : 123450 time to create 1 rle with old method : 0.16564154624938965 time for calcul the mask position with numpy : 0.026015758514404297 nb_pixel_total : 37989 time to create 1 rle with old method : 0.04444003105163574 time for calcul the mask position with numpy : 0.026549816131591797 nb_pixel_total : 5807 time to create 1 rle with old method : 0.009460687637329102 time for calcul the mask position with numpy : 0.040094614028930664 nb_pixel_total : 19061 time to create 1 rle with old method : 0.02788853645324707 time for calcul the mask position with numpy : 0.035871267318725586 nb_pixel_total : 15448 time to create 1 rle with old method : 0.017145395278930664 time for calcul the mask position with numpy : 0.03492403030395508 nb_pixel_total : 27544 time to create 1 rle with old method : 0.030600309371948242 time for calcul the mask position with numpy : 0.03634357452392578 nb_pixel_total : 103078 time to create 1 rle with old method : 0.11484146118164062 time for calcul the mask position with numpy : 0.03548145294189453 nb_pixel_total : 20831 time to create 1 rle with old method : 0.0235593318939209 time for calcul the mask position with numpy : 0.032358407974243164 nb_pixel_total : 64025 time to create 1 rle with old method : 0.07211661338806152 time for calcul the mask position with numpy : 0.022448301315307617 nb_pixel_total : 123101 time to create 1 rle with old method : 0.13862967491149902 time for calcul the mask position with numpy : 0.021696805953979492 nb_pixel_total : 6399 time to create 1 rle with old method : 0.007355690002441406 time for calcul the mask position with numpy : 0.026887893676757812 nb_pixel_total : 527222 time to create 1 rle with new method : 0.7990477085113525 time for calcul the mask position with numpy : 0.0276947021484375 nb_pixel_total : 620687 time to create 1 rle with new method : 0.5845205783843994 time for calcul the mask position with numpy : 0.021915197372436523 nb_pixel_total : 13481 time to create 1 rle with old method : 0.019902944564819336 time for calcul the mask position with numpy : 0.02458667755126953 nb_pixel_total : 13391 time to create 1 rle with old method : 0.021770000457763672 time for calcul the mask position with numpy : 0.024320363998413086 nb_pixel_total : 16938 time to create 1 rle with old method : 0.021971464157104492 time for calcul the mask position with numpy : 0.02391219139099121 nb_pixel_total : 37446 time to create 1 rle with old method : 0.04291701316833496 create new chi : 5.950688600540161 time to delete rle : 0.02435922622680664 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 12917 TO DO : save crop sub photo not yet done ! save time : 2.2475545406341553 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 14.289067029953003 time for calcul the mask position with numpy : 0.9380173683166504 nb_pixel_total : 4756575 time to create 1 rle with new method : 1.3152437210083008 time for calcul the mask position with numpy : 0.023062944412231445 nb_pixel_total : 151917 time to create 1 rle with new method : 1.2032115459442139 time for calcul the mask position with numpy : 0.020978450775146484 nb_pixel_total : 23163 time to create 1 rle with old method : 0.025414705276489258 time for calcul the mask position with numpy : 0.021599531173706055 nb_pixel_total : 11292 time to create 1 rle with old method : 0.012809514999389648 time for calcul the mask position with numpy : 0.02231287956237793 nb_pixel_total : 22126 time to create 1 rle with old method : 0.024633169174194336 time for calcul the mask position with numpy : 0.022816181182861328 nb_pixel_total : 129952 time to create 1 rle with old method : 0.14947986602783203 time for calcul the mask position with numpy : 0.0248563289642334 nb_pixel_total : 153193 time to create 1 rle with new method : 0.7835061550140381 time for calcul the mask position with numpy : 0.023576021194458008 nb_pixel_total : 22027 time to create 1 rle with old method : 0.02491283416748047 time for calcul the mask position with numpy : 0.046710968017578125 nb_pixel_total : 1120095 time to create 1 rle with new method : 1.3503212928771973 time for calcul the mask position with numpy : 0.022542715072631836 nb_pixel_total : 55553 time to create 1 rle with old method : 0.062367916107177734 time for calcul the mask position with numpy : 0.02148723602294922 nb_pixel_total : 6722 time to create 1 rle with old method : 0.007485628128051758 time for calcul the mask position with numpy : 0.02146148681640625 nb_pixel_total : 132179 time to create 1 rle with old method : 0.1435563564300537 time for calcul the mask position with numpy : 0.020643949508666992 nb_pixel_total : 65108 time to create 1 rle with old method : 0.07160019874572754 time for calcul the mask position with numpy : 0.020770549774169922 nb_pixel_total : 12704 time to create 1 rle with old method : 0.013701677322387695 time for calcul the mask position with numpy : 0.02202606201171875 nb_pixel_total : 29820 time to create 1 rle with old method : 0.03319287300109863 time for calcul the mask position with numpy : 0.020863771438598633 nb_pixel_total : 69118 time to create 1 rle with old method : 0.07745146751403809 time for calcul the mask position with numpy : 0.02178478240966797 nb_pixel_total : 36566 time to create 1 rle with old method : 0.04060769081115723 time for calcul the mask position with numpy : 0.021990299224853516 nb_pixel_total : 44642 time to create 1 rle with old method : 0.04985404014587402 time for calcul the mask position with numpy : 0.03476357460021973 nb_pixel_total : 40447 time to create 1 rle with old method : 0.04484724998474121 time for calcul the mask position with numpy : 0.0346987247467041 nb_pixel_total : 167041 time to create 1 rle with new method : 1.2589120864868164 create new chi : 8.243719100952148 time to delete rle : 0.002037525177001953 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 15071 TO DO : save crop sub photo not yet done ! save time : 3.3859753608703613 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 10.483623027801514 time for calcul the mask position with numpy : 1.87449049949646 nb_pixel_total : 5336903 time to create 1 rle with new method : 2.2747511863708496 time for calcul the mask position with numpy : 0.03284263610839844 nb_pixel_total : 1866 time to create 1 rle with old method : 0.0022628307342529297 time for calcul the mask position with numpy : 0.033564090728759766 nb_pixel_total : 191680 time to create 1 rle with new method : 1.339083194732666 time for calcul the mask position with numpy : 0.03335165977478027 nb_pixel_total : 50762 time to create 1 rle with old method : 0.06047868728637695 time for calcul the mask position with numpy : 0.03349804878234863 nb_pixel_total : 291669 time to create 1 rle with new method : 1.0472447872161865 time for calcul the mask position with numpy : 0.031105518341064453 nb_pixel_total : 55459 time to create 1 rle with old method : 0.060764312744140625 time for calcul the mask position with numpy : 0.02171492576599121 nb_pixel_total : 20045 time to create 1 rle with old method : 0.0223236083984375 time for calcul the mask position with numpy : 0.022321224212646484 nb_pixel_total : 114320 time to create 1 rle with old method : 0.12906956672668457 time for calcul the mask position with numpy : 0.021681785583496094 nb_pixel_total : 91450 time to create 1 rle with old method : 0.10235738754272461 time for calcul the mask position with numpy : 0.03044414520263672 nb_pixel_total : 66342 time to create 1 rle with old method : 0.07425189018249512 time for calcul the mask position with numpy : 0.03701305389404297 nb_pixel_total : 162960 time to create 1 rle with new method : 1.0243282318115234 time for calcul the mask position with numpy : 0.04253029823303223 nb_pixel_total : 570370 time to create 1 rle with new method : 0.8010179996490479 time for calcul the mask position with numpy : 0.03324007987976074 nb_pixel_total : 64520 time to create 1 rle with old method : 0.0697169303894043 time for calcul the mask position with numpy : 0.03084564208984375 nb_pixel_total : 31894 time to create 1 rle with old method : 0.03450417518615723 create new chi : 9.45516586303711 time to delete rle : 0.0018029212951660156 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 14052 TO DO : save crop sub photo not yet done ! save time : 2.603334426879883 nb_obj : 32 nb_hashtags : 3 time to prepare the origin masks : 3.7965433597564697 time for calcul the mask position with numpy : 1.235750675201416 nb_pixel_total : 5932988 time to create 1 rle with new method : 0.9043798446655273 time for calcul the mask position with numpy : 0.029137611389160156 nb_pixel_total : 20482 time to create 1 rle with old method : 0.023349761962890625 time for calcul the mask position with numpy : 0.029081344604492188 nb_pixel_total : 29211 time to create 1 rle with old method : 0.03346371650695801 time for calcul the mask position with numpy : 0.0292665958404541 nb_pixel_total : 53631 time to create 1 rle with old method : 0.06210470199584961 time for calcul the mask position with numpy : 0.029178619384765625 nb_pixel_total : 143807 time to create 1 rle with old method : 0.15993547439575195 time for calcul the mask position with numpy : 0.028867721557617188 nb_pixel_total : 12618 time to create 1 rle with old method : 0.014847755432128906 time for calcul the mask position with numpy : 0.029055356979370117 nb_pixel_total : 17613 time to create 1 rle with old method : 0.019815683364868164 time for calcul the mask position with numpy : 0.02885580062866211 nb_pixel_total : 34312 time to create 1 rle with old method : 0.03880572319030762 time for calcul the mask position with numpy : 0.02775430679321289 nb_pixel_total : 1737 time to create 1 rle with old method : 0.0019278526306152344 time for calcul the mask position with numpy : 0.02810955047607422 nb_pixel_total : 22147 time to create 1 rle with old method : 0.024353742599487305 time for calcul the mask position with numpy : 0.027181148529052734 nb_pixel_total : 1228 time to create 1 rle with old method : 0.001438140869140625 time for calcul the mask position with numpy : 0.02815079689025879 nb_pixel_total : 26960 time to create 1 rle with old method : 0.031217575073242188 time for calcul the mask position with numpy : 0.02877950668334961 nb_pixel_total : 27584 time to create 1 rle with old method : 0.031759023666381836 time for calcul the mask position with numpy : 0.02894282341003418 nb_pixel_total : 44430 time to create 1 rle with old method : 0.050023794174194336 time for calcul the mask position with numpy : 0.02852916717529297 nb_pixel_total : 11713 time to create 1 rle with old method : 0.013358831405639648 time for calcul the mask position with numpy : 0.02873396873474121 nb_pixel_total : 22229 time to create 1 rle with old method : 0.03325915336608887 time for calcul the mask position with numpy : 0.032685041427612305 nb_pixel_total : 13516 time to create 1 rle with old method : 0.02044510841369629 time for calcul the mask position with numpy : 0.028943538665771484 nb_pixel_total : 17334 time to create 1 rle with old method : 0.019714832305908203 time for calcul the mask position with numpy : 0.0290834903717041 nb_pixel_total : 15456 time to create 1 rle with old method : 0.017827510833740234 time for calcul the mask position with numpy : 0.029170751571655273 nb_pixel_total : 62353 time to create 1 rle with old method : 0.07101631164550781 time for calcul the mask position with numpy : 0.029688358306884766 nb_pixel_total : 66108 time to create 1 rle with old method : 0.0750420093536377 time for calcul the mask position with numpy : 0.029858827590942383 nb_pixel_total : 89791 time to create 1 rle with old method : 0.09975814819335938 time for calcul the mask position with numpy : 0.028609275817871094 nb_pixel_total : 20381 time to create 1 rle with old method : 0.02302837371826172 time for calcul the mask position with numpy : 0.028811216354370117 nb_pixel_total : 8635 time to create 1 rle with old method : 0.009491682052612305 time for calcul the mask position with numpy : 0.027823925018310547 nb_pixel_total : 35676 time to create 1 rle with old method : 0.038872480392456055 time for calcul the mask position with numpy : 0.028248071670532227 nb_pixel_total : 33621 time to create 1 rle with old method : 0.03562426567077637 time for calcul the mask position with numpy : 0.02684640884399414 nb_pixel_total : 57036 time to create 1 rle with old method : 0.06087231636047363 time for calcul the mask position with numpy : 0.027382612228393555 nb_pixel_total : 57872 time to create 1 rle with old method : 0.06349897384643555 time for calcul the mask position with numpy : 0.028287172317504883 nb_pixel_total : 44006 time to create 1 rle with old method : 0.04916095733642578 time for calcul the mask position with numpy : 0.0289456844329834 nb_pixel_total : 25453 time to create 1 rle with old method : 0.028794288635253906 time for calcul the mask position with numpy : 0.02910614013671875 nb_pixel_total : 61967 time to create 1 rle with old method : 0.06806349754333496 time for calcul the mask position with numpy : 0.028080224990844727 nb_pixel_total : 29180 time to create 1 rle with old method : 0.0332183837890625 time for calcul the mask position with numpy : 0.028789281845092773 nb_pixel_total : 9165 time to create 1 rle with old method : 0.010526180267333984 create new chi : 4.362978219985962 time to delete rle : 0.0021369457244873047 batch 1 Loaded 65 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17075 TO DO : save crop sub photo not yet done ! save time : 3.246143341064453 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 13.874255895614624 time for calcul the mask position with numpy : 1.4134502410888672 nb_pixel_total : 6355727 time to create 1 rle with new method : 0.9895203113555908 time for calcul the mask position with numpy : 0.024904966354370117 nb_pixel_total : 57249 time to create 1 rle with old method : 0.068603515625 time for calcul the mask position with numpy : 0.03730940818786621 nb_pixel_total : 6449 time to create 1 rle with old method : 0.0075113773345947266 time for calcul the mask position with numpy : 0.03580474853515625 nb_pixel_total : 21810 time to create 1 rle with old method : 0.025064945220947266 time for calcul the mask position with numpy : 0.023801803588867188 nb_pixel_total : 25435 time to create 1 rle with old method : 0.029324769973754883 time for calcul the mask position with numpy : 0.02830815315246582 nb_pixel_total : 72868 time to create 1 rle with old method : 0.08095479011535645 time for calcul the mask position with numpy : 0.02393960952758789 nb_pixel_total : 87576 time to create 1 rle with old method : 0.10131001472473145 time for calcul the mask position with numpy : 0.02215886116027832 nb_pixel_total : 5288 time to create 1 rle with old method : 0.006096601486206055 time for calcul the mask position with numpy : 0.021826744079589844 nb_pixel_total : 4914 time to create 1 rle with old method : 0.005669355392456055 time for calcul the mask position with numpy : 0.021773815155029297 nb_pixel_total : 20065 time to create 1 rle with old method : 0.022830724716186523 time for calcul the mask position with numpy : 0.02615046501159668 nb_pixel_total : 38200 time to create 1 rle with old method : 0.04307389259338379 time for calcul the mask position with numpy : 0.023678064346313477 nb_pixel_total : 91944 time to create 1 rle with old method : 0.10538649559020996 time for calcul the mask position with numpy : 0.022705554962158203 nb_pixel_total : 9918 time to create 1 rle with old method : 0.011282920837402344 time for calcul the mask position with numpy : 0.02315211296081543 nb_pixel_total : 18273 time to create 1 rle with old method : 0.020779132843017578 time for calcul the mask position with numpy : 0.022739887237548828 nb_pixel_total : 46491 time to create 1 rle with old method : 0.05304670333862305 time for calcul the mask position with numpy : 0.02402472496032715 nb_pixel_total : 34154 time to create 1 rle with old method : 0.038825035095214844 time for calcul the mask position with numpy : 0.02426886558532715 nb_pixel_total : 89317 time to create 1 rle with old method : 0.10147261619567871 time for calcul the mask position with numpy : 0.02434563636779785 nb_pixel_total : 40018 time to create 1 rle with old method : 0.044896602630615234 time for calcul the mask position with numpy : 0.023308277130126953 nb_pixel_total : 24544 time to create 1 rle with old method : 0.02851390838623047 create new chi : 3.6864259243011475 time to delete rle : 0.0016355514526367188 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 9124 TO DO : save crop sub photo not yet done ! save time : 1.1795501708984375 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 3.373150110244751 time for calcul the mask position with numpy : 2.6275994777679443 nb_pixel_total : 6962715 time to create 1 rle with new method : 2.5858333110809326 time for calcul the mask position with numpy : 0.02190542221069336 nb_pixel_total : 8132 time to create 1 rle with old method : 0.009295225143432617 time for calcul the mask position with numpy : 0.021311044692993164 nb_pixel_total : 8875 time to create 1 rle with old method : 0.010005474090576172 time for calcul the mask position with numpy : 0.02185988426208496 nb_pixel_total : 21817 time to create 1 rle with old method : 0.024883747100830078 time for calcul the mask position with numpy : 0.023504972457885742 nb_pixel_total : 6621 time to create 1 rle with old method : 0.007665395736694336 time for calcul the mask position with numpy : 0.022629737854003906 nb_pixel_total : 24912 time to create 1 rle with old method : 0.029513835906982422 time for calcul the mask position with numpy : 0.022742509841918945 nb_pixel_total : 17168 time to create 1 rle with old method : 0.02487921714782715 create new chi : 5.495863676071167 time to delete rle : 0.0005326271057128906 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 3590 TO DO : save crop sub photo not yet done ! save time : 1.4522507190704346 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 11.826405763626099 time for calcul the mask position with numpy : 0.7083146572113037 nb_pixel_total : 6589592 time to create 1 rle with new method : 0.7918472290039062 time for calcul the mask position with numpy : 0.022328615188598633 nb_pixel_total : 14332 time to create 1 rle with old method : 0.016137361526489258 time for calcul the mask position with numpy : 0.02224254608154297 nb_pixel_total : 35006 time to create 1 rle with old method : 0.04110288619995117 time for calcul the mask position with numpy : 0.022706985473632812 nb_pixel_total : 12933 time to create 1 rle with old method : 0.014838218688964844 time for calcul the mask position with numpy : 0.025369644165039062 nb_pixel_total : 155846 time to create 1 rle with new method : 0.6120281219482422 time for calcul the mask position with numpy : 0.022229671478271484 nb_pixel_total : 12906 time to create 1 rle with old method : 0.014594554901123047 time for calcul the mask position with numpy : 0.02194833755493164 nb_pixel_total : 51810 time to create 1 rle with old method : 0.07221102714538574 time for calcul the mask position with numpy : 0.02534651756286621 nb_pixel_total : 17643 time to create 1 rle with old method : 0.019952774047851562 time for calcul the mask position with numpy : 0.021779537200927734 nb_pixel_total : 6789 time to create 1 rle with old method : 0.00768589973449707 time for calcul the mask position with numpy : 0.021533489227294922 nb_pixel_total : 13047 time to create 1 rle with old method : 0.01485300064086914 time for calcul the mask position with numpy : 0.022784709930419922 nb_pixel_total : 10665 time to create 1 rle with old method : 0.012204885482788086 time for calcul the mask position with numpy : 0.023331165313720703 nb_pixel_total : 3927 time to create 1 rle with old method : 0.005106449127197266 time for calcul the mask position with numpy : 0.026429414749145508 nb_pixel_total : 59087 time to create 1 rle with old method : 0.06829547882080078 time for calcul the mask position with numpy : 0.03447270393371582 nb_pixel_total : 10180 time to create 1 rle with old method : 0.012793779373168945 time for calcul the mask position with numpy : 0.03554034233093262 nb_pixel_total : 14586 time to create 1 rle with old method : 0.018994569778442383 time for calcul the mask position with numpy : 0.022579669952392578 nb_pixel_total : 12331 time to create 1 rle with old method : 0.01402902603149414 time for calcul the mask position with numpy : 0.024159669876098633 nb_pixel_total : 29560 time to create 1 rle with old method : 0.03355145454406738 create new chi : 2.9445457458496094 time to delete rle : 0.0016641616821289062 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 8004 TO DO : save crop sub photo not yet done ! save time : 0.7649052143096924 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 7.520697832107544 time for calcul the mask position with numpy : 1.0559535026550293 nb_pixel_total : 6398147 time to create 1 rle with new method : 0.7179098129272461 time for calcul the mask position with numpy : 0.02193474769592285 nb_pixel_total : 5420 time to create 1 rle with old method : 0.021399736404418945 time for calcul the mask position with numpy : 0.021557092666625977 nb_pixel_total : 25029 time to create 1 rle with old method : 0.03029346466064453 time for calcul the mask position with numpy : 0.02357959747314453 nb_pixel_total : 10422 time to create 1 rle with old method : 0.011793851852416992 time for calcul the mask position with numpy : 0.022538185119628906 nb_pixel_total : 25575 time to create 1 rle with old method : 0.029272794723510742 time for calcul the mask position with numpy : 0.03480124473571777 nb_pixel_total : 33153 time to create 1 rle with old method : 0.042520761489868164 time for calcul the mask position with numpy : 0.038214921951293945 nb_pixel_total : 65398 time to create 1 rle with old method : 0.07312965393066406 time for calcul the mask position with numpy : 0.030785083770751953 nb_pixel_total : 6862 time to create 1 rle with old method : 0.0076940059661865234 time for calcul the mask position with numpy : 0.023221254348754883 nb_pixel_total : 8520 time to create 1 rle with old method : 0.009610891342163086 time for calcul the mask position with numpy : 0.02866816520690918 nb_pixel_total : 15212 time to create 1 rle with old method : 0.017108917236328125 time for calcul the mask position with numpy : 0.026812314987182617 nb_pixel_total : 148330 time to create 1 rle with old method : 0.17717289924621582 time for calcul the mask position with numpy : 0.023749589920043945 nb_pixel_total : 132995 time to create 1 rle with old method : 0.15550851821899414 time for calcul the mask position with numpy : 0.022637128829956055 nb_pixel_total : 175177 time to create 1 rle with new method : 0.2998063564300537 create new chi : 3.0333027839660645 time to delete rle : 0.001173257827758789 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 7834 TO DO : save crop sub photo not yet done ! save time : 2.508794069290161 map_output_result : {1354057194: (0.0, 'Should be the crop_list due to order', 0), 1354057134: (0.0, 'Should be the crop_list due to order', 0), 1354056792: (0.0, 'Should be the crop_list due to order', 0), 1354056763: (0.0, 'Should be the crop_list due to order', 0), 1354056760: (0.0, 'Should be the crop_list due to order', 0), 1354056757: (0.0, 'Should be the crop_list due to order', 0), 1354056753: (0.0, 'Should be the crop_list due to order', 0), 1354056748: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1354057194, 1354057134, 1354056792, 1354056763, 1354056760, 1354056757, 1354056753, 1354056748] Looping around the photos to save general results len do output : 8 /1354057194.Didn't retrieve data . /1354057134.Didn't retrieve data . /1354056792.Didn't retrieve data . /1354056763.Didn't retrieve data . /1354056760.Didn't retrieve data . /1354056757.Didn't retrieve data . /1354056753.Didn't retrieve data . /1354056748.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354057194', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354057134', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056792', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056763', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056760', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056757', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056753', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056748', None, None, None, None, None, '2766700') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.0160064697265625 save_final save missing photos in datou_result : time spend for datou_step_exec : 144.49948239326477 time spend to save output : 0.02295398712158203 total time spend for step 3 : 144.52243638038635 step4:ventilate_hashtags_in_portfolio Tue Apr 29 00:35:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22477709 get user id for portfolio 22477709 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22477709 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','environnement','metal','carton','papier','flou','mal_croppe','background','pet_clair','autre','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22477709 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','environnement','metal','carton','papier','flou','mal_croppe','background','pet_clair','autre','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22477709 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','environnement','metal','carton','papier','flou','mal_croppe','background','pet_clair','autre','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22478633,22478634,22478635,22478636,22478637,22478638,22478639,22478640,22478641,22478642,22478643?tags=pet_fonce,environnement,metal,carton,papier,flou,mal_croppe,background,pet_clair,autre,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1354057194, 1354057134, 1354056792, 1354056763, 1354056760, 1354056757, 1354056753, 1354056748] Looping around the photos to save general results len do output : 1 /22477709. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354057194', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354057134', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056792', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056763', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056760', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056757', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056753', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056748', None, None, None, None, None, '2766700') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01589345932006836 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.7156803607940674 time spend to save output : 0.01625370979309082 total time spend for step 4 : 2.731934070587158 step5:final Tue Apr 29 00:35:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1354057194: ('0.15721360194830247',), 1354057134: ('0.15721360194830247',), 1354056792: ('0.15721360194830247',), 1354056763: ('0.15721360194830247',), 1354056760: ('0.15721360194830247',), 1354056757: ('0.15721360194830247',), 1354056753: ('0.15721360194830247',), 1354056748: ('0.15721360194830247',)} new output for save of step final : {1354057194: ('0.15721360194830247',), 1354057134: ('0.15721360194830247',), 1354056792: ('0.15721360194830247',), 1354056763: ('0.15721360194830247',), 1354056760: ('0.15721360194830247',), 1354056757: ('0.15721360194830247',), 1354056753: ('0.15721360194830247',), 1354056748: ('0.15721360194830247',)} [1354057194, 1354057134, 1354056792, 1354056763, 1354056760, 1354056757, 1354056753, 1354056748] Looping around the photos to save general results len do output : 8 /1354057194.Didn't retrieve data . /1354057134.Didn't retrieve data . /1354056792.Didn't retrieve data . /1354056763.Didn't retrieve data . /1354056760.Didn't retrieve data . /1354056757.Didn't retrieve data . /1354056753.Didn't retrieve data . /1354056748.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354057194', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354057134', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056792', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056763', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056760', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056757', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056753', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056748', None, None, None, None, None, '2766700') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.05627083778381348 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.23404216766357422 time spend to save output : 0.059186697006225586 total time spend for step 5 : 0.2932288646697998 step6:blur_detection Tue Apr 29 00:35:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf.jpg resize: (2160, 3264) 1354057194 -2.167795573647124 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a.jpg resize: (2160, 3264) 1354057134 2.162376960936548 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143.jpg resize: (2160, 3264) 1354056792 -1.1330020250821549 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8.jpg resize: (2160, 3264) 1354056763 -3.8038341384308163 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a.jpg resize: (2160, 3264) 1354056760 -0.020901450869087894 treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157.jpg resize: (2160, 3264) 1354056757 -0.3981439141596649 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20.jpg resize: (2160, 3264) 1354056753 -1.2985278532698645 treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6.jpg resize: (2160, 3264) 1354056748 -1.2481262884767095 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891988_0.png resize: (811, 840) 1354070207 0.0201827093335932 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891998_0.png resize: (299, 164) 1354070210 -0.9395140040147354 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891992_0.png resize: (144, 335) 1354070212 -1.4745108691073103 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891983_0.png resize: (339, 192) 1354070214 -1.1913849046154177 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891997_0.png resize: (71, 120) 1354070216 -1.351336390547558 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891996_0.png resize: (172, 188) 1354070218 -0.024007374416592724 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891985_0.png resize: (166, 145) 1354070221 -1.1262756073099471 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771892002_0.png resize: (407, 136) 1354070223 -3.8175158506999822 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892011_0.png resize: (271, 364) 1354070225 -1.3429197028905189 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892021_0.png resize: (222, 157) 1354070228 -1.840200936860709 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892012_0.png resize: (427, 605) 1354070230 -0.7764782350061379 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892009_0.png resize: (247, 185) 1354070232 -1.171313919275668 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892015_0.png resize: (920, 1793) 1354070235 0.5638431158983922 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892018_0.png resize: (387, 559) 1354070237 -1.0126040469579312 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892007_0.png resize: (220, 315) 1354070239 -0.5766703110507085 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892010_0.png resize: (230, 169) 1354070241 -2.160449045965286 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892016_0.png resize: (141, 243) 1354070244 -1.2054953314568393 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892020_0.png resize: (151, 131) 1354070246 -1.9498818077241387 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892013_0.png resize: (150, 56) 1354070248 1.5519705767979373 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892005_0.png resize: (221, 315) 1354070251 -0.79245066633795 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892019_0.png resize: (123, 222) 1354070253 -0.2792815005930648 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892032_0.png resize: (1078, 602) 1354070255 -2.2506637351189966 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892023_0.png resize: (209, 237) 1354070258 -1.6296238661834839 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892024_0.png resize: (316, 254) 1354070260 -0.7936998171933074 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892031_0.png resize: (262, 320) 1354070262 -0.7870449291363544 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892034_0.png resize: (383, 794) 1354070265 -1.8075733873910227 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892035_0.png resize: (377, 209) 1354070267 -1.4011081864395587 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892025_0.png resize: (1001, 733) 1354070269 -0.043808707534410275 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892039_0.png resize: (446, 335) 1354070272 -1.2459541935067249 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892067_0.png resize: (180, 206) 1354070274 -1.21024891357368 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892052_0.png resize: (379, 412) 1354070277 -1.0591052226699333 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892058_0.png resize: (168, 202) 1354070279 -1.3658629988633035 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892055_0.png resize: (85, 148) 1354070281 -1.1852711615193043 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892061_0.png resize: (210, 224) 1354070283 -2.167225450781879 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892043_0.png resize: (188, 150) 1354070285 -2.2631000952584692 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892037_0.png resize: (224, 253) 1354070287 -0.9934024297672319 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892036_0.png resize: (258, 211) 1354070289 -1.6468586992743837 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892059_0.png resize: (135, 152) 1354070291 -2.5768484379741863 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892053_0.png resize: (203, 210) 1354070293 -3.164542210569675 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892054_0.png resize: (310, 338) 1354070295 -1.5611779785000393 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892038_0.png resize: (126, 106) 1354070298 6.020914526155539 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892060_0.png resize: (171, 297) 1354070300 -0.6799424151663397 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892044_0.png resize: (224, 124) 1354070302 -1.475173776564487 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892045_0.png resize: (332, 354) 1354070304 -2.757943079582557 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892042_0.png resize: (236, 365) 1354070306 -2.052466075100405 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892062_0.png resize: (136, 206) 1354070308 -1.6164141510445602 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892047_0.png resize: (275, 319) 1354070310 -1.6678842289686016 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892063_0.png resize: (215, 301) 1354070312 -3.142562329891745 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892041_0.png resize: (294, 313) 1354070314 -2.598278554707887 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892048_0.png resize: (168, 127) 1354070316 -3.19463782970766 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892066_0.png resize: (113, 92) 1354070318 -3.4048791863599206 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892049_0.png resize: (212, 192) 1354070320 -1.9861213310777541 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892057_0.png resize: (169, 217) 1354070322 -2.9717326495420338 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892051_0.png resize: (339, 135) 1354070324 -2.004969243275574 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892084_0.png resize: (114, 73) 1354070326 0.3041062390319217 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892073_0.png resize: (186, 221) 1354070328 -2.0434583118770284 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892069_0.png resize: (180, 286) 1354070330 -0.9890896509875481 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892079_0.png resize: (74, 90) 1354070332 0.5709653093739008 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892071_0.png resize: (148, 356) 1354070334 -1.100769962344351 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892068_0.png resize: (191, 233) 1354070336 -0.6599346551890207 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892072_0.png resize: (234, 353) 1354070338 -0.6498958304929475 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892074_0.png resize: (75, 173) 1354070340 -0.5299007535065569 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892070_0.png resize: (379, 358) 1354070342 -0.39180278107152267 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892078_0.png resize: (63, 123) 1354070344 -1.1521669212898629 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892085_0.png resize: (236, 286) 1354070346 -0.3049461712685891 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892080_0.png resize: (346, 415) 1354070348 -1.4497434757513334 treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157_rle_crop_3771892088_0.png resize: (72, 159) 1354070350 -2.528688283552076 treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157_rle_crop_3771892091_0.png resize: (165, 77) 1354070352 -2.017799670049877 treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157_rle_crop_3771892087_0.png resize: (147, 244) 1354070354 -0.764127190534855 treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157_rle_crop_3771892089_0.png resize: (89, 362) 1354070356 -0.8266102888161282 treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157_rle_crop_3771892086_0.png resize: (152, 170) 1354070358 -1.8209738917895528 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892107_0.png resize: (176, 111) 1354070360 -0.8687775689671525 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892097_0.png resize: (63, 85) 1354070362 -0.5004995358683104 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892103_0.png resize: (181, 167) 1354070363 -1.8802162192075667 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892098_0.png resize: (104, 152) 1354070364 -1.8065030192352167 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892094_0.png resize: (143, 167) 1354070365 -1.1015647517940461 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892092_0.png resize: (194, 210) 1354070366 -0.1990203569039474 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892095_0.png resize: (99, 123) 1354070367 2.0525683109216555 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892093_0.png resize: (94, 187) 1354070368 -0.6467682108607848 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892096_0.png resize: (347, 250) 1354070369 -1.7857084534311074 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892102_0.png resize: (376, 251) 1354070370 -1.1074498213079607 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892105_0.png resize: (133, 134) 1354070371 -0.1827119954074522 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892101_0.png resize: (92, 274) 1354070372 -0.7840026942844878 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892104_0.png resize: (441, 486) 1354070373 -0.2424290377007317 treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892117_0.png resize: (87, 161) 1354070374 -1.6679401430260166 treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892108_0.png resize: (455, 466) 1354070375 -0.9036853304064734 treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892109_0.png resize: (337, 523) 1354070376 0.620365595649397 treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892110_0.png resize: (388, 525) 1354070378 -0.08492987542336765 treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892115_0.png resize: (243, 231) 1354070379 -3.3272554637758045 treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892113_0.png resize: (103, 100) 1354070380 -0.6855457764778872 treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892112_0.png resize: (121, 100) 1354070381 -0.6098974565468396 treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892119_0.png resize: (94, 90) 1354070382 -0.9726128095756729 treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892114_0.png resize: (315, 311) 1354070383 -1.7276934241687365 treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892118_0.png resize: (244, 252) 1354070384 -1.235858061238763 treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892111_0.png resize: (120, 196) 1354070385 -1.6918237459119494 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771892003_0.png resize: (242, 189) 1354070392 -1.4263857052723017 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771892000_0.png resize: (106, 170) 1354070393 -1.929193823947594 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891984_0.png resize: (111, 190) 1354070394 -0.23925795796879573 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891986_0.png resize: (116, 176) 1354070395 -0.8563814993914302 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891987_0.png resize: (781, 1065) 1354070396 -1.0041388375257705 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892006_0.png resize: (165, 359) 1354070397 -0.9015115821817345 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892028_0.png resize: (399, 375) 1354070398 -0.9656869055585865 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892030_0.png resize: (128, 192) 1354070399 -1.7725146457747014 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892033_0.png resize: (366, 196) 1354070400 -1.367711783365048 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892027_0.png resize: (340, 312) 1354070401 -0.7838772349944261 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892056_0.png resize: (381, 244) 1354070403 -3.2126282707392266 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892040_0.png resize: (175, 199) 1354070404 -1.125776201927376 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892065_0.png resize: (168, 238) 1354070406 -1.2643063945050503 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892046_0.png resize: (239, 215) 1354070407 -1.9124599789062469 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892077_0.png resize: (157, 164) 1354070408 -1.5898328354082867 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892076_0.png resize: (180, 337) 1354070409 -1.9824247874244114 treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157_rle_crop_3771892090_0.png resize: (64, 173) 1354070410 -0.7427439600458922 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891995_0.png resize: (143, 132) 1354070419 -2.0837741645197148 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771892001_0.png resize: (202, 166) 1354070420 -2.86399082743955 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891991_0.png resize: (268, 357) 1354070421 -3.493103680684338 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891993_0.png resize: (223, 637) 1354070422 -3.1740935704040285 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891999_0.png resize: (301, 596) 1354070423 -1.7827009022331926 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891990_0.png resize: (291, 510) 1354070424 -0.8953688560782044 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892004_0.png resize: (494, 442) 1354070425 -0.7613442137354134 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892022_0.png resize: (500, 739) 1354070426 -1.7748046238000699 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892017_0.png resize: (263, 719) 1354070427 -1.1702121632902296 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892008_0.png resize: (157, 512) 1354070428 -0.08783258689763433 treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892014_0.png resize: (358, 240) 1354070429 -1.1644089279049112 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892029_0.png resize: (268, 684) 1354070430 -1.4979232527240105 treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892026_0.png resize: (277, 852) 1354070431 -2.848627953076126 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892050_0.png resize: (384, 432) 1354070432 -0.3375106735177107 treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892064_0.png resize: (204, 421) 1354070433 -1.9379651826942434 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892075_0.png resize: (212, 703) 1354070434 -1.309758345731471 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892081_0.png resize: (284, 404) 1354070435 -2.1634428247811255 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892083_0.png resize: (103, 267) 1354070436 -0.7592763953698933 treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892082_0.png resize: (115, 258) 1354070437 2.2549477849646746 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892099_0.png resize: (80, 218) 1354070438 -0.8511615332512055 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892106_0.png resize: (230, 163) 1354070439 0.43277077355015364 treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892116_0.png resize: (202, 164) 1354070440 -2.0303107502238213 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891989_0.png resize: (74, 106) 1354070442 1.5814290844044703 treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891994_0.png resize: (211, 206) 1354070449 -0.6445926160856632 treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892100_0.png resize: (101, 80) 1354070450 2.2707364524260196 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 145 time used for this insertion : 0.02149200439453125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 145 time used for this insertion : 1.1042535305023193 save missing photos in datou_result : time spend for datou_step_exec : 38.70848059654236 time spend to save output : 1.1320979595184326 total time spend for step 6 : 39.84057855606079 step7:brightness Tue Apr 29 00:36:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf.jpg treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a.jpg treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143.jpg treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8.jpg treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a.jpg treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157.jpg treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20.jpg treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6.jpg treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891988_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891998_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891992_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891983_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891997_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891996_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891985_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771892002_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892011_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892021_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892012_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892009_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892015_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892018_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892007_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892010_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892016_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892020_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892013_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892005_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892019_0.png treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892032_0.png treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892023_0.png treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892024_0.png treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892031_0.png treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892034_0.png treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892035_0.png treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892025_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892039_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892067_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892052_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892058_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892055_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892061_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892043_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892037_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892036_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892059_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892053_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892054_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892038_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892060_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892044_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892045_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892042_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892062_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892047_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892063_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892041_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892048_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892066_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892049_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892057_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892051_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892084_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892073_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892069_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892079_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892071_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892068_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892072_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892074_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892070_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892078_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892085_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892080_0.png treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157_rle_crop_3771892088_0.png treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157_rle_crop_3771892091_0.png treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157_rle_crop_3771892087_0.png treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157_rle_crop_3771892089_0.png treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157_rle_crop_3771892086_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892107_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892097_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892103_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892098_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892094_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892092_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892095_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892093_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892096_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892102_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892105_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892101_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892104_0.png treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892117_0.png treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892108_0.png treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892109_0.png treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892110_0.png treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892115_0.png treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892113_0.png treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892112_0.png treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892119_0.png treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892114_0.png treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892118_0.png treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892111_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771892003_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771892000_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891984_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891986_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891987_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892006_0.png treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892028_0.png treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892030_0.png treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892033_0.png treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892027_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892056_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892040_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892065_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892046_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892077_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892076_0.png treat image : temp/1745879429_96089_1354056757_95960484663bd46d578cb07678d9e157_rle_crop_3771892090_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891995_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771892001_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891991_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891993_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891999_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891990_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892004_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892022_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892017_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892008_0.png treat image : temp/1745879429_96089_1354057134_8d1f4827add2e45d6d8940efbd43c64a_rle_crop_3771892014_0.png treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892029_0.png treat image : temp/1745879429_96089_1354056792_747cb8a91e1aa9b3505262d023723143_rle_crop_3771892026_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892050_0.png treat image : temp/1745879429_96089_1354056763_6b4758569f1ca62e86463942cf3fdbe8_rle_crop_3771892064_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892075_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892081_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892083_0.png treat image : temp/1745879429_96089_1354056760_92f8194d59222f7cb28cac7d84e9ba3a_rle_crop_3771892082_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892099_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892106_0.png treat image : temp/1745879429_96089_1354056748_c7b21d64400cf43e611f961a014f1aa6_rle_crop_3771892116_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891989_0.png treat image : temp/1745879429_96089_1354057194_79cba97f375282887501e29a31ab81cf_rle_crop_3771891994_0.png treat image : temp/1745879429_96089_1354056753_dfd1f7f730b01644c2a77b50ffb2ca20_rle_crop_3771892100_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 145 time used for this insertion : 0.020099639892578125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 145 time used for this insertion : 0.3396461009979248 save missing photos in datou_result : time spend for datou_step_exec : 8.848221778869629 time spend to save output : 0.365309476852417 total time spend for step 7 : 9.213531255722046 step8:velours_tree Tue Apr 29 00:36:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.4108724594116211 time spend to save output : 6.198883056640625e-05 total time spend for step 8 : 0.4109344482421875 step9:send_mail_cod Tue Apr 29 00:36:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22477709_29-04-2025_00_36_47.pdf 22478633 imagette224786331745879807 22478635 imagette224786351745879807 22478636 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224786361745879807 22478637 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224786371745879808 22478638 imagette224786381745879809 22478639 imagette224786391745879809 22478640 imagette224786401745879809 22478641 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224786411745879809 22478642 change filename to text .imagette224786421745879811 22478643 change filename to text .change filename to text .imagette224786431745879811 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22477709 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22478633,22478634,22478635,22478636,22478637,22478638,22478639,22478640,22478641,22478642,22478643?tags=pet_fonce,environnement,metal,carton,papier,flou,mal_croppe,background,pet_clair,autre,pehd args[1354057194] : ((1354057194, -2.167795573647124, 492609224), (1354057194, 0.13661315879316094, 2107752395), '0.15721360194830247') We are sending mail with results at report@fotonower.com args[1354057134] : ((1354057134, 2.162376960936548, 492688767), (1354057134, 0.10835137271963632, 2107752395), '0.15721360194830247') We are sending mail with results at report@fotonower.com args[1354056792] : ((1354056792, -1.1330020250821549, 492688767), (1354056792, -0.21541996337180677, 496442774), '0.15721360194830247') We are sending mail with results at report@fotonower.com args[1354056763] : ((1354056763, -3.8038341384308163, 492609224), (1354056763, 0.48519370929689076, 2107752395), '0.15721360194830247') We are sending mail with results at report@fotonower.com args[1354056760] : ((1354056760, -0.020901450869087894, 492688767), (1354056760, 0.11396828111864217, 2107752395), '0.15721360194830247') We are sending mail with results at report@fotonower.com args[1354056757] : ((1354056757, -0.3981439141596649, 492688767), (1354056757, 0.30147749508133104, 2107752395), '0.15721360194830247') We are sending mail with results at report@fotonower.com args[1354056753] : ((1354056753, -1.2985278532698645, 492688767), (1354056753, 0.20062412808492036, 2107752395), '0.15721360194830247') We are sending mail with results at report@fotonower.com args[1354056748] : ((1354056748, -1.2481262884767095, 492688767), (1354056748, -0.4665388178684359, 496442774), '0.15721360194830247') We are sending mail with results at report@fotonower.com refus_total : 0.15721360194830247 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22477709 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22477709_29-04-2025_00_36_47.pdf results_Auto_P22477709_29-04-2025_00_36_47.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22477709_29-04-2025_00_36_47.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22477709','results_Auto_P22477709_29-04-2025_00_36_47.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22477709_29-04-2025_00_36_47.pdf','pdf','','0.61','0.15721360194830247') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22477709

https://www.fotonower.com/image?json=false&list_photos_id=1354057194
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354057134
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.162376960936548)
https://www.fotonower.com/image?json=false&list_photos_id=1354056792
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354056763
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354056760
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354056757
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354056753
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354056748
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 15.72%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/22478636?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22478637?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22478641?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22478642?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22478643?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22477709_29-04-2025_00_36_47.pdf.

Lien vers velours :https://www.fotonower.com/velours/22478633,22478634,22478635,22478636,22478637,22478638,22478639,22478640,22478641,22478642,22478643?tags=pet_fonce,environnement,metal,carton,papier,flou,mal_croppe,background,pet_clair,autre,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 28 Apr 2025 22:36:54 GMT Content-Length: 0 Connection: close X-Message-Id: SiXts-s_RzG6CysTkqZ8sA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1354057194, 1354057134, 1354056792, 1354056763, 1354056760, 1354056757, 1354056753, 1354056748] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354057194', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354057134', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056792', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056763', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056760', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056757', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056753', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056748', None, None, None, None, None, '2766700') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.9044725894927979 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.316753149032593 time spend to save output : 0.9046964645385742 total time spend for step 9 : 8.221449613571167 step10:split_time_score Tue Apr 29 00:36:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 28042025 22477709 Nombre de photos uploadées : 8 / 23040 (0%) 28042025 22477709 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 28042025 22477709 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.0994415283203125e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0003948211669921875 elapsed_time : insert_dashboard_record_day_entry 0.02906346321105957 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22477677 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22477681 order by id desc limit 1 Qualite : 0.15721360194830247 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22477709_29-04-2025_00_36_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22477709 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22477709 AND mptpi.`type`=3594 To do Qualite : 0.02492546166814284 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22477710_29-04-2025_00_36_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22477710 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22477710 AND mptpi.`type`=3726 To do Qualite : 0.1550940109840232 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22477720_29-04-2025_00_28_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22477720 order by id desc limit 1 Catched exception ! Connect or reconnect ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22477720 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'28042025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1354057194, 1354057134, 1354056792, 1354056763, 1354056760, 1354056757, 1354056753, 1354056748] Looping around the photos to save general results len do output : 1 /22477709Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354057194', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354057134', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056792', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056763', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056760', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056757', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056753', None, None, None, None, None, '2766700') ('3318', None, None, None, None, None, None, None, '2766700') ('3318', '22477709', '1354056748', None, None, None, None, None, '2766700') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.016773223876953125 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.4302995204925537 time spend to save output : 0.017054319381713867 total time spend for step 10 : 2.4473538398742676 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 138.79user 177.56system 6:32.93elapsed 80%CPU (0avgtext+0avgdata 4647120maxresident)k 1719848inputs+79776outputs (24580major+11780889minor)pagefaults 0swaps