python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2747785 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2750609'] with mtr_portfolio_ids : ['22322924'] and first list_photo_ids : [] new path : /proc/2747785/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 16 ; length of list_pids : 16 ; length of list_args : 16 time to download the photos : 2.2987985610961914 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Apr 23 01:10:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 1390 wait 20 seconds l 3637 free memory gpu now : 1390 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-23 01:10:54.766874: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-23 01:10:54.799271: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-23 01:10:54.800956: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7388000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-23 01:10:54.801014: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-23 01:10:54.803902: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-23 01:10:55.033126: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xea08bc0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-23 01:10:55.033198: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-23 01:10:55.034216: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-23 01:10:55.035128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-23 01:10:55.038274: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-23 01:10:55.040901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-23 01:10:55.041923: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-23 01:10:55.045364: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-23 01:10:55.047165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-23 01:10:55.054646: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-23 01:10:55.056270: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-23 01:10:55.056390: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-23 01:10:55.057226: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-23 01:10:55.057254: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-23 01:10:55.057289: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-23 01:10:55.058725: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1013 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-23 01:10:55.429266: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-23 01:10:55.429361: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-23 01:10:55.429382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-23 01:10:55.429402: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-23 01:10:55.429429: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-23 01:10:55.429456: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-23 01:10:55.429481: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-23 01:10:55.429508: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-23 01:10:55.430364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-23 01:10:55.431767: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-23 01:10:55.431900: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-23 01:10:55.431925: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-23 01:10:55.431946: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-23 01:10:55.431965: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-23 01:10:55.431985: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-23 01:10:55.432003: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-23 01:10:55.432022: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-23 01:10:55.432754: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-23 01:10:55.432805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-23 01:10:55.432817: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-23 01:10:55.432825: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-23 01:10:55.433671: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1013 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-23 01:11:07.329400: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-23 01:11:07.526779: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-23 01:11:07.555321: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-04-23 01:11:07.564882: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-04-23 01:11:08.866387: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-04-23 01:11:08.873328: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-04-23 01:11:10.791550: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-04-23 01:11:10.792644: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-04-23 01:11:12.671235: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-04-23 01:11:12.672483: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-04-23 01:11:16.259550: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-23 01:11:16.259613: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-23 01:11:16.266146: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-23 01:11:16.266190: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-23 01:11:16.272823: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.272848: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-23 01:11:16.273344: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.273360: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-23 01:11:16.304843: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-23 01:11:16.304881: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-23 01:11:16.310670: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.310691: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-23 01:11:16.311207: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.311225: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-23 01:11:16.346846: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.347370: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.423869: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.424388: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.438125: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.438591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.471671: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.472184: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.476186: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.476685: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.494751: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.495286: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.495785: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.496292: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.517631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.518136: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.530044: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.530568: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.534699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.535219: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.535883: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.536385: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.547181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.547787: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.548355: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.548888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.639011: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.639587: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.663261: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.663980: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.664538: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.665069: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.669263: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.669789: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.670299: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.670806: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.672319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.672354: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-04-23 01:11:16.682401: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.682976: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.692231: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.692762: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.693288: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.693800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.694324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-23 01:11:16.694834: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 502.88M (527302656 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 16 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1745363429_2747785_1352851749_69de939c58a9ee8eba1c973f4ad9b93b.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/ExpandDims_2/_84]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1745363429_2747785_1352851540_6832566dbab0b211a3483b1fe9452946.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/ExpandDims_2/_84]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1745363429_2747785_1352851508_04d8d9ed59fa95e969363fd30467c1e7.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/ExpandDims_2/_84]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1745363429_2747785_1352851475_142e3b6150e1f0d40d213a5d481a0028.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/ExpandDims_2/_84]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 50.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 54 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 60.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 9 Detection mask done ! Trying to reset tf kernel 2749314 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 193 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1390 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0019407272338867188 nb_pixel_total : 35706 time to create 1 rle with old method : 0.04169726371765137 length of segment : 226 time for calcul the mask position with numpy : 0.0005774497985839844 nb_pixel_total : 22270 time to create 1 rle with old method : 0.0241696834564209 length of segment : 211 time for calcul the mask position with numpy : 0.0016760826110839844 nb_pixel_total : 59845 time to create 1 rle with old method : 0.06837654113769531 length of segment : 377 time for calcul the mask position with numpy : 0.24582433700561523 nb_pixel_total : 294785 time to create 1 rle with new method : 0.03267192840576172 length of segment : 570 time for calcul the mask position with numpy : 0.0008497238159179688 nb_pixel_total : 27085 time to create 1 rle with old method : 0.034372568130493164 length of segment : 182 time for calcul the mask position with numpy : 0.0010571479797363281 nb_pixel_total : 43708 time to create 1 rle with old method : 0.05280017852783203 length of segment : 241 time for calcul the mask position with numpy : 0.0008602142333984375 nb_pixel_total : 19187 time to create 1 rle with old method : 0.027114391326904297 length of segment : 204 time for calcul the mask position with numpy : 0.0016942024230957031 nb_pixel_total : 44229 time to create 1 rle with old method : 0.05753016471862793 length of segment : 543 time for calcul the mask position with numpy : 0.0006690025329589844 nb_pixel_total : 20473 time to create 1 rle with old method : 0.023437976837158203 length of segment : 275 time for calcul the mask position with numpy : 0.0003898143768310547 nb_pixel_total : 5853 time to create 1 rle with old method : 0.00699162483215332 length of segment : 180 time for calcul the mask position with numpy : 0.0016715526580810547 nb_pixel_total : 58352 time to create 1 rle with old method : 0.06749439239501953 length of segment : 406 time for calcul the mask position with numpy : 0.0006513595581054688 nb_pixel_total : 18379 time to create 1 rle with old method : 0.021540164947509766 length of segment : 137 time for calcul the mask position with numpy : 0.001882314682006836 nb_pixel_total : 58337 time to create 1 rle with old method : 0.07670235633850098 length of segment : 281 time for calcul the mask position with numpy : 0.0008475780487060547 nb_pixel_total : 17539 time to create 1 rle with old method : 0.02360677719116211 length of segment : 229 time for calcul the mask position with numpy : 0.00048470497131347656 nb_pixel_total : 16217 time to create 1 rle with old method : 0.021628856658935547 length of segment : 143 time for calcul the mask position with numpy : 0.0006597042083740234 nb_pixel_total : 16860 time to create 1 rle with old method : 0.022396087646484375 length of segment : 296 time for calcul the mask position with numpy : 0.0011653900146484375 nb_pixel_total : 34676 time to create 1 rle with old method : 0.04409670829772949 length of segment : 414 time for calcul the mask position with numpy : 0.0003075599670410156 nb_pixel_total : 9899 time to create 1 rle with old method : 0.011411666870117188 length of segment : 150 time for calcul the mask position with numpy : 0.0004227161407470703 nb_pixel_total : 13976 time to create 1 rle with old method : 0.01584315299987793 length of segment : 155 time for calcul the mask position with numpy : 0.00044536590576171875 nb_pixel_total : 10232 time to create 1 rle with old method : 0.01200556755065918 length of segment : 181 time for calcul the mask position with numpy : 0.0002071857452392578 nb_pixel_total : 8077 time to create 1 rle with old method : 0.009117364883422852 length of segment : 105 time for calcul the mask position with numpy : 0.0003159046173095703 nb_pixel_total : 13242 time to create 1 rle with old method : 0.014820098876953125 length of segment : 131 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 5105 time to create 1 rle with old method : 0.006066083908081055 length of segment : 94 time for calcul the mask position with numpy : 0.00015425682067871094 nb_pixel_total : 8698 time to create 1 rle with old method : 0.009937763214111328 length of segment : 94 time for calcul the mask position with numpy : 0.0004024505615234375 nb_pixel_total : 22295 time to create 1 rle with old method : 0.025096893310546875 length of segment : 118 time for calcul the mask position with numpy : 0.0006356239318847656 nb_pixel_total : 35949 time to create 1 rle with old method : 0.04271888732910156 length of segment : 147 time for calcul the mask position with numpy : 0.0006911754608154297 nb_pixel_total : 54750 time to create 1 rle with old method : 0.06086897850036621 length of segment : 273 time for calcul the mask position with numpy : 0.0029180049896240234 nb_pixel_total : 108178 time to create 1 rle with old method : 0.12029528617858887 length of segment : 462 time for calcul the mask position with numpy : 0.0006749629974365234 nb_pixel_total : 33574 time to create 1 rle with old method : 0.03925275802612305 length of segment : 216 time for calcul the mask position with numpy : 0.003977537155151367 nb_pixel_total : 196248 time to create 1 rle with new method : 0.01531529426574707 length of segment : 460 time for calcul the mask position with numpy : 0.00026607513427734375 nb_pixel_total : 11306 time to create 1 rle with old method : 0.01327657699584961 length of segment : 118 time for calcul the mask position with numpy : 0.0005598068237304688 nb_pixel_total : 18392 time to create 1 rle with old method : 0.021891117095947266 length of segment : 227 time for calcul the mask position with numpy : 0.0005745887756347656 nb_pixel_total : 34281 time to create 1 rle with old method : 0.046170711517333984 length of segment : 154 time for calcul the mask position with numpy : 0.000335693359375 nb_pixel_total : 15375 time to create 1 rle with old method : 0.018409013748168945 length of segment : 163 time for calcul the mask position with numpy : 0.0004963874816894531 nb_pixel_total : 24370 time to create 1 rle with old method : 0.02830982208251953 length of segment : 218 time for calcul the mask position with numpy : 0.0004291534423828125 nb_pixel_total : 24016 time to create 1 rle with old method : 0.02870464324951172 length of segment : 120 time for calcul the mask position with numpy : 0.0017800331115722656 nb_pixel_total : 100834 time to create 1 rle with old method : 0.11829781532287598 length of segment : 504 time for calcul the mask position with numpy : 0.0015311241149902344 nb_pixel_total : 98827 time to create 1 rle with old method : 0.10889005661010742 length of segment : 384 time for calcul the mask position with numpy : 0.0018460750579833984 nb_pixel_total : 75977 time to create 1 rle with old method : 0.08599281311035156 length of segment : 344 time for calcul the mask position with numpy : 0.0009484291076660156 nb_pixel_total : 44122 time to create 1 rle with old method : 0.053220272064208984 length of segment : 195 time for calcul the mask position with numpy : 0.0021288394927978516 nb_pixel_total : 139436 time to create 1 rle with old method : 0.15892934799194336 length of segment : 306 time for calcul the mask position with numpy : 0.0003151893615722656 nb_pixel_total : 13965 time to create 1 rle with old method : 0.01627039909362793 length of segment : 170 time for calcul the mask position with numpy : 0.0013079643249511719 nb_pixel_total : 66512 time to create 1 rle with old method : 0.07502508163452148 length of segment : 375 time for calcul the mask position with numpy : 0.0008690357208251953 nb_pixel_total : 38683 time to create 1 rle with old method : 0.044701337814331055 length of segment : 270 time for calcul the mask position with numpy : 0.00026345252990722656 nb_pixel_total : 11508 time to create 1 rle with old method : 0.012981414794921875 length of segment : 126 time for calcul the mask position with numpy : 0.0024361610412597656 nb_pixel_total : 150295 time to create 1 rle with new method : 0.010084867477416992 length of segment : 397 time for calcul the mask position with numpy : 0.0010006427764892578 nb_pixel_total : 45848 time to create 1 rle with old method : 0.0499415397644043 length of segment : 587 time for calcul the mask position with numpy : 0.0004885196685791016 nb_pixel_total : 26696 time to create 1 rle with old method : 0.029651641845703125 length of segment : 213 time for calcul the mask position with numpy : 0.0007307529449462891 nb_pixel_total : 56109 time to create 1 rle with old method : 0.06435847282409668 length of segment : 281 time for calcul the mask position with numpy : 0.00032448768615722656 nb_pixel_total : 15507 time to create 1 rle with old method : 0.01770925521850586 length of segment : 174 time for calcul the mask position with numpy : 0.00022935867309570312 nb_pixel_total : 14414 time to create 1 rle with old method : 0.016132354736328125 length of segment : 127 time for calcul the mask position with numpy : 0.00023794174194335938 nb_pixel_total : 11498 time to create 1 rle with old method : 0.012977838516235352 length of segment : 200 time for calcul the mask position with numpy : 0.0004305839538574219 nb_pixel_total : 23985 time to create 1 rle with old method : 0.02756476402282715 length of segment : 249 time for calcul the mask position with numpy : 0.0007414817810058594 nb_pixel_total : 29216 time to create 1 rle with old method : 0.032186031341552734 length of segment : 376 time for calcul the mask position with numpy : 0.0003097057342529297 nb_pixel_total : 18830 time to create 1 rle with old method : 0.021154403686523438 length of segment : 115 time for calcul the mask position with numpy : 0.0031824111938476562 nb_pixel_total : 180497 time to create 1 rle with new method : 0.0101776123046875 length of segment : 563 time for calcul the mask position with numpy : 0.00014781951904296875 nb_pixel_total : 5611 time to create 1 rle with old method : 0.00655364990234375 length of segment : 65 time for calcul the mask position with numpy : 0.0006225109100341797 nb_pixel_total : 36923 time to create 1 rle with old method : 0.04108452796936035 length of segment : 363 time for calcul the mask position with numpy : 0.0008325576782226562 nb_pixel_total : 44915 time to create 1 rle with old method : 0.05020880699157715 length of segment : 356 time for calcul the mask position with numpy : 0.0008900165557861328 nb_pixel_total : 22065 time to create 1 rle with old method : 0.02574944496154785 length of segment : 184 time for calcul the mask position with numpy : 0.0009198188781738281 nb_pixel_total : 35482 time to create 1 rle with old method : 0.03981328010559082 length of segment : 243 time for calcul the mask position with numpy : 0.0006189346313476562 nb_pixel_total : 26121 time to create 1 rle with old method : 0.029860973358154297 length of segment : 209 time for calcul the mask position with numpy : 0.00027179718017578125 nb_pixel_total : 7053 time to create 1 rle with old method : 0.008374929428100586 length of segment : 115 time for calcul the mask position with numpy : 0.00014019012451171875 nb_pixel_total : 3550 time to create 1 rle with old method : 0.004338741302490234 length of segment : 64 time for calcul the mask position with numpy : 0.002977132797241211 nb_pixel_total : 124519 time to create 1 rle with old method : 0.14914631843566895 length of segment : 565 time for calcul the mask position with numpy : 0.0011816024780273438 nb_pixel_total : 52001 time to create 1 rle with old method : 0.06357669830322266 length of segment : 378 time for calcul the mask position with numpy : 0.0005490779876708984 nb_pixel_total : 7872 time to create 1 rle with old method : 0.009299039840698242 length of segment : 101 time for calcul the mask position with numpy : 0.0006108283996582031 nb_pixel_total : 25826 time to create 1 rle with old method : 0.029523372650146484 length of segment : 161 time for calcul the mask position with numpy : 0.0007328987121582031 nb_pixel_total : 21305 time to create 1 rle with old method : 0.024805307388305664 length of segment : 186 time for calcul the mask position with numpy : 0.00093841552734375 nb_pixel_total : 50707 time to create 1 rle with old method : 0.05808901786804199 length of segment : 193 time for calcul the mask position with numpy : 0.0005834102630615234 nb_pixel_total : 13180 time to create 1 rle with old method : 0.015088081359863281 length of segment : 263 time for calcul the mask position with numpy : 0.0002875328063964844 nb_pixel_total : 10904 time to create 1 rle with old method : 0.012531042098999023 length of segment : 147 time for calcul the mask position with numpy : 0.00027680397033691406 nb_pixel_total : 10490 time to create 1 rle with old method : 0.01197361946105957 length of segment : 102 time for calcul the mask position with numpy : 0.0007967948913574219 nb_pixel_total : 28891 time to create 1 rle with old method : 0.03336215019226074 length of segment : 174 time for calcul the mask position with numpy : 0.0005097389221191406 nb_pixel_total : 21482 time to create 1 rle with old method : 0.02535390853881836 length of segment : 167 time for calcul the mask position with numpy : 0.00011372566223144531 nb_pixel_total : 3501 time to create 1 rle with old method : 0.0042209625244140625 length of segment : 65 time for calcul the mask position with numpy : 0.000335693359375 nb_pixel_total : 10409 time to create 1 rle with old method : 0.012418746948242188 length of segment : 146 time for calcul the mask position with numpy : 0.0005981922149658203 nb_pixel_total : 8243 time to create 1 rle with old method : 0.00967550277709961 length of segment : 103 time for calcul the mask position with numpy : 0.0004134178161621094 nb_pixel_total : 11574 time to create 1 rle with old method : 0.013546466827392578 length of segment : 164 time for calcul the mask position with numpy : 0.0007843971252441406 nb_pixel_total : 14653 time to create 1 rle with old method : 0.01744818687438965 length of segment : 127 time for calcul the mask position with numpy : 0.0003573894500732422 nb_pixel_total : 12834 time to create 1 rle with old method : 0.015519857406616211 length of segment : 179 time for calcul the mask position with numpy : 0.00024580955505371094 nb_pixel_total : 11414 time to create 1 rle with old method : 0.013092041015625 length of segment : 123 time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 8519 time to create 1 rle with old method : 0.009900093078613281 length of segment : 117 time for calcul the mask position with numpy : 0.0006320476531982422 nb_pixel_total : 20523 time to create 1 rle with old method : 0.024431467056274414 length of segment : 204 time for calcul the mask position with numpy : 0.0004868507385253906 nb_pixel_total : 26168 time to create 1 rle with old method : 0.031219005584716797 length of segment : 153 time for calcul the mask position with numpy : 0.001360177993774414 nb_pixel_total : 62674 time to create 1 rle with old method : 0.06950092315673828 length of segment : 453 time for calcul the mask position with numpy : 0.00018978118896484375 nb_pixel_total : 6930 time to create 1 rle with old method : 0.007869243621826172 length of segment : 146 time for calcul the mask position with numpy : 0.0004608631134033203 nb_pixel_total : 25615 time to create 1 rle with old method : 0.031502723693847656 length of segment : 179 time for calcul the mask position with numpy : 0.001031637191772461 nb_pixel_total : 65371 time to create 1 rle with old method : 0.07504558563232422 length of segment : 241 time for calcul the mask position with numpy : 0.00018668174743652344 nb_pixel_total : 7860 time to create 1 rle with old method : 0.009185791015625 length of segment : 75 time for calcul the mask position with numpy : 0.00033354759216308594 nb_pixel_total : 13424 time to create 1 rle with old method : 0.016467571258544922 length of segment : 132 time for calcul the mask position with numpy : 0.0017447471618652344 nb_pixel_total : 95497 time to create 1 rle with old method : 0.10485649108886719 length of segment : 405 time for calcul the mask position with numpy : 0.0012540817260742188 nb_pixel_total : 74037 time to create 1 rle with old method : 0.08079862594604492 length of segment : 460 time for calcul the mask position with numpy : 0.00032591819763183594 nb_pixel_total : 11127 time to create 1 rle with old method : 0.01255488395690918 length of segment : 164 time for calcul the mask position with numpy : 0.0002651214599609375 nb_pixel_total : 12298 time to create 1 rle with old method : 0.01376485824584961 length of segment : 138 time for calcul the mask position with numpy : 0.00031757354736328125 nb_pixel_total : 17540 time to create 1 rle with old method : 0.019756317138671875 length of segment : 169 time for calcul the mask position with numpy : 0.0003123283386230469 nb_pixel_total : 12249 time to create 1 rle with old method : 0.013878583908081055 length of segment : 151 time for calcul the mask position with numpy : 0.0004131793975830078 nb_pixel_total : 29028 time to create 1 rle with old method : 0.03276801109313965 length of segment : 165 time for calcul the mask position with numpy : 0.00011873245239257812 nb_pixel_total : 5137 time to create 1 rle with old method : 0.0061533451080322266 length of segment : 53 time for calcul the mask position with numpy : 0.002079486846923828 nb_pixel_total : 111742 time to create 1 rle with old method : 0.1215674877166748 length of segment : 538 time for calcul the mask position with numpy : 0.00016260147094726562 nb_pixel_total : 7515 time to create 1 rle with old method : 0.008390426635742188 length of segment : 73 time for calcul the mask position with numpy : 0.001466512680053711 nb_pixel_total : 80605 time to create 1 rle with old method : 0.08843374252319336 length of segment : 444 time for calcul the mask position with numpy : 0.016022205352783203 nb_pixel_total : 359437 time to create 1 rle with new method : 0.12870001792907715 length of segment : 813 time for calcul the mask position with numpy : 0.0006582736968994141 nb_pixel_total : 16628 time to create 1 rle with old method : 0.01889824867248535 length of segment : 168 time for calcul the mask position with numpy : 0.0005621910095214844 nb_pixel_total : 12169 time to create 1 rle with old method : 0.014088630676269531 length of segment : 148 time for calcul the mask position with numpy : 0.0007772445678710938 nb_pixel_total : 22315 time to create 1 rle with old method : 0.02531909942626953 length of segment : 198 time for calcul the mask position with numpy : 0.0003209114074707031 nb_pixel_total : 7125 time to create 1 rle with old method : 0.008233785629272461 length of segment : 82 time for calcul the mask position with numpy : 0.006488323211669922 nb_pixel_total : 175543 time to create 1 rle with new method : 0.014686346054077148 length of segment : 684 time for calcul the mask position with numpy : 0.0020482540130615234 nb_pixel_total : 80286 time to create 1 rle with old method : 0.0918722152709961 length of segment : 293 time for calcul the mask position with numpy : 0.0013272762298583984 nb_pixel_total : 37166 time to create 1 rle with old method : 0.04477548599243164 length of segment : 249 time for calcul the mask position with numpy : 0.0009512901306152344 nb_pixel_total : 21108 time to create 1 rle with old method : 0.02368927001953125 length of segment : 168 time for calcul the mask position with numpy : 0.0019860267639160156 nb_pixel_total : 80153 time to create 1 rle with old method : 0.09542465209960938 length of segment : 399 time for calcul the mask position with numpy : 0.00047206878662109375 nb_pixel_total : 7518 time to create 1 rle with old method : 0.008916139602661133 length of segment : 143 time for calcul the mask position with numpy : 0.0006887912750244141 nb_pixel_total : 20087 time to create 1 rle with old method : 0.02405714988708496 length of segment : 161 time for calcul the mask position with numpy : 0.0017278194427490234 nb_pixel_total : 25426 time to create 1 rle with old method : 0.03008270263671875 length of segment : 450 time for calcul the mask position with numpy : 0.0008237361907958984 nb_pixel_total : 37086 time to create 1 rle with old method : 0.041229248046875 length of segment : 276 time for calcul the mask position with numpy : 0.0007708072662353516 nb_pixel_total : 18286 time to create 1 rle with old method : 0.02032470703125 length of segment : 179 time for calcul the mask position with numpy : 0.00047707557678222656 nb_pixel_total : 24247 time to create 1 rle with old method : 0.027039289474487305 length of segment : 236 time for calcul the mask position with numpy : 0.00024962425231933594 nb_pixel_total : 13358 time to create 1 rle with old method : 0.015188217163085938 length of segment : 154 time for calcul the mask position with numpy : 0.005938291549682617 nb_pixel_total : 244146 time to create 1 rle with new method : 0.014808177947998047 length of segment : 646 time for calcul the mask position with numpy : 0.001051187515258789 nb_pixel_total : 46821 time to create 1 rle with old method : 0.05788993835449219 length of segment : 336 time for calcul the mask position with numpy : 0.0007898807525634766 nb_pixel_total : 31188 time to create 1 rle with old method : 0.035385847091674805 length of segment : 240 time for calcul the mask position with numpy : 0.0020525455474853516 nb_pixel_total : 49577 time to create 1 rle with old method : 0.05558323860168457 length of segment : 300 time for calcul the mask position with numpy : 0.0007531642913818359 nb_pixel_total : 15139 time to create 1 rle with old method : 0.017447233200073242 length of segment : 137 time for calcul the mask position with numpy : 0.003787994384765625 nb_pixel_total : 129928 time to create 1 rle with old method : 0.14240550994873047 length of segment : 407 time for calcul the mask position with numpy : 0.0011763572692871094 nb_pixel_total : 24672 time to create 1 rle with old method : 0.028395652770996094 length of segment : 185 time for calcul the mask position with numpy : 0.0004630088806152344 nb_pixel_total : 3036 time to create 1 rle with old method : 0.0037539005279541016 length of segment : 106 time for calcul the mask position with numpy : 0.0008091926574707031 nb_pixel_total : 17405 time to create 1 rle with old method : 0.019525766372680664 length of segment : 142 time for calcul the mask position with numpy : 0.0018591880798339844 nb_pixel_total : 48643 time to create 1 rle with old method : 0.053290605545043945 length of segment : 371 time for calcul the mask position with numpy : 0.0011060237884521484 nb_pixel_total : 25509 time to create 1 rle with old method : 0.027947187423706055 length of segment : 152 time for calcul the mask position with numpy : 0.0013763904571533203 nb_pixel_total : 33418 time to create 1 rle with old method : 0.037354469299316406 length of segment : 159 time for calcul the mask position with numpy : 0.004810810089111328 nb_pixel_total : 113767 time to create 1 rle with old method : 0.12397527694702148 length of segment : 406 time for calcul the mask position with numpy : 0.0013575553894042969 nb_pixel_total : 21736 time to create 1 rle with old method : 0.02382516860961914 length of segment : 256 time for calcul the mask position with numpy : 0.0009760856628417969 nb_pixel_total : 30009 time to create 1 rle with old method : 0.033679962158203125 length of segment : 166 time for calcul the mask position with numpy : 0.0010004043579101562 nb_pixel_total : 21578 time to create 1 rle with old method : 0.02447509765625 length of segment : 128 time for calcul the mask position with numpy : 0.00041484832763671875 nb_pixel_total : 8489 time to create 1 rle with old method : 0.009557247161865234 length of segment : 108 time for calcul the mask position with numpy : 0.0010292530059814453 nb_pixel_total : 18329 time to create 1 rle with old method : 0.027521610260009766 length of segment : 242 time for calcul the mask position with numpy : 0.00038433074951171875 nb_pixel_total : 6196 time to create 1 rle with old method : 0.007143497467041016 length of segment : 115 time for calcul the mask position with numpy : 0.0005357265472412109 nb_pixel_total : 12687 time to create 1 rle with old method : 0.014318227767944336 length of segment : 198 time for calcul the mask position with numpy : 0.02996540069580078 nb_pixel_total : 637940 time to create 1 rle with new method : 0.043882131576538086 length of segment : 835 time for calcul the mask position with numpy : 0.0031201839447021484 nb_pixel_total : 95159 time to create 1 rle with old method : 0.10365796089172363 length of segment : 485 time for calcul the mask position with numpy : 0.0044591426849365234 nb_pixel_total : 95529 time to create 1 rle with old method : 0.1046745777130127 length of segment : 283 time for calcul the mask position with numpy : 0.0006277561187744141 nb_pixel_total : 11584 time to create 1 rle with old method : 0.013028621673583984 length of segment : 97 time for calcul the mask position with numpy : 0.002505779266357422 nb_pixel_total : 56742 time to create 1 rle with old method : 0.06322097778320312 length of segment : 303 time for calcul the mask position with numpy : 0.0020341873168945312 nb_pixel_total : 50722 time to create 1 rle with old method : 0.055574655532836914 length of segment : 355 time for calcul the mask position with numpy : 0.0005428791046142578 nb_pixel_total : 9898 time to create 1 rle with old method : 0.010970830917358398 length of segment : 117 time for calcul the mask position with numpy : 0.001035451889038086 nb_pixel_total : 22844 time to create 1 rle with old method : 0.02549123764038086 length of segment : 202 time for calcul the mask position with numpy : 0.0013849735260009766 nb_pixel_total : 37939 time to create 1 rle with old method : 0.041602134704589844 length of segment : 210 time for calcul the mask position with numpy : 0.001194000244140625 nb_pixel_total : 34946 time to create 1 rle with old method : 0.038411855697631836 length of segment : 202 time for calcul the mask position with numpy : 0.001012563705444336 nb_pixel_total : 21689 time to create 1 rle with old method : 0.024872779846191406 length of segment : 150 time for calcul the mask position with numpy : 0.0007081031799316406 nb_pixel_total : 10496 time to create 1 rle with old method : 0.01226949691772461 length of segment : 136 time for calcul the mask position with numpy : 0.0010602474212646484 nb_pixel_total : 19862 time to create 1 rle with old method : 0.023189783096313477 length of segment : 194 time for calcul the mask position with numpy : 0.005183696746826172 nb_pixel_total : 76998 time to create 1 rle with old method : 0.08716607093811035 length of segment : 288 time for calcul the mask position with numpy : 0.0012061595916748047 nb_pixel_total : 25771 time to create 1 rle with old method : 0.02898883819580078 length of segment : 203 time for calcul the mask position with numpy : 0.001519918441772461 nb_pixel_total : 25604 time to create 1 rle with old method : 0.029646635055541992 length of segment : 315 time for calcul the mask position with numpy : 0.0005583763122558594 nb_pixel_total : 9281 time to create 1 rle with old method : 0.01076054573059082 length of segment : 119 time for calcul the mask position with numpy : 0.0006933212280273438 nb_pixel_total : 17893 time to create 1 rle with old method : 0.02128148078918457 length of segment : 151 time for calcul the mask position with numpy : 0.0031151771545410156 nb_pixel_total : 73435 time to create 1 rle with old method : 0.08249688148498535 length of segment : 373 time for calcul the mask position with numpy : 0.0007350444793701172 nb_pixel_total : 22035 time to create 1 rle with old method : 0.026091337203979492 length of segment : 110 time for calcul the mask position with numpy : 0.009948253631591797 nb_pixel_total : 199062 time to create 1 rle with new method : 0.01397848129272461 length of segment : 666 time for calcul the mask position with numpy : 0.0012502670288085938 nb_pixel_total : 33552 time to create 1 rle with old method : 0.04202413558959961 length of segment : 324 time for calcul the mask position with numpy : 0.0008876323699951172 nb_pixel_total : 18250 time to create 1 rle with old method : 0.020697355270385742 length of segment : 243 time for calcul the mask position with numpy : 0.00037980079650878906 nb_pixel_total : 15044 time to create 1 rle with old method : 0.017316579818725586 length of segment : 107 time for calcul the mask position with numpy : 0.008273124694824219 nb_pixel_total : 72127 time to create 1 rle with old method : 0.0821533203125 length of segment : 649 time for calcul the mask position with numpy : 0.009590387344360352 nb_pixel_total : 178555 time to create 1 rle with new method : 0.013900279998779297 length of segment : 646 time for calcul the mask position with numpy : 0.0048029422760009766 nb_pixel_total : 143663 time to create 1 rle with old method : 0.16286849975585938 length of segment : 429 time for calcul the mask position with numpy : 0.0026504993438720703 nb_pixel_total : 35619 time to create 1 rle with old method : 0.04179978370666504 length of segment : 284 time for calcul the mask position with numpy : 0.0006413459777832031 nb_pixel_total : 18538 time to create 1 rle with old method : 0.02282881736755371 length of segment : 138 time for calcul the mask position with numpy : 0.006685018539428711 nb_pixel_total : 171958 time to create 1 rle with new method : 0.010709285736083984 length of segment : 580 time for calcul the mask position with numpy : 0.0009100437164306641 nb_pixel_total : 12202 time to create 1 rle with old method : 0.015306234359741211 length of segment : 205 time for calcul the mask position with numpy : 0.0014240741729736328 nb_pixel_total : 33886 time to create 1 rle with old method : 0.03986763954162598 length of segment : 243 time for calcul the mask position with numpy : 0.0021271705627441406 nb_pixel_total : 59476 time to create 1 rle with old method : 0.06861209869384766 length of segment : 301 time for calcul the mask position with numpy : 0.005475044250488281 nb_pixel_total : 177366 time to create 1 rle with new method : 0.007886409759521484 length of segment : 495 time for calcul the mask position with numpy : 0.0002655982971191406 nb_pixel_total : 8192 time to create 1 rle with old method : 0.01165914535522461 length of segment : 141 time for calcul the mask position with numpy : 0.00042510032653808594 nb_pixel_total : 6717 time to create 1 rle with old method : 0.00802159309387207 length of segment : 115 time for calcul the mask position with numpy : 0.0006513595581054688 nb_pixel_total : 14730 time to create 1 rle with old method : 0.01793193817138672 length of segment : 129 time for calcul the mask position with numpy : 0.0006508827209472656 nb_pixel_total : 14674 time to create 1 rle with old method : 0.017046689987182617 length of segment : 177 time for calcul the mask position with numpy : 0.0010628700256347656 nb_pixel_total : 26432 time to create 1 rle with old method : 0.03033447265625 length of segment : 278 time for calcul the mask position with numpy : 0.0046274662017822266 nb_pixel_total : 144293 time to create 1 rle with old method : 0.16464805603027344 length of segment : 422 time for calcul the mask position with numpy : 0.0004603862762451172 nb_pixel_total : 7315 time to create 1 rle with old method : 0.008907079696655273 length of segment : 119 time for calcul the mask position with numpy : 0.0005211830139160156 nb_pixel_total : 11997 time to create 1 rle with old method : 0.013986825942993164 length of segment : 128 time for calcul the mask position with numpy : 0.00034499168395996094 nb_pixel_total : 11676 time to create 1 rle with old method : 0.01374197006225586 length of segment : 227 time for calcul the mask position with numpy : 0.0038292407989501953 nb_pixel_total : 110701 time to create 1 rle with old method : 0.13080954551696777 length of segment : 452 time for calcul the mask position with numpy : 0.0013048648834228516 nb_pixel_total : 21691 time to create 1 rle with old method : 0.025667667388916016 length of segment : 287 time for calcul the mask position with numpy : 0.00027441978454589844 nb_pixel_total : 13537 time to create 1 rle with old method : 0.015803098678588867 length of segment : 140 time for calcul the mask position with numpy : 0.008493185043334961 nb_pixel_total : 180566 time to create 1 rle with new method : 0.1812577247619629 length of segment : 1222 time for calcul the mask position with numpy : 0.0004818439483642578 nb_pixel_total : 18533 time to create 1 rle with old method : 0.021663188934326172 length of segment : 202 time for calcul the mask position with numpy : 0.0008003711700439453 nb_pixel_total : 21756 time to create 1 rle with old method : 0.027280330657958984 length of segment : 161 time for calcul the mask position with numpy : 0.0005133152008056641 nb_pixel_total : 18751 time to create 1 rle with old method : 0.02351522445678711 length of segment : 147 time for calcul the mask position with numpy : 0.0002963542938232422 nb_pixel_total : 7842 time to create 1 rle with old method : 0.011492252349853516 length of segment : 111 time for calcul the mask position with numpy : 0.0011186599731445312 nb_pixel_total : 50974 time to create 1 rle with old method : 0.06404662132263184 length of segment : 188 time for calcul the mask position with numpy : 0.004494667053222656 nb_pixel_total : 272565 time to create 1 rle with new method : 0.012181520462036133 length of segment : 412 time for calcul the mask position with numpy : 0.0013158321380615234 nb_pixel_total : 85113 time to create 1 rle with old method : 0.09719061851501465 length of segment : 378 time for calcul the mask position with numpy : 0.0002741813659667969 nb_pixel_total : 7711 time to create 1 rle with old method : 0.009172439575195312 length of segment : 107 time spent for convertir_results : 15.29254150390625 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 194 chid ids of type : 3594 Number RLEs to save : 49442 save missing photos in datou_result : time spend for datou_step_exec : 111.99399161338806 time spend to save output : 10.838745355606079 total time spend for step 1 : 122.83273696899414 step2:crop_condition Wed Apr 23 01:12:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 16 ! batch 1 Loaded 194 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 128 About to insert : list_path_to_insert length 128 new photo from crops ! About to upload 128 photos upload in portfolio : 3736932 init cache_photo without model_param we have 128 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745363581_2747785 we have uploaded 128 photos in the portfolio 3736932 time of upload the photos Elapsed time : 39.404417991638184 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 3736932 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745363627_2747785 we have uploaded 20 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.350901126861572 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745363635_2747785 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5652806758880615 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 3736932 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745363651_2747785 we have uploaded 37 photos in the portfolio 3736932 time of upload the photos Elapsed time : 26.549968242645264 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745363679_2747785 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.4559955596923828 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745363683_2747785 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9456338882446289 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1352851749, 1352851540, 1352851508, 1352851475, 1352851432, 1352851385, 1352851098, 1352850976, 1352850921, 1352850918, 1352850636, 1352850493, 1352850274, 1352850239, 1352850040, 1352848580] Looping around the photos to save general results len do output : 194 /1352876484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352876947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352877554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851749', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851540', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851508', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851475', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851432', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851385', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851098', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850976', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850921', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850918', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850636', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850493', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850274', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850239', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850040', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352848580', None, None, None, None, None, '2750609') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 598 time used for this insertion : 0.12356972694396973 save_final save missing photos in datou_result : time spend for datou_step_exec : 129.3342137336731 time spend to save output : 0.1292126178741455 total time spend for step 2 : 129.46342635154724 step3:rle_unique_nms_with_priority Wed Apr 23 01:14:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 194 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ No data in photo_id : 1352851749 No data in photo_id : 1352851540 No data in photo_id : 1352851508 No data in photo_id : 1352851475 nb_obj : 22 nb_hashtags : 2 time to prepare the origin masks : 5.652553081512451 time for calcul the mask position with numpy : 0.8168652057647705 nb_pixel_total : 6201313 time to create 1 rle with new method : 0.6774349212646484 time for calcul the mask position with numpy : 0.021132230758666992 nb_pixel_total : 13242 time to create 1 rle with old method : 0.015320539474487305 time for calcul the mask position with numpy : 0.023332834243774414 nb_pixel_total : 8077 time to create 1 rle with old method : 0.009645700454711914 time for calcul the mask position with numpy : 0.023234844207763672 nb_pixel_total : 10232 time to create 1 rle with old method : 0.013190269470214844 time for calcul the mask position with numpy : 0.023573875427246094 nb_pixel_total : 13976 time to create 1 rle with old method : 0.016863584518432617 time for calcul the mask position with numpy : 0.022562742233276367 nb_pixel_total : 9899 time to create 1 rle with old method : 0.012201309204101562 time for calcul the mask position with numpy : 0.022841453552246094 nb_pixel_total : 34676 time to create 1 rle with old method : 0.04147148132324219 time for calcul the mask position with numpy : 0.022172927856445312 nb_pixel_total : 16860 time to create 1 rle with old method : 0.020229101181030273 time for calcul the mask position with numpy : 0.021791934967041016 nb_pixel_total : 16217 time to create 1 rle with old method : 0.019113540649414062 time for calcul the mask position with numpy : 0.021994352340698242 nb_pixel_total : 17539 time to create 1 rle with old method : 0.0205996036529541 time for calcul the mask position with numpy : 0.021324872970581055 nb_pixel_total : 58337 time to create 1 rle with old method : 0.06575250625610352 time for calcul the mask position with numpy : 0.0208590030670166 nb_pixel_total : 18379 time to create 1 rle with old method : 0.021303415298461914 time for calcul the mask position with numpy : 0.024206876754760742 nb_pixel_total : 58352 time to create 1 rle with old method : 0.06786274909973145 time for calcul the mask position with numpy : 0.021904468536376953 nb_pixel_total : 5853 time to create 1 rle with old method : 0.006606101989746094 time for calcul the mask position with numpy : 0.02173471450805664 nb_pixel_total : 20473 time to create 1 rle with old method : 0.025834321975708008 time for calcul the mask position with numpy : 0.021671056747436523 nb_pixel_total : 44229 time to create 1 rle with old method : 0.05339980125427246 time for calcul the mask position with numpy : 0.022015094757080078 nb_pixel_total : 19187 time to create 1 rle with old method : 0.027549266815185547 time for calcul the mask position with numpy : 0.024586200714111328 nb_pixel_total : 43708 time to create 1 rle with old method : 0.07218074798583984 time for calcul the mask position with numpy : 0.02350306510925293 nb_pixel_total : 27085 time to create 1 rle with old method : 0.04518294334411621 time for calcul the mask position with numpy : 0.02866649627685547 nb_pixel_total : 294785 time to create 1 rle with new method : 0.5745329856872559 time for calcul the mask position with numpy : 0.02092909812927246 nb_pixel_total : 59845 time to create 1 rle with old method : 0.06701850891113281 time for calcul the mask position with numpy : 0.02074885368347168 nb_pixel_total : 22270 time to create 1 rle with old method : 0.024947643280029297 time for calcul the mask position with numpy : 0.021259307861328125 nb_pixel_total : 35706 time to create 1 rle with old method : 0.0406336784362793 create new chi : 3.3054819107055664 time to delete rle : 0.01884770393371582 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 13434 TO DO : save crop sub photo not yet done ! save time : 2.290778160095215 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 2.6198694705963135 time for calcul the mask position with numpy : 0.2554972171783447 nb_pixel_total : 6923443 time to create 1 rle with new method : 0.5580775737762451 time for calcul the mask position with numpy : 0.021573543548583984 nb_pixel_total : 54750 time to create 1 rle with old method : 0.06323051452636719 time for calcul the mask position with numpy : 0.0204160213470459 nb_pixel_total : 35949 time to create 1 rle with old method : 0.042101383209228516 time for calcul the mask position with numpy : 0.02726149559020996 nb_pixel_total : 22295 time to create 1 rle with old method : 0.026056766510009766 time for calcul the mask position with numpy : 0.032941579818725586 nb_pixel_total : 8698 time to create 1 rle with old method : 0.01011037826538086 time for calcul the mask position with numpy : 0.030942201614379883 nb_pixel_total : 5105 time to create 1 rle with old method : 0.006327629089355469 create new chi : 1.1313929557800293 time to delete rle : 0.0005373954772949219 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3612 TO DO : save crop sub photo not yet done ! save time : 0.39669275283813477 nb_obj : 20 nb_hashtags : 4 time to prepare the origin masks : 6.478604793548584 time for calcul the mask position with numpy : 0.40288734436035156 nb_pixel_total : 5798493 time to create 1 rle with new method : 0.6533005237579346 time for calcul the mask position with numpy : 0.03490281105041504 nb_pixel_total : 45848 time to create 1 rle with old method : 0.05456209182739258 time for calcul the mask position with numpy : 0.03487086296081543 nb_pixel_total : 150295 time to create 1 rle with new method : 0.739203691482544 time for calcul the mask position with numpy : 0.03273963928222656 nb_pixel_total : 11508 time to create 1 rle with old method : 0.013603687286376953 time for calcul the mask position with numpy : 0.025584697723388672 nb_pixel_total : 38683 time to create 1 rle with old method : 0.05103754997253418 time for calcul the mask position with numpy : 0.023417234420776367 nb_pixel_total : 66512 time to create 1 rle with old method : 0.08183908462524414 time for calcul the mask position with numpy : 0.020902395248413086 nb_pixel_total : 13965 time to create 1 rle with old method : 0.016159772872924805 time for calcul the mask position with numpy : 0.03438711166381836 nb_pixel_total : 139436 time to create 1 rle with old method : 0.16528701782226562 time for calcul the mask position with numpy : 0.03412318229675293 nb_pixel_total : 44122 time to create 1 rle with old method : 0.053735971450805664 time for calcul the mask position with numpy : 0.03370165824890137 nb_pixel_total : 75977 time to create 1 rle with old method : 0.08891797065734863 time for calcul the mask position with numpy : 0.037117719650268555 nb_pixel_total : 98827 time to create 1 rle with old method : 0.11403155326843262 time for calcul the mask position with numpy : 0.03421330451965332 nb_pixel_total : 100834 time to create 1 rle with old method : 0.11731171607971191 time for calcul the mask position with numpy : 0.03515505790710449 nb_pixel_total : 24016 time to create 1 rle with old method : 0.029608488082885742 time for calcul the mask position with numpy : 0.03349709510803223 nb_pixel_total : 24370 time to create 1 rle with old method : 0.0282747745513916 time for calcul the mask position with numpy : 0.03222823143005371 nb_pixel_total : 15375 time to create 1 rle with old method : 0.018123865127563477 time for calcul the mask position with numpy : 0.03288149833679199 nb_pixel_total : 34281 time to create 1 rle with old method : 0.043447256088256836 time for calcul the mask position with numpy : 0.025101423263549805 nb_pixel_total : 18392 time to create 1 rle with old method : 0.021621227264404297 time for calcul the mask position with numpy : 0.021159648895263672 nb_pixel_total : 11306 time to create 1 rle with old method : 0.013339519500732422 time for calcul the mask position with numpy : 0.023190736770629883 nb_pixel_total : 196248 time to create 1 rle with new method : 0.9517745971679688 time for calcul the mask position with numpy : 0.021614789962768555 nb_pixel_total : 33574 time to create 1 rle with old method : 0.037958621978759766 time for calcul the mask position with numpy : 0.02216196060180664 nb_pixel_total : 108178 time to create 1 rle with old method : 0.1256415843963623 create new chi : 4.498873710632324 time to delete rle : 0.001987934112548828 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 13752 TO DO : save crop sub photo not yet done ! save time : 2.236506462097168 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 5.644269943237305 time for calcul the mask position with numpy : 0.44654226303100586 nb_pixel_total : 6586039 time to create 1 rle with new method : 0.6393587589263916 time for calcul the mask position with numpy : 0.022699594497680664 nb_pixel_total : 44915 time to create 1 rle with old method : 0.051253557205200195 time for calcul the mask position with numpy : 0.020397186279296875 nb_pixel_total : 36923 time to create 1 rle with old method : 0.04205679893493652 time for calcul the mask position with numpy : 0.020396947860717773 nb_pixel_total : 5611 time to create 1 rle with old method : 0.006275653839111328 time for calcul the mask position with numpy : 0.022068023681640625 nb_pixel_total : 180497 time to create 1 rle with new method : 0.7252099514007568 time for calcul the mask position with numpy : 0.020288705825805664 nb_pixel_total : 18830 time to create 1 rle with old method : 0.024620771408081055 time for calcul the mask position with numpy : 0.02111053466796875 nb_pixel_total : 29216 time to create 1 rle with old method : 0.03468060493469238 time for calcul the mask position with numpy : 0.02318406105041504 nb_pixel_total : 23985 time to create 1 rle with old method : 0.032929182052612305 time for calcul the mask position with numpy : 0.023245573043823242 nb_pixel_total : 11498 time to create 1 rle with old method : 0.016194820404052734 time for calcul the mask position with numpy : 0.02297520637512207 nb_pixel_total : 14414 time to create 1 rle with old method : 0.017986774444580078 time for calcul the mask position with numpy : 0.024156570434570312 nb_pixel_total : 15507 time to create 1 rle with old method : 0.018871545791625977 time for calcul the mask position with numpy : 0.023943185806274414 nb_pixel_total : 56109 time to create 1 rle with old method : 0.06648850440979004 time for calcul the mask position with numpy : 0.02128124237060547 nb_pixel_total : 26696 time to create 1 rle with old method : 0.030921220779418945 create new chi : 2.4765028953552246 time to delete rle : 0.0013344287872314453 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 8324 TO DO : save crop sub photo not yet done ! save time : 2.030170202255249 nb_obj : 21 nb_hashtags : 5 time to prepare the origin masks : 8.715031862258911 time for calcul the mask position with numpy : 0.4459114074707031 nb_pixel_total : 6540412 time to create 1 rle with new method : 0.6892859935760498 time for calcul the mask position with numpy : 0.0216825008392334 nb_pixel_total : 14653 time to create 1 rle with old method : 0.017530441284179688 time for calcul the mask position with numpy : 0.020717859268188477 nb_pixel_total : 11574 time to create 1 rle with old method : 0.013458013534545898 time for calcul the mask position with numpy : 0.02042412757873535 nb_pixel_total : 8243 time to create 1 rle with old method : 0.010320901870727539 time for calcul the mask position with numpy : 0.02138519287109375 nb_pixel_total : 10409 time to create 1 rle with old method : 0.012224435806274414 time for calcul the mask position with numpy : 0.022500038146972656 nb_pixel_total : 3501 time to create 1 rle with old method : 0.004125356674194336 time for calcul the mask position with numpy : 0.02367377281188965 nb_pixel_total : 21482 time to create 1 rle with old method : 0.025136709213256836 time for calcul the mask position with numpy : 0.023219585418701172 nb_pixel_total : 28891 time to create 1 rle with old method : 0.04927968978881836 time for calcul the mask position with numpy : 0.022574186325073242 nb_pixel_total : 10490 time to create 1 rle with old method : 0.016816139221191406 time for calcul the mask position with numpy : 0.0226438045501709 nb_pixel_total : 10904 time to create 1 rle with old method : 0.012748479843139648 time for calcul the mask position with numpy : 0.024189472198486328 nb_pixel_total : 13180 time to create 1 rle with old method : 0.015726089477539062 time for calcul the mask position with numpy : 0.02265000343322754 nb_pixel_total : 50707 time to create 1 rle with old method : 0.0644986629486084 time for calcul the mask position with numpy : 0.023569583892822266 nb_pixel_total : 21305 time to create 1 rle with old method : 0.027764081954956055 time for calcul the mask position with numpy : 0.022442102432250977 nb_pixel_total : 25826 time to create 1 rle with old method : 0.03008437156677246 time for calcul the mask position with numpy : 0.023179292678833008 nb_pixel_total : 7872 time to create 1 rle with old method : 0.009258031845092773 time for calcul the mask position with numpy : 0.021860837936401367 nb_pixel_total : 52001 time to create 1 rle with old method : 0.0606234073638916 time for calcul the mask position with numpy : 0.023168325424194336 nb_pixel_total : 124519 time to create 1 rle with old method : 0.1647946834564209 time for calcul the mask position with numpy : 0.02141404151916504 nb_pixel_total : 3550 time to create 1 rle with old method : 0.004305362701416016 time for calcul the mask position with numpy : 0.022122621536254883 nb_pixel_total : 7053 time to create 1 rle with old method : 0.00830984115600586 time for calcul the mask position with numpy : 0.021602869033813477 nb_pixel_total : 26121 time to create 1 rle with old method : 0.03052210807800293 time for calcul the mask position with numpy : 0.023730754852294922 nb_pixel_total : 35482 time to create 1 rle with old method : 0.05998349189758301 time for calcul the mask position with numpy : 0.022882699966430664 nb_pixel_total : 22065 time to create 1 rle with old method : 0.025997400283813477 create new chi : 2.3089051246643066 time to delete rle : 0.0024209022521972656 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 9874 TO DO : save crop sub photo not yet done ! save time : 1.5665388107299805 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 4.252894163131714 time for calcul the mask position with numpy : 0.8646082878112793 nb_pixel_total : 6608705 time to create 1 rle with new method : 0.5009047985076904 time for calcul the mask position with numpy : 0.023258209228515625 nb_pixel_total : 11127 time to create 1 rle with old method : 0.013636589050292969 time for calcul the mask position with numpy : 0.028146982192993164 nb_pixel_total : 74037 time to create 1 rle with old method : 0.10935735702514648 time for calcul the mask position with numpy : 0.02149510383605957 nb_pixel_total : 95497 time to create 1 rle with old method : 0.10916376113891602 time for calcul the mask position with numpy : 0.02125406265258789 nb_pixel_total : 13424 time to create 1 rle with old method : 0.015307188034057617 time for calcul the mask position with numpy : 0.02084183692932129 nb_pixel_total : 7860 time to create 1 rle with old method : 0.00889730453491211 time for calcul the mask position with numpy : 0.021205663681030273 nb_pixel_total : 65371 time to create 1 rle with old method : 0.07323908805847168 time for calcul the mask position with numpy : 0.027918338775634766 nb_pixel_total : 25615 time to create 1 rle with old method : 0.03076934814453125 time for calcul the mask position with numpy : 0.022809982299804688 nb_pixel_total : 6862 time to create 1 rle with old method : 0.011626005172729492 time for calcul the mask position with numpy : 0.024444580078125 nb_pixel_total : 62284 time to create 1 rle with old method : 0.08729052543640137 time for calcul the mask position with numpy : 0.02214956283569336 nb_pixel_total : 26168 time to create 1 rle with old method : 0.029944658279418945 time for calcul the mask position with numpy : 0.022077322006225586 nb_pixel_total : 20523 time to create 1 rle with old method : 0.02408909797668457 time for calcul the mask position with numpy : 0.0218508243560791 nb_pixel_total : 8519 time to create 1 rle with old method : 0.00965571403503418 time for calcul the mask position with numpy : 0.021349430084228516 nb_pixel_total : 11414 time to create 1 rle with old method : 0.01288151741027832 time for calcul the mask position with numpy : 0.022159337997436523 nb_pixel_total : 12834 time to create 1 rle with old method : 0.014823436737060547 create new chi : 2.278780937194824 time to delete rle : 0.0012187957763671875 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 8117 TO DO : save crop sub photo not yet done ! save time : 2.6351568698883057 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 5.283010005950928 time for calcul the mask position with numpy : 0.607337236404419 nb_pixel_total : 6356504 time to create 1 rle with new method : 0.7942805290222168 time for calcul the mask position with numpy : 0.022719383239746094 nb_pixel_total : 7125 time to create 1 rle with old method : 0.00839543342590332 time for calcul the mask position with numpy : 0.02251267433166504 nb_pixel_total : 22315 time to create 1 rle with old method : 0.026167631149291992 time for calcul the mask position with numpy : 0.022080421447753906 nb_pixel_total : 12169 time to create 1 rle with old method : 0.014566421508789062 time for calcul the mask position with numpy : 0.023902416229248047 nb_pixel_total : 16628 time to create 1 rle with old method : 0.01908397674560547 time for calcul the mask position with numpy : 0.024196863174438477 nb_pixel_total : 359437 time to create 1 rle with new method : 0.9751806259155273 time for calcul the mask position with numpy : 0.02313542366027832 nb_pixel_total : 80605 time to create 1 rle with old method : 0.09776639938354492 time for calcul the mask position with numpy : 0.021758317947387695 nb_pixel_total : 7515 time to create 1 rle with old method : 0.008829832077026367 time for calcul the mask position with numpy : 0.02887558937072754 nb_pixel_total : 111742 time to create 1 rle with old method : 0.13191986083984375 time for calcul the mask position with numpy : 0.036590576171875 nb_pixel_total : 5085 time to create 1 rle with old method : 0.006735324859619141 time for calcul the mask position with numpy : 0.04124188423156738 nb_pixel_total : 29028 time to create 1 rle with old method : 0.03376603126525879 time for calcul the mask position with numpy : 0.036982059478759766 nb_pixel_total : 12249 time to create 1 rle with old method : 0.014409303665161133 time for calcul the mask position with numpy : 0.03717374801635742 nb_pixel_total : 17540 time to create 1 rle with old method : 0.020526409149169922 time for calcul the mask position with numpy : 0.03414177894592285 nb_pixel_total : 12298 time to create 1 rle with old method : 0.015499591827392578 create new chi : 3.2102653980255127 time to delete rle : 0.0015370845794677734 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 8438 TO DO : save crop sub photo not yet done ! save time : 1.8516755104064941 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 7.929419040679932 time for calcul the mask position with numpy : 0.7046637535095215 nb_pixel_total : 6202578 time to create 1 rle with new method : 0.817826509475708 time for calcul the mask position with numpy : 0.02476811408996582 nb_pixel_total : 31188 time to create 1 rle with old method : 0.03476595878601074 time for calcul the mask position with numpy : 0.0338897705078125 nb_pixel_total : 46821 time to create 1 rle with old method : 0.05503988265991211 time for calcul the mask position with numpy : 0.03541302680969238 nb_pixel_total : 244146 time to create 1 rle with new method : 0.5437564849853516 time for calcul the mask position with numpy : 0.034049034118652344 nb_pixel_total : 1673 time to create 1 rle with old method : 0.002067089080810547 time for calcul the mask position with numpy : 0.033887624740600586 nb_pixel_total : 21488 time to create 1 rle with old method : 0.024527788162231445 time for calcul the mask position with numpy : 0.03393697738647461 nb_pixel_total : 18286 time to create 1 rle with old method : 0.021338701248168945 time for calcul the mask position with numpy : 0.03388857841491699 nb_pixel_total : 37086 time to create 1 rle with old method : 0.0433344841003418 time for calcul the mask position with numpy : 0.032849788665771484 nb_pixel_total : 25426 time to create 1 rle with old method : 0.02927851676940918 time for calcul the mask position with numpy : 0.03258156776428223 nb_pixel_total : 20087 time to create 1 rle with old method : 0.022770166397094727 time for calcul the mask position with numpy : 0.03213310241699219 nb_pixel_total : 7518 time to create 1 rle with old method : 0.008640050888061523 time for calcul the mask position with numpy : 0.030436992645263672 nb_pixel_total : 79840 time to create 1 rle with old method : 0.08947873115539551 time for calcul the mask position with numpy : 0.03007793426513672 nb_pixel_total : 21108 time to create 1 rle with old method : 0.02511286735534668 time for calcul the mask position with numpy : 0.021775007247924805 nb_pixel_total : 37166 time to create 1 rle with old method : 0.04800057411193848 time for calcul the mask position with numpy : 0.021381616592407227 nb_pixel_total : 80286 time to create 1 rle with old method : 0.09246826171875 time for calcul the mask position with numpy : 0.023205041885375977 nb_pixel_total : 175543 time to create 1 rle with new method : 1.171515941619873 create new chi : 4.273960828781128 time to delete rle : 0.00222015380859375 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 11204 TO DO : save crop sub photo not yet done ! save time : 3.3363237380981445 nb_obj : 19 nb_hashtags : 2 time to prepare the origin masks : 5.2154459953308105 time for calcul the mask position with numpy : 0.38440680503845215 nb_pixel_total : 5796855 time to create 1 rle with new method : 0.9436969757080078 time for calcul the mask position with numpy : 0.020521879196166992 nb_pixel_total : 95159 time to create 1 rle with old method : 0.10620546340942383 time for calcul the mask position with numpy : 0.023070335388183594 nb_pixel_total : 578348 time to create 1 rle with new method : 0.532228946685791 time for calcul the mask position with numpy : 0.019772768020629883 nb_pixel_total : 12687 time to create 1 rle with old method : 0.013781547546386719 time for calcul the mask position with numpy : 0.01937246322631836 nb_pixel_total : 6196 time to create 1 rle with old method : 0.006702423095703125 time for calcul the mask position with numpy : 0.019285917282104492 nb_pixel_total : 18329 time to create 1 rle with old method : 0.020330429077148438 time for calcul the mask position with numpy : 0.019078493118286133 nb_pixel_total : 8489 time to create 1 rle with old method : 0.009965181350708008 time for calcul the mask position with numpy : 0.019791126251220703 nb_pixel_total : 21578 time to create 1 rle with old method : 0.024276256561279297 time for calcul the mask position with numpy : 0.020376920700073242 nb_pixel_total : 30009 time to create 1 rle with old method : 0.03343701362609863 time for calcul the mask position with numpy : 0.019739866256713867 nb_pixel_total : 21736 time to create 1 rle with old method : 0.0240170955657959 time for calcul the mask position with numpy : 0.020639657974243164 nb_pixel_total : 113527 time to create 1 rle with old method : 0.12693333625793457 time for calcul the mask position with numpy : 0.02036881446838379 nb_pixel_total : 33418 time to create 1 rle with old method : 0.0372312068939209 time for calcul the mask position with numpy : 0.02113485336303711 nb_pixel_total : 25509 time to create 1 rle with old method : 0.029044389724731445 time for calcul the mask position with numpy : 0.02112102508544922 nb_pixel_total : 48643 time to create 1 rle with old method : 0.05427742004394531 time for calcul the mask position with numpy : 0.020001888275146484 nb_pixel_total : 17405 time to create 1 rle with old method : 0.018761873245239258 time for calcul the mask position with numpy : 0.020396947860717773 nb_pixel_total : 3036 time to create 1 rle with old method : 0.003782033920288086 time for calcul the mask position with numpy : 0.024825572967529297 nb_pixel_total : 24672 time to create 1 rle with old method : 0.02764725685119629 time for calcul the mask position with numpy : 0.0294492244720459 nb_pixel_total : 129928 time to create 1 rle with old method : 0.14595293998718262 time for calcul the mask position with numpy : 0.03356051445007324 nb_pixel_total : 15139 time to create 1 rle with old method : 0.01784229278564453 time for calcul the mask position with numpy : 0.03319144248962402 nb_pixel_total : 49577 time to create 1 rle with old method : 0.05846095085144043 create new chi : 3.0998804569244385 time to delete rle : 0.0018429756164550781 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 11821 TO DO : save crop sub photo not yet done ! save time : 3.8214941024780273 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 8.79638147354126 time for calcul the mask position with numpy : 0.47194433212280273 nb_pixel_total : 6093177 time to create 1 rle with new method : 0.5615782737731934 time for calcul the mask position with numpy : 0.024872541427612305 nb_pixel_total : 72127 time to create 1 rle with old method : 0.11166596412658691 time for calcul the mask position with numpy : 0.021563053131103516 nb_pixel_total : 13471 time to create 1 rle with old method : 0.015978097915649414 time for calcul the mask position with numpy : 0.02254486083984375 nb_pixel_total : 18250 time to create 1 rle with old method : 0.021316051483154297 time for calcul the mask position with numpy : 0.021241188049316406 nb_pixel_total : 33552 time to create 1 rle with old method : 0.039391517639160156 time for calcul the mask position with numpy : 0.02437114715576172 nb_pixel_total : 196395 time to create 1 rle with new method : 0.5116176605224609 time for calcul the mask position with numpy : 0.021663427352905273 nb_pixel_total : 22035 time to create 1 rle with old method : 0.025042057037353516 time for calcul the mask position with numpy : 0.020915508270263672 nb_pixel_total : 73435 time to create 1 rle with old method : 0.08646845817565918 time for calcul the mask position with numpy : 0.02006077766418457 nb_pixel_total : 17893 time to create 1 rle with old method : 0.021707773208618164 time for calcul the mask position with numpy : 0.019544124603271484 nb_pixel_total : 9281 time to create 1 rle with old method : 0.011100530624389648 time for calcul the mask position with numpy : 0.019379854202270508 nb_pixel_total : 25604 time to create 1 rle with old method : 0.02758646011352539 time for calcul the mask position with numpy : 0.01963186264038086 nb_pixel_total : 25771 time to create 1 rle with old method : 0.02904057502746582 time for calcul the mask position with numpy : 0.019982337951660156 nb_pixel_total : 76998 time to create 1 rle with old method : 0.11466813087463379 time for calcul the mask position with numpy : 0.021239042282104492 nb_pixel_total : 19862 time to create 1 rle with old method : 0.022533893585205078 time for calcul the mask position with numpy : 0.020913124084472656 nb_pixel_total : 10496 time to create 1 rle with old method : 0.012239933013916016 time for calcul the mask position with numpy : 0.02030634880065918 nb_pixel_total : 21689 time to create 1 rle with old method : 0.02479243278503418 time for calcul the mask position with numpy : 0.02039790153503418 nb_pixel_total : 34946 time to create 1 rle with old method : 0.04125523567199707 time for calcul the mask position with numpy : 0.020663022994995117 nb_pixel_total : 37939 time to create 1 rle with old method : 0.04914975166320801 time for calcul the mask position with numpy : 0.022775650024414062 nb_pixel_total : 22844 time to create 1 rle with old method : 0.02708578109741211 time for calcul the mask position with numpy : 0.021902799606323242 nb_pixel_total : 9898 time to create 1 rle with old method : 0.011775732040405273 time for calcul the mask position with numpy : 0.02137589454650879 nb_pixel_total : 50722 time to create 1 rle with old method : 0.06368088722229004 time for calcul the mask position with numpy : 0.021724224090576172 nb_pixel_total : 56742 time to create 1 rle with old method : 0.06676340103149414 time for calcul the mask position with numpy : 0.021066665649414062 nb_pixel_total : 11584 time to create 1 rle with old method : 0.013675212860107422 time for calcul the mask position with numpy : 0.02131819725036621 nb_pixel_total : 95529 time to create 1 rle with old method : 0.10861992835998535 create new chi : 3.0400617122650146 time to delete rle : 0.003312826156616211 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 13648 TO DO : save crop sub photo not yet done ! save time : 3.4297518730163574 nb_obj : 24 nb_hashtags : 4 time to prepare the origin masks : 7.680138349533081 time for calcul the mask position with numpy : 0.4092283248901367 nb_pixel_total : 5609039 time to create 1 rle with new method : 0.6576731204986572 time for calcul the mask position with numpy : 0.021746158599853516 nb_pixel_total : 21756 time to create 1 rle with old method : 0.024608612060546875 time for calcul the mask position with numpy : 0.03280496597290039 nb_pixel_total : 16814 time to create 1 rle with old method : 0.01835179328918457 time for calcul the mask position with numpy : 0.033388376235961914 nb_pixel_total : 180566 time to create 1 rle with new method : 0.6455173492431641 time for calcul the mask position with numpy : 0.032550811767578125 nb_pixel_total : 12384 time to create 1 rle with old method : 0.013775348663330078 time for calcul the mask position with numpy : 0.03172659873962402 nb_pixel_total : 21691 time to create 1 rle with old method : 0.023799657821655273 time for calcul the mask position with numpy : 0.03221774101257324 nb_pixel_total : 110701 time to create 1 rle with old method : 0.1204068660736084 time for calcul the mask position with numpy : 0.031841278076171875 nb_pixel_total : 11676 time to create 1 rle with old method : 0.012623786926269531 time for calcul the mask position with numpy : 0.031314849853515625 nb_pixel_total : 11997 time to create 1 rle with old method : 0.012852907180786133 time for calcul the mask position with numpy : 0.03220486640930176 nb_pixel_total : 7315 time to create 1 rle with old method : 0.007915973663330078 time for calcul the mask position with numpy : 0.0324404239654541 nb_pixel_total : 144293 time to create 1 rle with old method : 0.15907835960388184 time for calcul the mask position with numpy : 0.03331875801086426 nb_pixel_total : 26432 time to create 1 rle with old method : 0.03059673309326172 time for calcul the mask position with numpy : 0.03188824653625488 nb_pixel_total : 14674 time to create 1 rle with old method : 0.017139911651611328 time for calcul the mask position with numpy : 0.03229522705078125 nb_pixel_total : 14730 time to create 1 rle with old method : 0.01622176170349121 time for calcul the mask position with numpy : 0.03122115135192871 nb_pixel_total : 6717 time to create 1 rle with old method : 0.007279396057128906 time for calcul the mask position with numpy : 0.032677650451660156 nb_pixel_total : 8192 time to create 1 rle with old method : 0.009639501571655273 time for calcul the mask position with numpy : 0.03235745429992676 nb_pixel_total : 177366 time to create 1 rle with new method : 0.4814450740814209 time for calcul the mask position with numpy : 0.031003713607788086 nb_pixel_total : 59476 time to create 1 rle with old method : 0.06385350227355957 time for calcul the mask position with numpy : 0.030171871185302734 nb_pixel_total : 33886 time to create 1 rle with old method : 0.03646588325500488 time for calcul the mask position with numpy : 0.030666112899780273 nb_pixel_total : 12202 time to create 1 rle with old method : 0.013857841491699219 time for calcul the mask position with numpy : 0.03146767616271973 nb_pixel_total : 171958 time to create 1 rle with new method : 0.6698989868164062 time for calcul the mask position with numpy : 0.021964550018310547 nb_pixel_total : 18538 time to create 1 rle with old method : 0.021213054656982422 time for calcul the mask position with numpy : 0.021261930465698242 nb_pixel_total : 35619 time to create 1 rle with old method : 0.04167652130126953 time for calcul the mask position with numpy : 0.022422313690185547 nb_pixel_total : 143663 time to create 1 rle with old method : 0.17483305931091309 time for calcul the mask position with numpy : 0.025076866149902344 nb_pixel_total : 178555 time to create 1 rle with new method : 0.4973418712615967 create new chi : 5.05541729927063 time to delete rle : 0.003916501998901367 batch 1 Loaded 49 chid ids of type : 3594 +++++++++++++++++++++++++++++++++Number RLEs to save : 17101 TO DO : save crop sub photo not yet done ! save time : 7.434402942657471 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 2.213024139404297 time for calcul the mask position with numpy : 0.6508288383483887 nb_pixel_total : 6607284 time to create 1 rle with new method : 0.5624299049377441 time for calcul the mask position with numpy : 0.019137144088745117 nb_pixel_total : 7711 time to create 1 rle with old method : 0.00837397575378418 time for calcul the mask position with numpy : 0.019603967666625977 nb_pixel_total : 85113 time to create 1 rle with old method : 0.09513545036315918 time for calcul the mask position with numpy : 0.02152276039123535 nb_pixel_total : 272565 time to create 1 rle with new method : 0.5926113128662109 time for calcul the mask position with numpy : 0.02015376091003418 nb_pixel_total : 50974 time to create 1 rle with old method : 0.057088613510131836 time for calcul the mask position with numpy : 0.026822328567504883 nb_pixel_total : 7842 time to create 1 rle with old method : 0.012659788131713867 time for calcul the mask position with numpy : 0.02488088607788086 nb_pixel_total : 18751 time to create 1 rle with old method : 0.026170730590820312 create new chi : 2.1939637660980225 time to delete rle : 0.0010731220245361328 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4846 TO DO : save crop sub photo not yet done ! save time : 0.484710693359375 map_output_result : {1352851749: (0.0, 'Should be the crop_list due to order', 0.0), 1352851540: (0.0, 'Should be the crop_list due to order', 0.0), 1352851508: (0.0, 'Should be the crop_list due to order', 0.0), 1352851475: (0.0, 'Should be the crop_list due to order', 0.0), 1352851432: (0.0, 'Should be the crop_list due to order', 0), 1352851385: (0.0, 'Should be the crop_list due to order', 0), 1352851098: (0.0, 'Should be the crop_list due to order', 0), 1352850976: (0.0, 'Should be the crop_list due to order', 0), 1352850921: (0.0, 'Should be the crop_list due to order', 0), 1352850918: (0.0, 'Should be the crop_list due to order', 0), 1352850636: (0.0, 'Should be the crop_list due to order', 0), 1352850493: (0.0, 'Should be the crop_list due to order', 0), 1352850274: (0.0, 'Should be the crop_list due to order', 0), 1352850239: (0.0, 'Should be the crop_list due to order', 0), 1352850040: (0.0, 'Should be the crop_list due to order', 0), 1352848580: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1352851749, 1352851540, 1352851508, 1352851475, 1352851432, 1352851385, 1352851098, 1352850976, 1352850921, 1352850918, 1352850636, 1352850493, 1352850274, 1352850239, 1352850040, 1352848580] Looping around the photos to save general results len do output : 16 /1352851749.Didn't retrieve data . /1352851540.Didn't retrieve data . /1352851508.Didn't retrieve data . /1352851475.Didn't retrieve data . /1352851432.Didn't retrieve data . /1352851385.Didn't retrieve data . /1352851098.Didn't retrieve data . /1352850976.Didn't retrieve data . /1352850921.Didn't retrieve data . /1352850918.Didn't retrieve data . /1352850636.Didn't retrieve data . /1352850493.Didn't retrieve data . /1352850274.Didn't retrieve data . /1352850239.Didn't retrieve data . /1352850040.Didn't retrieve data . /1352848580.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851749', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851540', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851508', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851475', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851432', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851385', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851098', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850976', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850921', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850918', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850636', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850493', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850274', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850239', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850040', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352848580', None, None, None, None, None, '2750609') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 48 time used for this insertion : 0.021465539932250977 save_final save missing photos in datou_result : time spend for datou_step_exec : 140.10754680633545 time spend to save output : 0.022227048873901367 total time spend for step 3 : 140.12977385520935 step4:ventilate_hashtags_in_portfolio Wed Apr 23 01:17:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22322924 get user id for portfolio 22322924 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22322924 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pehd','metal','flou','carton','background','autre','mal_croppe','papier','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22322924 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pehd','metal','flou','carton','background','autre','mal_croppe','papier','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22322924 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','pehd','metal','flou','carton','background','autre','mal_croppe','papier','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22323220,22323221,22323222,22323223,22323224,22323225,22323226,22323227,22323228,22323229,22323230?tags=environnement,pehd,metal,flou,carton,background,autre,mal_croppe,papier,pet_clair,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1352851749, 1352851540, 1352851508, 1352851475, 1352851432, 1352851385, 1352851098, 1352850976, 1352850921, 1352850918, 1352850636, 1352850493, 1352850274, 1352850239, 1352850040, 1352848580] Looping around the photos to save general results len do output : 1 /22322924. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851749', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851540', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851508', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851475', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851432', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851385', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851098', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850976', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850921', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850918', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850636', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850493', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850274', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850239', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850040', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352848580', None, None, None, None, None, '2750609') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 17 time used for this insertion : 0.02044844627380371 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.273651361465454 time spend to save output : 0.020817995071411133 total time spend for step 4 : 2.2944693565368652 step5:final Wed Apr 23 01:17:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1352851749: ('0.08225817489901056',), 1352851540: ('0.08225817489901056',), 1352851508: ('0.08225817489901056',), 1352851475: ('0.08225817489901056',), 1352851432: ('0.08225817489901056',), 1352851385: ('0.08225817489901056',), 1352851098: ('0.08225817489901056',), 1352850976: ('0.08225817489901056',), 1352850921: ('0.08225817489901056',), 1352850918: ('0.08225817489901056',), 1352850636: ('0.08225817489901056',), 1352850493: ('0.08225817489901056',), 1352850274: ('0.08225817489901056',), 1352850239: ('0.08225817489901056',), 1352850040: ('0.08225817489901056',), 1352848580: ('0.08225817489901056',)} new output for save of step final : {1352851749: ('0.08225817489901056',), 1352851540: ('0.08225817489901056',), 1352851508: ('0.08225817489901056',), 1352851475: ('0.08225817489901056',), 1352851432: ('0.08225817489901056',), 1352851385: ('0.08225817489901056',), 1352851098: ('0.08225817489901056',), 1352850976: ('0.08225817489901056',), 1352850921: ('0.08225817489901056',), 1352850918: ('0.08225817489901056',), 1352850636: ('0.08225817489901056',), 1352850493: ('0.08225817489901056',), 1352850274: ('0.08225817489901056',), 1352850239: ('0.08225817489901056',), 1352850040: ('0.08225817489901056',), 1352848580: ('0.08225817489901056',)} [1352851749, 1352851540, 1352851508, 1352851475, 1352851432, 1352851385, 1352851098, 1352850976, 1352850921, 1352850918, 1352850636, 1352850493, 1352850274, 1352850239, 1352850040, 1352848580] Looping around the photos to save general results len do output : 16 /1352851749.Didn't retrieve data . /1352851540.Didn't retrieve data . /1352851508.Didn't retrieve data . /1352851475.Didn't retrieve data . /1352851432.Didn't retrieve data . /1352851385.Didn't retrieve data . /1352851098.Didn't retrieve data . /1352850976.Didn't retrieve data . /1352850921.Didn't retrieve data . /1352850918.Didn't retrieve data . /1352850636.Didn't retrieve data . /1352850493.Didn't retrieve data . /1352850274.Didn't retrieve data . /1352850239.Didn't retrieve data . /1352850040.Didn't retrieve data . /1352848580.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851749', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851540', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851508', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851475', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851432', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851385', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851098', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850976', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850921', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850918', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850636', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850493', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850274', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850239', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850040', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352848580', None, None, None, None, None, '2750609') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 48 time used for this insertion : 0.015438079833984375 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10956263542175293 time spend to save output : 0.016153812408447266 total time spend for step 5 : 0.1257164478302002 step6:blur_detection Wed Apr 23 01:17:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1745363429_2747785_1352851749_69de939c58a9ee8eba1c973f4ad9b93b.jpg resize: (2160, 3264) 1352851749 -1.3548159528664503 treat image : temp/1745363429_2747785_1352851540_6832566dbab0b211a3483b1fe9452946.jpg resize: (2160, 3264) 1352851540 -1.3497204705915349 treat image : temp/1745363429_2747785_1352851508_04d8d9ed59fa95e969363fd30467c1e7.jpg resize: (2160, 3264) 1352851508 -1.275442841905854 treat image : temp/1745363429_2747785_1352851475_142e3b6150e1f0d40d213a5d481a0028.jpg resize: (2160, 3264) 1352851475 -4.398945289204525 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8.jpg resize: (2160, 3264) 1352851432 -2.9968337784980132 treat image : temp/1745363429_2747785_1352851385_e73e815b66ddf8fa6ad95ab8faa2fb54.jpg resize: (2160, 3264) 1352851385 -0.8614027251819881 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4.jpg resize: (2160, 3264) 1352851098 -0.9450088949011894 treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e.jpg resize: (2160, 3264) 1352850976 -1.5840889402517837 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe.jpg resize: (2160, 3264) 1352850921 -3.260452174558296 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a.jpg resize: (2160, 3264) 1352850918 -0.6680574986174015 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064.jpg resize: (2160, 3264) 1352850636 1.4230725853930557 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0.jpg resize: (2160, 3264) 1352850493 0.6037020945924858 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b.jpg resize: (2160, 3264) 1352850274 -0.6498462598525153 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc.jpg resize: (2160, 3264) 1352850239 -1.5179271814235946 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30.jpg resize: (2160, 3264) 1352850040 -0.7329176286016951 treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14.jpg resize: (2160, 3264) 1352848580 -2.4575815153363503 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597915_0.png resize: (318, 306) 1352876484 -1.865431831811663 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597920_0.png resize: (336, 238) 1352876485 -2.196755593845337 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597928_0.png resize: (219, 121) 1352876488 -2.4828307460582137 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597918_0.png resize: (231, 307) 1352876490 -1.6699628573665086 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597914_0.png resize: (209, 149) 1352876492 -0.9371816354974087 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597919_0.png resize: (201, 187) 1352876493 -1.5092461956103607 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597917_0.png resize: (179, 243) 1352876495 -0.26650370914401017 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597930_0.png resize: (150, 91) 1352876497 0.2777772690845041 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597927_0.png resize: (138, 167) 1352876499 -0.5044882151768257 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597934_0.png resize: (131, 141) 1352876501 -0.46947636635604434 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597916_0.png resize: (461, 1012) 1352876502 -2.225664573362193 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597929_0.png resize: (412, 136) 1352876504 -3.04986189381787 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597913_0.png resize: (207, 258) 1352876506 -2.159467625270718 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597931_0.png resize: (155, 149) 1352876507 -2.52117006701885 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597932_0.png resize: (153, 226) 1352876509 -1.0825713520277416 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597933_0.png resize: (105, 97) 1352876511 -1.6454014421044736 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597926_0.png resize: (182, 220) 1352876512 -2.469987951378552 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597924_0.png resize: (120, 259) 1352876514 -2.2642871330794176 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597921_0.png resize: (225, 206) 1352876516 -1.95515825799983 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597922_0.png resize: (130, 120) 1352876517 -2.6611966220347893 treat image : temp/1745363429_2747785_1352851385_e73e815b66ddf8fa6ad95ab8faa2fb54_rle_crop_3764597939_0.png resize: (270, 308) 1352876519 -1.6495556092383543 treat image : temp/1745363429_2747785_1352851385_e73e815b66ddf8fa6ad95ab8faa2fb54_rle_crop_3764597936_0.png resize: (94, 134) 1352876521 -0.6773152305558695 treat image : temp/1745363429_2747785_1352851385_e73e815b66ddf8fa6ad95ab8faa2fb54_rle_crop_3764597935_0.png resize: (93, 66) 1352876522 0.802874426786416 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597947_0.png resize: (218, 148) 1352876524 -1.1829350825188154 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597959_0.png resize: (354, 213) 1352876525 -3.7028666448149643 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597944_0.png resize: (176, 254) 1352876527 -2.722281011642228 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597946_0.png resize: (162, 123) 1352876529 -1.2735022359125847 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597941_0.png resize: (216, 235) 1352876530 -1.5263072939962918 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597955_0.png resize: (335, 318) 1352876532 -1.1569778574609222 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597958_0.png resize: (397, 557) 1352876534 -0.9758872156816849 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597945_0.png resize: (151, 325) 1352876535 0.7769600966263893 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597949_0.png resize: (348, 525) 1352876538 -2.2598731094044373 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597957_0.png resize: (126, 120) 1352876539 -1.1618822454241085 treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597964_0.png resize: (181, 100) 1352876541 -1.0688354462675766 treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597971_0.png resize: (282, 240) 1352876543 -1.7226198974506977 treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597962_0.png resize: (144, 158) 1352876544 -1.4678410318848465 treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597960_0.png resize: (213, 206) 1352876547 -1.679003744196306 treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597967_0.png resize: (112, 189) 1352876550 1.4258913077476343 treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597965_0.png resize: (246, 170) 1352876551 -1.840929966228295 treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597966_0.png resize: (287, 227) 1352876552 -1.5702706044896362 treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597968_0.png resize: (523, 456) 1352876555 -2.0458877848923542 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597986_0.png resize: (173, 255) 1352876556 -1.4044178062147397 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597978_0.png resize: (305, 265) 1352876558 -1.6346702469794436 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597984_0.png resize: (147, 100) 1352876560 -1.7489950382044426 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597972_0.png resize: (184, 217) 1352876561 -1.5412973794691494 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597974_0.png resize: (198, 214) 1352876564 -0.8190805934553265 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597985_0.png resize: (100, 135) 1352876565 -0.4510820917091685 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597979_0.png resize: (99, 103) 1352876567 -0.8066847443048526 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597973_0.png resize: (241, 205) 1352876569 -0.5070149645032213 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597975_0.png resize: (111, 93) 1352876570 -1.2833715163248178 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597981_0.png resize: (186, 190) 1352876572 -1.2795841042511267 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597983_0.png resize: (225, 132) 1352876574 -1.9842269284893002 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597977_0.png resize: (564, 405) 1352876575 -0.9764314479343803 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597989_0.png resize: (141, 102) 1352876577 -0.392595831129588 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597988_0.png resize: (65, 69) 1352876579 -0.7037992837339662 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597976_0.png resize: (61, 84) 1352876580 -2.1899081032627454 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597992_0.png resize: (118, 145) 1352876583 -0.3164353783390963 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597998_0.png resize: (418, 230) 1352876585 -2.0043347170238803 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597999_0.png resize: (140, 73) 1352876586 -2.1708420489633022 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598006_0.png resize: (143, 158) 1352876588 -2.1683267198795115 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597994_0.png resize: (123, 127) 1352876590 -1.4665484059298526 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597993_0.png resize: (179, 158) 1352876591 -2.2361878765961403 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597995_0.png resize: (117, 114) 1352876594 -0.38244481079779197 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598005_0.png resize: (385, 288) 1352876595 -0.7434455211013349 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598009_0.png resize: (151, 134) 1352876596 -2.061963606095539 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598012_0.png resize: (538, 326) 1352876597 -0.8661791839177326 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598010_0.png resize: (165, 208) 1352876600 2.1060788886139994 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598014_0.png resize: (403, 367) 1352876602 -1.0438814011254096 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598013_0.png resize: (73, 113) 1352876603 3.1144013375803086 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598011_0.png resize: (53, 126) 1352876606 0.2602278020828498 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598008_0.png resize: (169, 147) 1352876607 0.10662909507374708 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598019_0.png resize: (80, 150) 1352876608 -1.2746668706491908 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598007_0.png resize: (138, 170) 1352876611 -0.12103281919558506 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598022_0.png resize: (235, 285) 1352876612 -1.8271420364316036 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598029_0.png resize: (179, 146) 1352876613 -0.6743716417018049 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598031_0.png resize: (153, 115) 1352876616 0.025580289757515896 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598027_0.png resize: (338, 249) 1352876617 -1.1720649548118471 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598030_0.png resize: (236, 120) 1352876619 1.6202611662342263 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598032_0.png resize: (541, 658) 1352876621 0.14837011735062466 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598034_0.png resize: (203, 207) 1352876622 -0.3177162176926988 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598039_0.png resize: (106, 59) 1352876624 -2.7226834297468807 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598053_0.png resize: (455, 289) 1352876626 -0.8641953740064463 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598052_0.png resize: (821, 890) 1352876627 -0.28590198821434887 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598043_0.png resize: (145, 395) 1352876629 -1.803673032599688 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598037_0.png resize: (388, 403) 1352876631 -0.8679234105245696 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598042_0.png resize: (145, 252) 1352876632 -1.4969478843439208 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598035_0.png resize: (299, 260) 1352876634 -0.7688910541033591 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598036_0.png resize: (137, 208) 1352876636 -0.9994086071187459 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598044_0.png resize: (390, 489) 1352876637 -0.474535679183031 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598049_0.png resize: (227, 126) 1352876639 -1.034165586341222 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598051_0.png resize: (154, 139) 1352876641 -1.8463785099899235 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598040_0.png resize: (141, 165) 1352876642 -0.9660436015993319 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598048_0.png resize: (108, 100) 1352876644 0.5693203675607598 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598038_0.png resize: (173, 226) 1352876646 -0.8998974916454887 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598046_0.png resize: (138, 305) 1352876647 -1.3926164760528417 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598050_0.png resize: (115, 78) 1352876649 -0.7006486892921197 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598045_0.png resize: (256, 178) 1352876651 -0.8522411389046989 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598041_0.png resize: (318, 246) 1352876652 -1.7117034721981064 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598074_0.png resize: (237, 117) 1352876655 -2.1236396654912535 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598075_0.png resize: (102, 168) 1352876657 2.0601500686927148 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598064_0.png resize: (194, 146) 1352876659 -1.6523705538701046 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598061_0.png resize: (167, 234) 1352876661 -0.5093909556635758 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598069_0.png resize: (147, 154) 1352876663 -1.4053834156633516 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598059_0.png resize: (200, 155) 1352876665 -0.9087670385982269 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598063_0.png resize: (135, 141) 1352876667 -1.6861837195269234 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598076_0.png resize: (464, 547) 1352876669 -1.0735535258895683 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598058_0.png resize: (117, 111) 1352876671 0.49069955385528735 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598068_0.png resize: (116, 129) 1352876674 -1.3697687393443805 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598055_0.png resize: (97, 160) 1352876675 -0.6150065988815533 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598067_0.png resize: (255, 166) 1352876676 -1.431896672589512 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598066_0.png resize: (165, 205) 1352876679 -1.6498024364355788 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598088_0.png resize: (129, 163) 1352876680 -1.747922821950945 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598079_0.png resize: (279, 334) 1352876681 -2.094577636578364 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598090_0.png resize: (248, 219) 1352876684 -2.492135001790175 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598089_0.png resize: (176, 112) 1352876685 -1.396680315507167 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598087_0.png resize: (114, 94) 1352876687 -1.3251670952329953 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598082_0.png resize: (205, 182) 1352876689 -1.2491791631313736 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598086_0.png resize: (141, 74) 1352876690 -0.07139178938468255 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598094_0.png resize: (159, 96) 1352876692 -1.75125552777606 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598099_0.png resize: (202, 134) 1352876694 -2.0616724672480675 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598098_0.png resize: (610, 690) 1352876695 -0.37021876463813996 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598096_0.png resize: (204, 254) 1352876697 -1.5901756510821075 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598097_0.png resize: (140, 166) 1352876699 -0.614331278727263 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598092_0.png resize: (119, 94) 1352876700 -1.1887903839462544 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598080_0.png resize: (138, 163) 1352876702 0.3919764137264484 treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14_rle_crop_3764598106_0.png resize: (107, 109) 1352876704 0.028989350468244062 treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14_rle_crop_3764598101_0.png resize: (147, 212) 1352876705 -1.752703406081707 treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14_rle_crop_3764598102_0.png resize: (110, 101) 1352876708 -3.3838384976946965 treat image : temp/1745363429_2747785_1352851385_e73e815b66ddf8fa6ad95ab8faa2fb54_rle_crop_3764597937_0.png resize: (112, 288) 1352876879 0.08208781761578957 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597940_0.png resize: (444, 569) 1352876881 -1.2460898743934623 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597943_0.png resize: (118, 120) 1352876883 0.1351219266117514 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597956_0.png resize: (252, 232) 1352876885 -1.5197754432272261 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597980_0.png resize: (160, 241) 1352876887 -0.9860537656116373 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597996_0.png resize: (142, 366) 1352876889 -2.7778603327932245 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598002_0.png resize: (74, 143) 1352876891 -0.1078507492158988 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598016_0.png resize: (168, 136) 1352876892 0.16823306193304335 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598018_0.png resize: (196, 156) 1352876896 -1.1393924939393565 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598017_0.png resize: (148, 121) 1352876898 -0.3731831219095744 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598025_0.png resize: (140, 73) 1352876899 -1.1718052482501318 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598020_0.png resize: (678, 439) 1352876902 -0.6252953018610157 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598024_0.png resize: (396, 309) 1352876903 -0.10771929187703658 treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598047_0.png resize: (119, 282) 1352876905 -0.1283278688198993 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598062_0.png resize: (147, 201) 1352876907 -1.4947087320111516 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598071_0.png resize: (107, 243) 1352876909 2.2571192508640245 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598077_0.png resize: (637, 534) 1352876911 -1.0678045188733747 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598100_0.png resize: (161, 167) 1352876913 0.8434372256451348 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598081_0.png resize: (579, 465) 1352876914 -2.116019615782622 treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14_rle_crop_3764598103_0.png resize: (186, 395) 1352876916 -0.4694264218059355 treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597969_0.png resize: (65, 103) 1352876947 -0.07076002548850963 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597923_0.png resize: (390, 216) 1352877393 -2.6394488471533335 treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597925_0.png resize: (267, 281) 1352877396 -2.2444288597299384 treat image : temp/1745363429_2747785_1352851385_e73e815b66ddf8fa6ad95ab8faa2fb54_rle_crop_3764597938_0.png resize: (140, 449) 1352877397 -1.7660436180753132 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597950_0.png resize: (376, 342) 1352877398 -2.0482767709535317 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597953_0.png resize: (295, 583) 1352877401 -0.19705473362093354 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597952_0.png resize: (180, 325) 1352877402 -1.1295238553503393 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597942_0.png resize: (448, 608) 1352877403 0.12046989699109359 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597951_0.png resize: (344, 378) 1352877406 -0.44634221910033844 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597948_0.png resize: (119, 229) 1352877407 -3.3171539867572513 treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597970_0.png resize: (338, 146) 1352877408 -1.965536352693575 treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597961_0.png resize: (254, 282) 1352877411 -2.6190002781522237 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597982_0.png resize: (181, 352) 1352877412 -3.081125775093718 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598001_0.png resize: (240, 383) 1352877414 -0.4436252780559694 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598004_0.png resize: (405, 341) 1352877416 -0.7502854267441617 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597997_0.png resize: (147, 241) 1352877417 -0.6175563972171302 treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598015_0.png resize: (813, 751) 1352877419 -0.5169178911152897 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598026_0.png resize: (160, 168) 1352877421 -1.140197317075853 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598028_0.png resize: (255, 178) 1352877422 -0.269879095437738 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598023_0.png resize: (149, 261) 1352877424 -3.4987431909193223 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598021_0.png resize: (287, 386) 1352877426 -0.30485005406678 treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598033_0.png resize: (335, 164) 1352877427 -2.1875485360040856 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598060_0.png resize: (209, 229) 1352877429 -1.9572554448555348 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598072_0.png resize: (490, 689) 1352877431 -1.1268801316251449 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598065_0.png resize: (270, 570) 1352877432 -1.349668394873071 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598054_0.png resize: (275, 547) 1352877434 -2.6297985801873796 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598073_0.png resize: (323, 124) 1352877436 -2.012020679662793 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598057_0.png resize: (287, 231) 1352877437 -2.195288958921666 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598070_0.png resize: (369, 278) 1352877439 -0.6942956702184062 treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598056_0.png resize: (301, 276) 1352877441 -0.7842387280555767 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598085_0.png resize: (436, 490) 1352877442 -0.3316178095935194 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598084_0.png resize: (297, 278) 1352877445 -3.05930864839174 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598083_0.png resize: (241, 192) 1352877446 -0.7042057936022734 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598095_0.png resize: (442, 349) 1352877448 0.2564463124593716 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598091_0.png resize: (405, 592) 1352877450 -1.700336314578126 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598078_0.png resize: (429, 453) 1352877451 -1.399794578950486 treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14_rle_crop_3764598105_0.png resize: (376, 290) 1352877453 -2.9814553444025167 treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14_rle_crop_3764598104_0.png resize: (373, 995) 1352877456 -3.475286384360874 treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597954_0.png resize: (168, 95) 1352877506 1.093881437649839 treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597963_0.png resize: (127, 134) 1352877507 -2.09747466610351 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597987_0.png resize: (166, 162) 1352877509 -0.40432014730586774 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597990_0.png resize: (102, 106) 1352877511 -0.015730769947066087 treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598093_0.png resize: (128, 123) 1352877512 -0.474302771080816 treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597991_0.png resize: (160, 94) 1352877550 -0.13267667458134677 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598003_0.png resize: (106, 198) 1352877551 -1.8879194629009397 treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598000_0.png resize: (179, 179) 1352877554 1.516756572182292 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 210 time used for this insertion : 0.021227121353149414 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 210 time used for this insertion : 0.06096625328063965 save missing photos in datou_result : time spend for datou_step_exec : 52.55079436302185 time spend to save output : 0.0878899097442627 total time spend for step 6 : 52.63868427276611 step7:brightness Wed Apr 23 01:17:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1745363429_2747785_1352851749_69de939c58a9ee8eba1c973f4ad9b93b.jpg treat image : temp/1745363429_2747785_1352851540_6832566dbab0b211a3483b1fe9452946.jpg treat image : temp/1745363429_2747785_1352851508_04d8d9ed59fa95e969363fd30467c1e7.jpg treat image : temp/1745363429_2747785_1352851475_142e3b6150e1f0d40d213a5d481a0028.jpg treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8.jpg treat image : temp/1745363429_2747785_1352851385_e73e815b66ddf8fa6ad95ab8faa2fb54.jpg treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4.jpg treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e.jpg treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe.jpg treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a.jpg treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064.jpg treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0.jpg treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b.jpg treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc.jpg treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30.jpg treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14.jpg treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597915_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597920_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597928_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597918_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597914_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597919_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597917_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597930_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597927_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597934_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597916_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597929_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597913_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597931_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597932_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597933_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597926_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597924_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597921_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597922_0.png treat image : temp/1745363429_2747785_1352851385_e73e815b66ddf8fa6ad95ab8faa2fb54_rle_crop_3764597939_0.png treat image : temp/1745363429_2747785_1352851385_e73e815b66ddf8fa6ad95ab8faa2fb54_rle_crop_3764597936_0.png treat image : temp/1745363429_2747785_1352851385_e73e815b66ddf8fa6ad95ab8faa2fb54_rle_crop_3764597935_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597947_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597959_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597944_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597946_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597941_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597955_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597958_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597945_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597949_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597957_0.png treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597964_0.png treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597971_0.png treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597962_0.png treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597960_0.png treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597967_0.png treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597965_0.png treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597966_0.png treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597968_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597986_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597978_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597984_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597972_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597974_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597985_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597979_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597973_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597975_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597981_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597983_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597977_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597989_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597988_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597976_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597992_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597998_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597999_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598006_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597994_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597993_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597995_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598005_0.png treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598009_0.png treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598012_0.png treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598010_0.png treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598014_0.png treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598013_0.png treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598011_0.png treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598008_0.png treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598019_0.png treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598007_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598022_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598029_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598031_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598027_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598030_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598032_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598034_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598039_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598053_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598052_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598043_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598037_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598042_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598035_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598036_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598044_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598049_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598051_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598040_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598048_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598038_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598046_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598050_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598045_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598041_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598074_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598075_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598064_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598061_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598069_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598059_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598063_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598076_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598058_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598068_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598055_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598067_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598066_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598088_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598079_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598090_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598089_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598087_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598082_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598086_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598094_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598099_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598098_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598096_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598097_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598092_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598080_0.png treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14_rle_crop_3764598106_0.png treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14_rle_crop_3764598101_0.png treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14_rle_crop_3764598102_0.png treat image : temp/1745363429_2747785_1352851385_e73e815b66ddf8fa6ad95ab8faa2fb54_rle_crop_3764597937_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597940_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597943_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597956_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597980_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597996_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598002_0.png treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598016_0.png treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598018_0.png treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598017_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598025_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598020_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598024_0.png treat image : temp/1745363429_2747785_1352850274_1044ac87c1f94d279edf2825ae121e3b_rle_crop_3764598047_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598062_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598071_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598077_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598100_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598081_0.png treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14_rle_crop_3764598103_0.png treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597969_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597923_0.png treat image : temp/1745363429_2747785_1352851432_e55283ed280bf66448e4964893143be8_rle_crop_3764597925_0.png treat image : temp/1745363429_2747785_1352851385_e73e815b66ddf8fa6ad95ab8faa2fb54_rle_crop_3764597938_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597950_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597953_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597952_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597942_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597951_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597948_0.png treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597970_0.png treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597961_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597982_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598001_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598004_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764597997_0.png treat image : temp/1745363429_2747785_1352850636_b34768cf1f13c579d2fbbfc365eaa064_rle_crop_3764598015_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598026_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598028_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598023_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598021_0.png treat image : temp/1745363429_2747785_1352850493_455ecf813aae52c192e803c61bb9ffa0_rle_crop_3764598033_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598060_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598072_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598065_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598054_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598073_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598057_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598070_0.png treat image : temp/1745363429_2747785_1352850239_d4a5a29d747618761ec1d03cae125bfc_rle_crop_3764598056_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598085_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598084_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598083_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598095_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598091_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598078_0.png treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14_rle_crop_3764598105_0.png treat image : temp/1745363429_2747785_1352848580_56262a0807e0723d63a396b48ff35e14_rle_crop_3764598104_0.png treat image : temp/1745363429_2747785_1352851098_c4ffebe74f6ed93e5b556498713338b4_rle_crop_3764597954_0.png treat image : temp/1745363429_2747785_1352850976_5c6ee8255af0c7f3186eed6fb26d276e_rle_crop_3764597963_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597987_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597990_0.png treat image : temp/1745363429_2747785_1352850040_5f5da2e11f23cadf7bf51ce13d837c30_rle_crop_3764598093_0.png treat image : temp/1745363429_2747785_1352850921_598413724c207d2940b40d75d0cc2dfe_rle_crop_3764597991_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598003_0.png treat image : temp/1745363429_2747785_1352850918_a63fbf0f32e0a78589f12d21f7381c3a_rle_crop_3764598000_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 210 time used for this insertion : 0.020749568939208984 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 210 time used for this insertion : 1.1697659492492676 save missing photos in datou_result : time spend for datou_step_exec : 13.584161281585693 time spend to save output : 1.1954269409179688 total time spend for step 7 : 14.779588222503662 step8:velours_tree Wed Apr 23 01:18:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.27161550521850586 time spend to save output : 6.866455078125e-05 total time spend for step 8 : 0.2716841697692871 step9:send_mail_cod Wed Apr 23 01:18:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22322924_23-04-2025_01_18_14.pdf 22323221 imagette223232211745363894 22323222 change filename to text .imagette223232221745363894 22323223 imagette223232231745363894 22323224 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223232241745363894 22323225 imagette223232251745363895 22323226 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223232261745363895 22323227 imagette223232271745363895 22323228 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223232281745363895 22323229 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette223232291745363898 22323230 change filename to text .change filename to text .change filename to text .imagette223232301745363899 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22322924 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22323220,22323221,22323222,22323223,22323224,22323225,22323226,22323227,22323228,22323229,22323230?tags=environnement,pehd,metal,flou,carton,background,autre,mal_croppe,papier,pet_clair,pet_fonce args[1352851749] : ((1352851749, -1.3548159528664503, 492688767), (1352851749, 0.48856208834070713, 2107752395), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352851540] : ((1352851540, -1.3497204705915349, 492688767), (1352851540, -0.19159217498279038, 496442774), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352851508] : ((1352851508, -1.275442841905854, 492688767), (1352851508, 0.33987194468011633, 2107752395), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352851475] : ((1352851475, -4.398945289204525, 492609224), (1352851475, 0.20188829010203782, 2107752395), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352851432] : ((1352851432, -2.9968337784980132, 492609224), (1352851432, 0.018967241493261715, 2107752395), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352851385] : ((1352851385, -0.8614027251819881, 492688767), (1352851385, 0.661205052235712, 2107752395), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352851098] : ((1352851098, -0.9450088949011894, 492688767), (1352851098, -0.29362791110087366, 496442774), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352850976] : ((1352850976, -1.5840889402517837, 492688767), (1352850976, 0.18745256715038655, 2107752395), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352850921] : ((1352850921, -3.260452174558296, 492609224), (1352850921, 0.09956794488164857, 2107752395), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352850918] : ((1352850918, -0.6680574986174015, 492688767), (1352850918, -0.06025394427755631, 2107752395), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352850636] : ((1352850636, 1.4230725853930557, 492688767), (1352850636, 0.74481372904139, 2107752395), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352850493] : ((1352850493, 0.6037020945924858, 492688767), (1352850493, -0.20023158026689233, 496442774), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352850274] : ((1352850274, -0.6498462598525153, 492688767), (1352850274, 0.25628397521613533, 2107752395), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352850239] : ((1352850239, -1.5179271814235946, 492688767), (1352850239, -0.17573600391623992, 496442774), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352850040] : ((1352850040, -0.7329176286016951, 492688767), (1352850040, -0.2202348515261153, 496442774), '0.08225817489901056') We are sending mail with results at report@fotonower.com args[1352848580] : ((1352848580, -2.4575815153363503, 492609224), (1352848580, 0.17576598728856907, 2107752395), '0.08225817489901056') We are sending mail with results at report@fotonower.com refus_total : 0.08225817489901056 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22322924 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22322924_23-04-2025_01_18_14.pdf results_Auto_P22322924_23-04-2025_01_18_14.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22322924_23-04-2025_01_18_14.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22322924','results_Auto_P22322924_23-04-2025_01_18_14.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22322924_23-04-2025_01_18_14.pdf','pdf','','0.79','0.08225817489901056') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22322924

https://www.fotonower.com/image?json=false&list_photos_id=1352851749
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352851540
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352851508
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352851475
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352851432
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352851385
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352851098
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352850976
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352850921
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352850918
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352850636
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.4230725853930557)
https://www.fotonower.com/image?json=false&list_photos_id=1352850493
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352850274
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352850239
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352850040
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352848580
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.23%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/22323222?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22323224?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22323226?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22323228?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22323229?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22323230?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22322924_23-04-2025_01_18_14.pdf.

Lien vers velours :https://www.fotonower.com/velours/22323220,22323221,22323222,22323223,22323224,22323225,22323226,22323227,22323228,22323229,22323230?tags=environnement,pehd,metal,flou,carton,background,autre,mal_croppe,papier,pet_clair,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 22 Apr 2025 23:18:23 GMT Content-Length: 0 Connection: close X-Message-Id: W1t0pjCFTGWFE9aDgwsVUw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1352851749, 1352851540, 1352851508, 1352851475, 1352851432, 1352851385, 1352851098, 1352850976, 1352850921, 1352850918, 1352850636, 1352850493, 1352850274, 1352850239, 1352850040, 1352848580] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851749', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851540', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851508', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851475', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851432', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851385', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851098', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850976', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850921', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850918', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850636', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850493', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850274', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850239', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850040', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352848580', None, None, None, None, None, '2750609') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.018601179122924805 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.57156491279602 time spend to save output : 0.018787145614624023 total time spend for step 9 : 9.590352058410645 step10:split_time_score Wed Apr 23 01:18:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 16),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 22042025 22322924 Nombre de photos uploadées : 16 / 23040 (0%) 22042025 22322924 Nombre de photos taguées (types de déchets): 0 / 16 (0%) 22042025 22322924 Nombre de photos taguées (volume) : 0 / 16 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ???????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007433891296386719 elapsed_time : insert_dashboard_record_day_entry 0.044058799743652344 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.095039153270242 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22320093_22-04-2025_23_12_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22320093 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22320093 AND mptpi.`type`=3726 To do Qualite : 0.12753700400722856 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22320094_22-04-2025_23_03_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22320094 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22320094 AND mptpi.`type`=3726 To do Qualite : 0.17077358359431744 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22320096_22-04-2025_23_35_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22320096 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22320096 AND mptpi.`type`=3594 To do Qualite : 0.14828435240889284 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22320098_22-04-2025_23_17_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22320098 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22320098 AND mptpi.`type`=3594 To do Qualite : 0.15047996790022594 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22322096_23-04-2025_00_23_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22322096 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22322096 AND mptpi.`type`=3594 To do Qualite : 0.028461996930071263 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22322100_23-04-2025_00_19_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22322100 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22322100 AND mptpi.`type`=3726 To do Qualite : 0.12110076630961027 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22301283_22-04-2025_13_39_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22301283 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22301283 AND mptpi.`type`=3594 To do Qualite : 0.08913563062786328 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22306054_22-04-2025_15_32_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22306054 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22306054 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22322902 order by id desc limit 1 Qualite : 0.08225817489901056 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22322924_23-04-2025_01_18_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22322924 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22322924 AND mptpi.`type`=3594 To do Qualite : 0.03964220537226671 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22322108_23-04-2025_00_15_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22322108 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22322108 AND mptpi.`type`=3726 To do Qualite : 0.11577262077670576 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22322111_23-04-2025_00_27_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22322111 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22322111 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22317568 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'22042025': {'nb_upload': 16, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1352851749, 1352851540, 1352851508, 1352851475, 1352851432, 1352851385, 1352851098, 1352850976, 1352850921, 1352850918, 1352850636, 1352850493, 1352850274, 1352850239, 1352850040, 1352848580] Looping around the photos to save general results len do output : 1 /22322924Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851749', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851540', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851508', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851475', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851432', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851385', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352851098', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850976', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850921', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850918', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850636', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850493', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850274', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850239', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352850040', None, None, None, None, None, '2750609') ('3318', None, None, None, None, None, None, None, '2750609') ('3318', '22322924', '1352848580', None, None, None, None, None, '2750609') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 17 time used for this insertion : 0.0204925537109375 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.6562302112579346 time spend to save output : 0.020725250244140625 total time spend for step 10 : 2.676955461502075 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 16 set_done_treatment 180.78user 155.07system 8:01.41elapsed 69%CPU (0avgtext+0avgdata 6072336maxresident)k 915328inputs+100816outputs (15800major+16629267minor)pagefaults 0swaps