python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 193040 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2965961'] with mtr_portfolio_ids : ['23375432'] and first list_photo_ids : [] new path : /proc/193040/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 1.9028220176696777 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 27 12:30:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 3000 l 3632 free memory gpu now : 1506 wait 20 seconds l 3637 free memory gpu now : 1506 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-27 12:30:52.229448: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-27 12:30:52.259036: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-27 12:30:52.260645: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f175c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-27 12:30:52.260705: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-27 12:30:52.263350: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-27 12:30:52.513469: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x19f1c270 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-27 12:30:52.513516: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-27 12:30:52.514470: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 12:30:52.514922: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 12:30:52.518071: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 12:30:52.521267: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 12:30:52.521854: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 12:30:52.525016: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 12:30:52.526184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 12:30:52.531006: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 12:30:52.532066: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 12:30:52.532178: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 12:30:52.532683: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 12:30:52.532700: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 12:30:52.532726: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 12:30:52.533553: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1129 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-27 12:30:52.789003: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 12:30:52.789090: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 12:30:52.789111: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 12:30:52.789130: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 12:30:52.789148: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 12:30:52.789167: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 12:30:52.789184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 12:30:52.789202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 12:30:52.790124: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 12:30:52.791076: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-27 12:30:52.791115: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-27 12:30:52.791134: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 12:30:52.791151: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-27 12:30:52.791168: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-27 12:30:52.791185: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-27 12:30:52.791202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-27 12:30:52.791219: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 12:30:52.792079: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-27 12:30:52.792116: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-27 12:30:52.792127: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-27 12:30:52.792136: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-27 12:30:52.793052: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1129 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-27 12:31:02.397461: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-27 12:31:02.593499: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-27 12:31:04.300793: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:31:04.300850: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:31:04.307283: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:31:04.307308: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:31:04.313745: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.313766: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:31:04.314214: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.314228: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:31:04.344173: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:31:04.344200: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:31:04.349886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.349905: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:31:04.350364: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.350379: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-27 12:31:04.385964: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.386434: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 512.00M (536870912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.461192: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.461705: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.463361: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.463850: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.471518: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.472009: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.478705: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.479221: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.480811: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.481258: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.512388: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.512845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.513291: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.513746: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.517694: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.518142: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.536670: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.537130: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.537573: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.538016: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.553179: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.553634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.562028: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.562517: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.575198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.575654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.579768: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.580220: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.580847: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.581302: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.592440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.592934: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.593438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.594031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.594553: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.595048: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.660572: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.661362: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.669563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.670393: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.686432: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.686990: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.687494: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.687977: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.692116: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.692585: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.693030: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.693472: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.694492: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.694513: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-27 12:31:04.705296: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.705781: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.714838: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.715345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.715894: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.716376: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.716868: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-27 12:31:04.717312: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 618.88M (648937472 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 Detection mask done ! Trying to reset tf kernel 194419 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 313 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1506 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.004084587097167969 nb_pixel_total : 181196 time to create 1 rle with new method : 0.011219024658203125 length of segment : 434 time for calcul the mask position with numpy : 0.0016617774963378906 nb_pixel_total : 109895 time to create 1 rle with old method : 0.15415430068969727 length of segment : 357 time for calcul the mask position with numpy : 0.004292726516723633 nb_pixel_total : 155872 time to create 1 rle with new method : 0.017093181610107422 length of segment : 778 time for calcul the mask position with numpy : 0.0013775825500488281 nb_pixel_total : 103739 time to create 1 rle with old method : 0.11757874488830566 length of segment : 435 time for calcul the mask position with numpy : 0.037886857986450195 nb_pixel_total : 696080 time to create 1 rle with new method : 0.5662243366241455 length of segment : 1714 time for calcul the mask position with numpy : 0.0025763511657714844 nb_pixel_total : 199356 time to create 1 rle with new method : 0.006848573684692383 length of segment : 553 time for calcul the mask position with numpy : 0.0015761852264404297 nb_pixel_total : 128642 time to create 1 rle with old method : 0.14179110527038574 length of segment : 527 time for calcul the mask position with numpy : 0.0002846717834472656 nb_pixel_total : 15055 time to create 1 rle with old method : 0.01709914207458496 length of segment : 118 time for calcul the mask position with numpy : 0.0008563995361328125 nb_pixel_total : 62494 time to create 1 rle with old method : 0.06874871253967285 length of segment : 407 time for calcul the mask position with numpy : 0.0020225048065185547 nb_pixel_total : 99366 time to create 1 rle with old method : 0.11142325401306152 length of segment : 591 time for calcul the mask position with numpy : 0.0011718273162841797 nb_pixel_total : 73486 time to create 1 rle with old method : 0.08223247528076172 length of segment : 363 time for calcul the mask position with numpy : 0.001627206802368164 nb_pixel_total : 115103 time to create 1 rle with old method : 0.12863397598266602 length of segment : 629 time for calcul the mask position with numpy : 0.00305938720703125 nb_pixel_total : 225633 time to create 1 rle with new method : 0.007489442825317383 length of segment : 593 time for calcul the mask position with numpy : 0.0003027915954589844 nb_pixel_total : 14231 time to create 1 rle with old method : 0.01597905158996582 length of segment : 144 time for calcul the mask position with numpy : 0.0006051063537597656 nb_pixel_total : 36167 time to create 1 rle with old method : 0.038973093032836914 length of segment : 240 time for calcul the mask position with numpy : 0.0006902217864990234 nb_pixel_total : 32658 time to create 1 rle with old method : 0.03689002990722656 length of segment : 207 time for calcul the mask position with numpy : 0.0007178783416748047 nb_pixel_total : 17260 time to create 1 rle with old method : 0.019612550735473633 length of segment : 205 time for calcul the mask position with numpy : 0.0015475749969482422 nb_pixel_total : 39334 time to create 1 rle with old method : 0.04494452476501465 length of segment : 285 time for calcul the mask position with numpy : 0.0013580322265625 nb_pixel_total : 49153 time to create 1 rle with old method : 0.0544888973236084 length of segment : 199 time for calcul the mask position with numpy : 0.0018396377563476562 nb_pixel_total : 65596 time to create 1 rle with old method : 0.0737771987915039 length of segment : 298 time for calcul the mask position with numpy : 0.0014853477478027344 nb_pixel_total : 46941 time to create 1 rle with old method : 0.052500009536743164 length of segment : 263 time for calcul the mask position with numpy : 0.0003402233123779297 nb_pixel_total : 11208 time to create 1 rle with old method : 0.013100862503051758 length of segment : 197 time for calcul the mask position with numpy : 0.0011801719665527344 nb_pixel_total : 49240 time to create 1 rle with old method : 0.054830074310302734 length of segment : 221 time for calcul the mask position with numpy : 0.0017955303192138672 nb_pixel_total : 75315 time to create 1 rle with old method : 0.08209109306335449 length of segment : 406 time for calcul the mask position with numpy : 0.00027179718017578125 nb_pixel_total : 5481 time to create 1 rle with old method : 0.0063800811767578125 length of segment : 126 time for calcul the mask position with numpy : 0.0001685619354248047 nb_pixel_total : 8302 time to create 1 rle with old method : 0.00971674919128418 length of segment : 91 time for calcul the mask position with numpy : 0.0010578632354736328 nb_pixel_total : 36965 time to create 1 rle with old method : 0.04016852378845215 length of segment : 206 time for calcul the mask position with numpy : 0.00519561767578125 nb_pixel_total : 262051 time to create 1 rle with new method : 0.009865999221801758 length of segment : 697 time for calcul the mask position with numpy : 0.0007045269012451172 nb_pixel_total : 31396 time to create 1 rle with old method : 0.03569817543029785 length of segment : 331 time for calcul the mask position with numpy : 0.0010564327239990234 nb_pixel_total : 42831 time to create 1 rle with old method : 0.04899334907531738 length of segment : 452 time for calcul the mask position with numpy : 0.0011587142944335938 nb_pixel_total : 35081 time to create 1 rle with old method : 0.039273738861083984 length of segment : 221 time for calcul the mask position with numpy : 0.0006055831909179688 nb_pixel_total : 26507 time to create 1 rle with old method : 0.02929377555847168 length of segment : 203 time for calcul the mask position with numpy : 0.001888275146484375 nb_pixel_total : 97571 time to create 1 rle with old method : 0.10788249969482422 length of segment : 358 time for calcul the mask position with numpy : 0.0025949478149414062 nb_pixel_total : 57912 time to create 1 rle with old method : 0.06486344337463379 length of segment : 499 time for calcul the mask position with numpy : 0.0008411407470703125 nb_pixel_total : 24296 time to create 1 rle with old method : 0.02696371078491211 length of segment : 366 time for calcul the mask position with numpy : 0.0011250972747802734 nb_pixel_total : 87189 time to create 1 rle with old method : 0.09517860412597656 length of segment : 295 time for calcul the mask position with numpy : 0.0005109310150146484 nb_pixel_total : 31756 time to create 1 rle with old method : 0.03557467460632324 length of segment : 169 time for calcul the mask position with numpy : 0.0008289813995361328 nb_pixel_total : 44293 time to create 1 rle with old method : 0.05066967010498047 length of segment : 290 time for calcul the mask position with numpy : 0.0018453598022460938 nb_pixel_total : 107510 time to create 1 rle with old method : 0.140761137008667 length of segment : 313 time for calcul the mask position with numpy : 0.0005052089691162109 nb_pixel_total : 27806 time to create 1 rle with old method : 0.030969858169555664 length of segment : 168 time for calcul the mask position with numpy : 0.001199960708618164 nb_pixel_total : 83090 time to create 1 rle with old method : 0.09032869338989258 length of segment : 373 time for calcul the mask position with numpy : 0.0011649131774902344 nb_pixel_total : 79912 time to create 1 rle with old method : 0.0893869400024414 length of segment : 330 time for calcul the mask position with numpy : 0.0005173683166503906 nb_pixel_total : 26966 time to create 1 rle with old method : 0.02997875213623047 length of segment : 385 time for calcul the mask position with numpy : 0.0014576911926269531 nb_pixel_total : 87552 time to create 1 rle with old method : 0.09759306907653809 length of segment : 374 time for calcul the mask position with numpy : 0.003721952438354492 nb_pixel_total : 296262 time to create 1 rle with new method : 0.009415149688720703 length of segment : 774 time for calcul the mask position with numpy : 0.0014815330505371094 nb_pixel_total : 97848 time to create 1 rle with old method : 0.10260820388793945 length of segment : 505 time for calcul the mask position with numpy : 0.0012359619140625 nb_pixel_total : 85437 time to create 1 rle with old method : 0.09689211845397949 length of segment : 462 time for calcul the mask position with numpy : 0.002161264419555664 nb_pixel_total : 140715 time to create 1 rle with old method : 0.1519794464111328 length of segment : 421 time for calcul the mask position with numpy : 0.0036242008209228516 nb_pixel_total : 124644 time to create 1 rle with old method : 0.13700437545776367 length of segment : 413 time for calcul the mask position with numpy : 0.0002677440643310547 nb_pixel_total : 11654 time to create 1 rle with old method : 0.013076066970825195 length of segment : 186 time for calcul the mask position with numpy : 0.0012009143829345703 nb_pixel_total : 27943 time to create 1 rle with old method : 0.03080439567565918 length of segment : 242 time for calcul the mask position with numpy : 0.000982046127319336 nb_pixel_total : 39518 time to create 1 rle with old method : 0.04558300971984863 length of segment : 259 time for calcul the mask position with numpy : 0.0018854141235351562 nb_pixel_total : 75498 time to create 1 rle with old method : 0.08783507347106934 length of segment : 296 time for calcul the mask position with numpy : 0.0009608268737792969 nb_pixel_total : 37670 time to create 1 rle with old method : 0.045058488845825195 length of segment : 316 time for calcul the mask position with numpy : 0.0007715225219726562 nb_pixel_total : 19230 time to create 1 rle with old method : 0.021363258361816406 length of segment : 207 time for calcul the mask position with numpy : 0.001848459243774414 nb_pixel_total : 69239 time to create 1 rle with old method : 0.07977914810180664 length of segment : 297 time for calcul the mask position with numpy : 0.0015368461608886719 nb_pixel_total : 50917 time to create 1 rle with old method : 0.05819988250732422 length of segment : 242 time for calcul the mask position with numpy : 0.001973867416381836 nb_pixel_total : 63802 time to create 1 rle with old method : 0.07116413116455078 length of segment : 440 time for calcul the mask position with numpy : 0.0005304813385009766 nb_pixel_total : 12769 time to create 1 rle with old method : 0.015023946762084961 length of segment : 179 time for calcul the mask position with numpy : 0.005306720733642578 nb_pixel_total : 195599 time to create 1 rle with new method : 0.008092403411865234 length of segment : 537 time for calcul the mask position with numpy : 0.0037522315979003906 nb_pixel_total : 129622 time to create 1 rle with old method : 0.14814376831054688 length of segment : 553 time for calcul the mask position with numpy : 0.0011677742004394531 nb_pixel_total : 34679 time to create 1 rle with old method : 0.03917431831359863 length of segment : 242 time for calcul the mask position with numpy : 0.001980304718017578 nb_pixel_total : 75403 time to create 1 rle with old method : 0.08219742774963379 length of segment : 435 time for calcul the mask position with numpy : 0.0007617473602294922 nb_pixel_total : 39799 time to create 1 rle with old method : 0.042867183685302734 length of segment : 260 time for calcul the mask position with numpy : 0.0011091232299804688 nb_pixel_total : 26544 time to create 1 rle with old method : 0.029332876205444336 length of segment : 306 time for calcul the mask position with numpy : 0.0033655166625976562 nb_pixel_total : 94515 time to create 1 rle with old method : 0.10286116600036621 length of segment : 631 time for calcul the mask position with numpy : 0.0008552074432373047 nb_pixel_total : 54617 time to create 1 rle with old method : 0.060135841369628906 length of segment : 305 time for calcul the mask position with numpy : 0.00019502639770507812 nb_pixel_total : 7479 time to create 1 rle with old method : 0.00879669189453125 length of segment : 100 time for calcul the mask position with numpy : 0.0013155937194824219 nb_pixel_total : 76426 time to create 1 rle with old method : 0.08310770988464355 length of segment : 282 time for calcul the mask position with numpy : 0.0003161430358886719 nb_pixel_total : 14643 time to create 1 rle with old method : 0.016674280166625977 length of segment : 190 time for calcul the mask position with numpy : 0.0005891323089599609 nb_pixel_total : 34399 time to create 1 rle with old method : 0.03901815414428711 length of segment : 239 time for calcul the mask position with numpy : 0.0006253719329833984 nb_pixel_total : 40953 time to create 1 rle with old method : 0.04703879356384277 length of segment : 241 time for calcul the mask position with numpy : 0.0001900196075439453 nb_pixel_total : 11043 time to create 1 rle with old method : 0.01224064826965332 length of segment : 115 time for calcul the mask position with numpy : 0.002769947052001953 nb_pixel_total : 130760 time to create 1 rle with old method : 0.17020273208618164 length of segment : 452 time for calcul the mask position with numpy : 0.00113677978515625 nb_pixel_total : 59414 time to create 1 rle with old method : 0.0637505054473877 length of segment : 461 time for calcul the mask position with numpy : 0.0006334781646728516 nb_pixel_total : 30643 time to create 1 rle with old method : 0.03455781936645508 length of segment : 368 time for calcul the mask position with numpy : 0.0006136894226074219 nb_pixel_total : 31049 time to create 1 rle with old method : 0.034430503845214844 length of segment : 233 time for calcul the mask position with numpy : 0.0031256675720214844 nb_pixel_total : 185837 time to create 1 rle with new method : 0.008528947830200195 length of segment : 602 time for calcul the mask position with numpy : 0.0008187294006347656 nb_pixel_total : 46039 time to create 1 rle with old method : 0.05011391639709473 length of segment : 272 time for calcul the mask position with numpy : 0.0018846988677978516 nb_pixel_total : 101440 time to create 1 rle with old method : 0.11125516891479492 length of segment : 575 time for calcul the mask position with numpy : 0.0022966861724853516 nb_pixel_total : 147878 time to create 1 rle with old method : 0.1678929328918457 length of segment : 379 time for calcul the mask position with numpy : 0.0035669803619384766 nb_pixel_total : 114941 time to create 1 rle with old method : 0.1289355754852295 length of segment : 659 time for calcul the mask position with numpy : 0.003760814666748047 nb_pixel_total : 138483 time to create 1 rle with old method : 0.14957475662231445 length of segment : 447 time for calcul the mask position with numpy : 0.0004010200500488281 nb_pixel_total : 11917 time to create 1 rle with old method : 0.013909339904785156 length of segment : 118 time for calcul the mask position with numpy : 0.0023512840270996094 nb_pixel_total : 56617 time to create 1 rle with old method : 0.08781957626342773 length of segment : 378 time for calcul the mask position with numpy : 0.003233194351196289 nb_pixel_total : 128572 time to create 1 rle with old method : 0.14127326011657715 length of segment : 840 time for calcul the mask position with numpy : 0.0021681785583496094 nb_pixel_total : 80544 time to create 1 rle with old method : 0.08715415000915527 length of segment : 305 time for calcul the mask position with numpy : 0.0014595985412597656 nb_pixel_total : 57977 time to create 1 rle with old method : 0.06225085258483887 length of segment : 405 time for calcul the mask position with numpy : 0.003353118896484375 nb_pixel_total : 111084 time to create 1 rle with old method : 0.11637330055236816 length of segment : 579 time for calcul the mask position with numpy : 0.002800464630126953 nb_pixel_total : 151867 time to create 1 rle with new method : 0.006082057952880859 length of segment : 501 time for calcul the mask position with numpy : 0.0009500980377197266 nb_pixel_total : 65964 time to create 1 rle with old method : 0.07149386405944824 length of segment : 323 time for calcul the mask position with numpy : 0.0012018680572509766 nb_pixel_total : 57974 time to create 1 rle with old method : 0.06455492973327637 length of segment : 531 time for calcul the mask position with numpy : 0.0003046989440917969 nb_pixel_total : 13857 time to create 1 rle with old method : 0.015869617462158203 length of segment : 188 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 5193 time to create 1 rle with old method : 0.006001949310302734 length of segment : 61 time for calcul the mask position with numpy : 0.0007333755493164062 nb_pixel_total : 21849 time to create 1 rle with old method : 0.02585124969482422 length of segment : 160 time for calcul the mask position with numpy : 0.0034134387969970703 nb_pixel_total : 191979 time to create 1 rle with new method : 0.006162166595458984 length of segment : 496 time for calcul the mask position with numpy : 0.014853477478027344 nb_pixel_total : 600922 time to create 1 rle with new method : 0.0697624683380127 length of segment : 806 time for calcul the mask position with numpy : 0.0057830810546875 nb_pixel_total : 194226 time to create 1 rle with new method : 0.011839628219604492 length of segment : 362 time for calcul the mask position with numpy : 0.0002923011779785156 nb_pixel_total : 3564 time to create 1 rle with old method : 0.004227399826049805 length of segment : 88 time for calcul the mask position with numpy : 0.0005640983581542969 nb_pixel_total : 11426 time to create 1 rle with old method : 0.013099431991577148 length of segment : 191 time for calcul the mask position with numpy : 0.0011451244354248047 nb_pixel_total : 33983 time to create 1 rle with old method : 0.038252830505371094 length of segment : 219 time for calcul the mask position with numpy : 0.0015163421630859375 nb_pixel_total : 32337 time to create 1 rle with old method : 0.036603689193725586 length of segment : 224 time for calcul the mask position with numpy : 0.0005819797515869141 nb_pixel_total : 36472 time to create 1 rle with old method : 0.04088187217712402 length of segment : 330 time for calcul the mask position with numpy : 0.00023889541625976562 nb_pixel_total : 13737 time to create 1 rle with old method : 0.015990018844604492 length of segment : 254 time for calcul the mask position with numpy : 0.00226593017578125 nb_pixel_total : 150807 time to create 1 rle with new method : 0.0063228607177734375 length of segment : 605 time for calcul the mask position with numpy : 0.0005059242248535156 nb_pixel_total : 26226 time to create 1 rle with old method : 0.030342817306518555 length of segment : 228 time for calcul the mask position with numpy : 0.0008785724639892578 nb_pixel_total : 49807 time to create 1 rle with old method : 0.057372093200683594 length of segment : 262 time for calcul the mask position with numpy : 0.0002701282501220703 nb_pixel_total : 16374 time to create 1 rle with old method : 0.01893305778503418 length of segment : 157 time for calcul the mask position with numpy : 0.0005059242248535156 nb_pixel_total : 30939 time to create 1 rle with old method : 0.035248756408691406 length of segment : 230 time for calcul the mask position with numpy : 0.00039768218994140625 nb_pixel_total : 23495 time to create 1 rle with old method : 0.026822805404663086 length of segment : 196 time for calcul the mask position with numpy : 0.0002694129943847656 nb_pixel_total : 14719 time to create 1 rle with old method : 0.01739215850830078 length of segment : 138 time for calcul the mask position with numpy : 0.0007157325744628906 nb_pixel_total : 43984 time to create 1 rle with old method : 0.04934430122375488 length of segment : 261 time for calcul the mask position with numpy : 0.0003495216369628906 nb_pixel_total : 17070 time to create 1 rle with old method : 0.01950526237487793 length of segment : 198 time for calcul the mask position with numpy : 0.001415252685546875 nb_pixel_total : 88452 time to create 1 rle with old method : 0.12494969367980957 length of segment : 536 time for calcul the mask position with numpy : 0.0004246234893798828 nb_pixel_total : 11738 time to create 1 rle with old method : 0.019878864288330078 length of segment : 131 time for calcul the mask position with numpy : 0.00022172927856445312 nb_pixel_total : 11318 time to create 1 rle with old method : 0.013860225677490234 length of segment : 120 time for calcul the mask position with numpy : 0.006844282150268555 nb_pixel_total : 250565 time to create 1 rle with new method : 0.008152246475219727 length of segment : 525 time for calcul the mask position with numpy : 0.0013170242309570312 nb_pixel_total : 21549 time to create 1 rle with old method : 0.02478480339050293 length of segment : 189 time for calcul the mask position with numpy : 0.0006144046783447266 nb_pixel_total : 8894 time to create 1 rle with old method : 0.010879993438720703 length of segment : 130 time for calcul the mask position with numpy : 0.0015001296997070312 nb_pixel_total : 44413 time to create 1 rle with old method : 0.05045175552368164 length of segment : 290 time for calcul the mask position with numpy : 0.003565549850463867 nb_pixel_total : 95209 time to create 1 rle with old method : 0.10790562629699707 length of segment : 439 time for calcul the mask position with numpy : 0.0010199546813964844 nb_pixel_total : 22293 time to create 1 rle with old method : 0.026392221450805664 length of segment : 230 time for calcul the mask position with numpy : 0.002697467803955078 nb_pixel_total : 63030 time to create 1 rle with old method : 0.09351134300231934 length of segment : 391 time for calcul the mask position with numpy : 0.0009553432464599609 nb_pixel_total : 22713 time to create 1 rle with old method : 0.026453733444213867 length of segment : 185 time for calcul the mask position with numpy : 0.003965139389038086 nb_pixel_total : 95917 time to create 1 rle with old method : 0.1096198558807373 length of segment : 453 time for calcul the mask position with numpy : 0.0031452178955078125 nb_pixel_total : 95464 time to create 1 rle with old method : 0.10959720611572266 length of segment : 343 time for calcul the mask position with numpy : 0.003586292266845703 nb_pixel_total : 98776 time to create 1 rle with old method : 0.11640095710754395 length of segment : 540 time for calcul the mask position with numpy : 0.004735231399536133 nb_pixel_total : 121577 time to create 1 rle with old method : 0.14671778678894043 length of segment : 648 time for calcul the mask position with numpy : 0.0003948211669921875 nb_pixel_total : 16849 time to create 1 rle with old method : 0.018817901611328125 length of segment : 214 time for calcul the mask position with numpy : 0.002053976058959961 nb_pixel_total : 52217 time to create 1 rle with old method : 0.06064438819885254 length of segment : 290 time for calcul the mask position with numpy : 0.0012307167053222656 nb_pixel_total : 34784 time to create 1 rle with old method : 0.04381680488586426 length of segment : 258 time for calcul the mask position with numpy : 0.0009958744049072266 nb_pixel_total : 18051 time to create 1 rle with old method : 0.020875215530395508 length of segment : 231 time for calcul the mask position with numpy : 0.004820585250854492 nb_pixel_total : 194819 time to create 1 rle with new method : 0.006133317947387695 length of segment : 647 time for calcul the mask position with numpy : 0.0005648136138916016 nb_pixel_total : 15825 time to create 1 rle with old method : 0.018746137619018555 length of segment : 136 time for calcul the mask position with numpy : 0.0021102428436279297 nb_pixel_total : 81779 time to create 1 rle with old method : 0.09330391883850098 length of segment : 266 time for calcul the mask position with numpy : 0.0024678707122802734 nb_pixel_total : 77493 time to create 1 rle with old method : 0.08404254913330078 length of segment : 539 time for calcul the mask position with numpy : 0.0007796287536621094 nb_pixel_total : 19730 time to create 1 rle with old method : 0.02310800552368164 length of segment : 265 time for calcul the mask position with numpy : 0.0011589527130126953 nb_pixel_total : 25881 time to create 1 rle with old method : 0.029233694076538086 length of segment : 222 time for calcul the mask position with numpy : 0.0012023448944091797 nb_pixel_total : 32322 time to create 1 rle with old method : 0.04112362861633301 length of segment : 197 time for calcul the mask position with numpy : 0.003550291061401367 nb_pixel_total : 112657 time to create 1 rle with old method : 0.2070176601409912 length of segment : 402 time for calcul the mask position with numpy : 0.006621122360229492 nb_pixel_total : 118575 time to create 1 rle with old method : 0.2642192840576172 length of segment : 473 time for calcul the mask position with numpy : 0.0007669925689697266 nb_pixel_total : 14037 time to create 1 rle with old method : 0.01642632484436035 length of segment : 132 time for calcul the mask position with numpy : 0.002433300018310547 nb_pixel_total : 41690 time to create 1 rle with old method : 0.0474545955657959 length of segment : 1009 time for calcul the mask position with numpy : 0.0003552436828613281 nb_pixel_total : 8806 time to create 1 rle with old method : 0.010371685028076172 length of segment : 77 time for calcul the mask position with numpy : 0.00075531005859375 nb_pixel_total : 21265 time to create 1 rle with old method : 0.029827117919921875 length of segment : 152 time for calcul the mask position with numpy : 0.00035881996154785156 nb_pixel_total : 5708 time to create 1 rle with old method : 0.006730556488037109 length of segment : 88 time for calcul the mask position with numpy : 0.0027179718017578125 nb_pixel_total : 86186 time to create 1 rle with old method : 0.10265541076660156 length of segment : 499 time for calcul the mask position with numpy : 0.0021986961364746094 nb_pixel_total : 35057 time to create 1 rle with old method : 0.04101371765136719 length of segment : 252 time for calcul the mask position with numpy : 0.00032520294189453125 nb_pixel_total : 14242 time to create 1 rle with old method : 0.016733169555664062 length of segment : 210 time for calcul the mask position with numpy : 0.0005483627319335938 nb_pixel_total : 24976 time to create 1 rle with old method : 0.03910708427429199 length of segment : 128 time for calcul the mask position with numpy : 0.007955312728881836 nb_pixel_total : 370890 time to create 1 rle with new method : 0.04794645309448242 length of segment : 894 time for calcul the mask position with numpy : 0.0014986991882324219 nb_pixel_total : 79647 time to create 1 rle with old method : 0.10314798355102539 length of segment : 400 time for calcul the mask position with numpy : 0.0029251575469970703 nb_pixel_total : 205012 time to create 1 rle with new method : 0.009402036666870117 length of segment : 479 time for calcul the mask position with numpy : 0.0011217594146728516 nb_pixel_total : 50834 time to create 1 rle with old method : 0.06587934494018555 length of segment : 322 time for calcul the mask position with numpy : 0.0006206035614013672 nb_pixel_total : 35807 time to create 1 rle with old method : 0.039545536041259766 length of segment : 244 time for calcul the mask position with numpy : 0.0009522438049316406 nb_pixel_total : 60276 time to create 1 rle with old method : 0.06663060188293457 length of segment : 370 time spent for convertir_results : 17.63826894760132 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 156 chid ids of type : 3594 Number RLEs to save : 54714 save missing photos in datou_result : time spend for datou_step_exec : 118.24490141868591 time spend to save output : 3.1483259201049805 total time spend for step 1 : 121.3932273387909 step2:crop_condition Tue May 27 12:32:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 156 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 90 About to insert : list_path_to_insert length 90 new photo from crops ! About to upload 90 photos upload in portfolio : 3736932 init cache_photo without model_param we have 90 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748341973_193040 we have uploaded 90 photos in the portfolio 3736932 time of upload the photos Elapsed time : 35.406038761138916 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748342016_193040 we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.9648847579956055 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748342023_193040 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0025899410247803 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 3736932 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748342056_193040 we have uploaded 42 photos in the portfolio 3736932 time of upload the photos Elapsed time : 20.630030393600464 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748342080_193040 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2913200855255127 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748342085_193040 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8150973320007324 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361264160, 1361264156, 1361264152, 1361264147, 1361264144, 1361264141, 1361263883, 1361263872, 1361263868, 1361263838, 1361263835, 1361263831] Looping around the photos to save general results len do output : 156 /1361280958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361280999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361281888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264160', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264156', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264152', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264147', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264144', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264141', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263883', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263872', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263868', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263838', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263835', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263831', None, None, None, None, None, '2965961') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 480 time used for this insertion : 0.028553247451782227 save_final save missing photos in datou_result : time spend for datou_step_exec : 135.01950907707214 time spend to save output : 0.0327298641204834 total time spend for step 2 : 135.05223894119263 step3:rle_unique_nms_with_priority Tue May 27 12:34:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 156 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 11.23829174041748 time for calcul the mask position with numpy : 1.6675546169281006 nb_pixel_total : 6643731 time to create 1 rle with new method : 1.8940796852111816 time for calcul the mask position with numpy : 0.0250091552734375 nb_pixel_total : 62494 time to create 1 rle with old method : 0.08480405807495117 time for calcul the mask position with numpy : 0.03666043281555176 nb_pixel_total : 15055 time to create 1 rle with old method : 0.02756500244140625 time for calcul the mask position with numpy : 0.03590083122253418 nb_pixel_total : 128642 time to create 1 rle with old method : 0.14905667304992676 time for calcul the mask position with numpy : 0.027621746063232422 nb_pixel_total : 199356 time to create 1 rle with new method : 1.0228829383850098 time for calcul the mask position with numpy : 0.02966165542602539 nb_pixel_total : 696080 time to create 1 rle with new method : 1.4277284145355225 time for calcul the mask position with numpy : 0.024764299392700195 nb_pixel_total : 103739 time to create 1 rle with old method : 0.10946345329284668 time for calcul the mask position with numpy : 0.026050567626953125 nb_pixel_total : 154212 time to create 1 rle with new method : 1.5760412216186523 time for calcul the mask position with numpy : 0.024417638778686523 nb_pixel_total : 109895 time to create 1 rle with old method : 0.11871695518493652 time for calcul the mask position with numpy : 0.02569293975830078 nb_pixel_total : 181196 time to create 1 rle with new method : 1.4354867935180664 create new chi : 9.902854919433594 time to delete rle : 0.01924920082092285 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 12703 TO DO : save crop sub photo not yet done ! save time : 0.7765920162200928 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 5.0002241134643555 time for calcul the mask position with numpy : 1.1650090217590332 nb_pixel_total : 7697756 time to create 1 rle with new method : 1.2718744277954102 time for calcul the mask position with numpy : 0.023817777633666992 nb_pixel_total : 32658 time to create 1 rle with old method : 0.03384232521057129 time for calcul the mask position with numpy : 0.023352622985839844 nb_pixel_total : 36167 time to create 1 rle with old method : 0.036379098892211914 time for calcul the mask position with numpy : 0.023731470108032227 nb_pixel_total : 14231 time to create 1 rle with old method : 0.014884710311889648 time for calcul the mask position with numpy : 0.02493596076965332 nb_pixel_total : 225633 time to create 1 rle with new method : 1.2551939487457275 time for calcul the mask position with numpy : 0.024782657623291016 nb_pixel_total : 115103 time to create 1 rle with old method : 0.1204538345336914 time for calcul the mask position with numpy : 0.02442789077758789 nb_pixel_total : 73486 time to create 1 rle with old method : 0.07735967636108398 time for calcul the mask position with numpy : 0.024300813674926758 nb_pixel_total : 99366 time to create 1 rle with old method : 0.10121488571166992 create new chi : 4.308555841445923 time to delete rle : 0.0009584426879882812 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 7694 TO DO : save crop sub photo not yet done ! save time : 0.5121350288391113 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 12.67131233215332 time for calcul the mask position with numpy : 0.6603329181671143 nb_pixel_total : 7354875 time to create 1 rle with new method : 1.637817144393921 time for calcul the mask position with numpy : 0.04468369483947754 nb_pixel_total : 24296 time to create 1 rle with old method : 0.02781510353088379 time for calcul the mask position with numpy : 0.03466486930847168 nb_pixel_total : 24286 time to create 1 rle with old method : 0.02774834632873535 time for calcul the mask position with numpy : 0.026301860809326172 nb_pixel_total : 97571 time to create 1 rle with old method : 0.10973334312438965 time for calcul the mask position with numpy : 0.025185585021972656 nb_pixel_total : 26507 time to create 1 rle with old method : 0.030269384384155273 time for calcul the mask position with numpy : 0.025164127349853516 nb_pixel_total : 35081 time to create 1 rle with old method : 0.03881382942199707 time for calcul the mask position with numpy : 0.03149127960205078 nb_pixel_total : 42831 time to create 1 rle with old method : 0.05113506317138672 time for calcul the mask position with numpy : 0.03885006904602051 nb_pixel_total : 31150 time to create 1 rle with old method : 0.03571677207946777 time for calcul the mask position with numpy : 0.043096303939819336 nb_pixel_total : 262051 time to create 1 rle with new method : 0.8973593711853027 time for calcul the mask position with numpy : 0.03932332992553711 nb_pixel_total : 36965 time to create 1 rle with old method : 0.04150080680847168 time for calcul the mask position with numpy : 0.03975868225097656 nb_pixel_total : 8302 time to create 1 rle with old method : 0.009037494659423828 time for calcul the mask position with numpy : 0.04043412208557129 nb_pixel_total : 5456 time to create 1 rle with old method : 0.006263017654418945 time for calcul the mask position with numpy : 0.043868064880371094 nb_pixel_total : 75315 time to create 1 rle with old method : 0.08732366561889648 time for calcul the mask position with numpy : 0.045493125915527344 nb_pixel_total : 49240 time to create 1 rle with old method : 0.05538129806518555 time for calcul the mask position with numpy : 0.04630756378173828 nb_pixel_total : 2190 time to create 1 rle with old method : 0.0027093887329101562 time for calcul the mask position with numpy : 0.041931867599487305 nb_pixel_total : 46941 time to create 1 rle with old method : 0.05293464660644531 time for calcul the mask position with numpy : 0.041780948638916016 nb_pixel_total : 65596 time to create 1 rle with old method : 0.07296085357666016 time for calcul the mask position with numpy : 0.03983926773071289 nb_pixel_total : 49153 time to create 1 rle with old method : 0.05384016036987305 time for calcul the mask position with numpy : 0.03432297706604004 nb_pixel_total : 39334 time to create 1 rle with old method : 0.044191837310791016 time for calcul the mask position with numpy : 0.0278165340423584 nb_pixel_total : 17260 time to create 1 rle with old method : 0.023601770401000977 create new chi : 4.7527735233306885 time to delete rle : 0.0049016475677490234 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 12739 TO DO : save crop sub photo not yet done ! save time : 0.8095870018005371 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 9.989612817764282 time for calcul the mask position with numpy : 0.5753726959228516 nb_pixel_total : 6961766 time to create 1 rle with new method : 1.9463591575622559 time for calcul the mask position with numpy : 0.02848649024963379 nb_pixel_total : 11654 time to create 1 rle with old method : 0.012565851211547852 time for calcul the mask position with numpy : 0.02757549285888672 nb_pixel_total : 124644 time to create 1 rle with old method : 0.1385040283203125 time for calcul the mask position with numpy : 0.02676677703857422 nb_pixel_total : 140715 time to create 1 rle with old method : 0.16242575645446777 time for calcul the mask position with numpy : 0.0279083251953125 nb_pixel_total : 85437 time to create 1 rle with old method : 0.10380983352661133 time for calcul the mask position with numpy : 0.035776615142822266 nb_pixel_total : 97848 time to create 1 rle with old method : 0.10839319229125977 time for calcul the mask position with numpy : 0.04431343078613281 nb_pixel_total : 296262 time to create 1 rle with new method : 1.6207528114318848 time for calcul the mask position with numpy : 0.040223121643066406 nb_pixel_total : 87552 time to create 1 rle with old method : 0.09670591354370117 time for calcul the mask position with numpy : 0.04445052146911621 nb_pixel_total : 26966 time to create 1 rle with old method : 0.0299527645111084 time for calcul the mask position with numpy : 0.0406947135925293 nb_pixel_total : 79912 time to create 1 rle with old method : 0.11273550987243652 time for calcul the mask position with numpy : 0.04425978660583496 nb_pixel_total : 83090 time to create 1 rle with old method : 0.11028313636779785 time for calcul the mask position with numpy : 0.04062247276306152 nb_pixel_total : 27806 time to create 1 rle with old method : 0.031137466430664062 time for calcul the mask position with numpy : 0.02626776695251465 nb_pixel_total : 107510 time to create 1 rle with old method : 0.12365412712097168 time for calcul the mask position with numpy : 0.026486635208129883 nb_pixel_total : 44293 time to create 1 rle with old method : 0.049591779708862305 time for calcul the mask position with numpy : 0.02654099464416504 nb_pixel_total : 31756 time to create 1 rle with old method : 0.036089420318603516 time for calcul the mask position with numpy : 0.026079177856445312 nb_pixel_total : 87189 time to create 1 rle with old method : 0.09514498710632324 create new chi : 5.930283308029175 time to delete rle : 0.0020232200622558594 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 13076 TO DO : save crop sub photo not yet done ! save time : 0.8039684295654297 nb_obj : 16 nb_hashtags : 4 time to prepare the origin masks : 13.483644008636475 time for calcul the mask position with numpy : 1.2327370643615723 nb_pixel_total : 7335407 time to create 1 rle with new method : 1.0314390659332275 time for calcul the mask position with numpy : 0.0425262451171875 nb_pixel_total : 60849 time to create 1 rle with old method : 0.06813931465148926 time for calcul the mask position with numpy : 0.04288339614868164 nb_pixel_total : 26544 time to create 1 rle with old method : 0.029912471771240234 time for calcul the mask position with numpy : 0.04114556312561035 nb_pixel_total : 39799 time to create 1 rle with old method : 0.04452991485595703 time for calcul the mask position with numpy : 0.04143977165222168 nb_pixel_total : 75403 time to create 1 rle with old method : 0.08416008949279785 time for calcul the mask position with numpy : 0.049759864807128906 nb_pixel_total : 34679 time to create 1 rle with old method : 0.03883028030395508 time for calcul the mask position with numpy : 0.04116249084472656 nb_pixel_total : 129622 time to create 1 rle with old method : 0.14381909370422363 time for calcul the mask position with numpy : 0.04237008094787598 nb_pixel_total : 195599 time to create 1 rle with new method : 1.7254164218902588 time for calcul the mask position with numpy : 0.042394399642944336 nb_pixel_total : 12769 time to create 1 rle with old method : 0.014465093612670898 time for calcul the mask position with numpy : 0.04742717742919922 nb_pixel_total : 63802 time to create 1 rle with old method : 0.07143664360046387 time for calcul the mask position with numpy : 0.04363441467285156 nb_pixel_total : 50917 time to create 1 rle with old method : 0.08060121536254883 time for calcul the mask position with numpy : 0.04263734817504883 nb_pixel_total : 69239 time to create 1 rle with old method : 0.07707834243774414 time for calcul the mask position with numpy : 0.0477902889251709 nb_pixel_total : 19230 time to create 1 rle with old method : 0.021453380584716797 time for calcul the mask position with numpy : 0.042092323303222656 nb_pixel_total : 37582 time to create 1 rle with old method : 0.04131054878234863 time for calcul the mask position with numpy : 0.04074454307556152 nb_pixel_total : 75498 time to create 1 rle with old method : 0.08215951919555664 time for calcul the mask position with numpy : 0.03997468948364258 nb_pixel_total : 39518 time to create 1 rle with old method : 0.043680429458618164 time for calcul the mask position with numpy : 0.039415836334228516 nb_pixel_total : 27943 time to create 1 rle with old method : 0.030139684677124023 create new chi : 5.626651287078857 time to delete rle : 0.002064943313598633 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 12854 TO DO : save crop sub photo not yet done ! save time : 0.7837238311767578 nb_obj : 16 nb_hashtags : 5 time to prepare the origin masks : 13.998615741729736 time for calcul the mask position with numpy : 0.9882311820983887 nb_pixel_total : 7206839 time to create 1 rle with new method : 1.3527588844299316 time for calcul the mask position with numpy : 0.0444338321685791 nb_pixel_total : 114941 time to create 1 rle with old method : 0.12891340255737305 time for calcul the mask position with numpy : 0.043871402740478516 nb_pixel_total : 147878 time to create 1 rle with old method : 0.16358590126037598 time for calcul the mask position with numpy : 0.041322946548461914 nb_pixel_total : 101440 time to create 1 rle with old method : 0.11443591117858887 time for calcul the mask position with numpy : 0.04200005531311035 nb_pixel_total : 46039 time to create 1 rle with old method : 0.060164690017700195 time for calcul the mask position with numpy : 0.06342315673828125 nb_pixel_total : 185837 time to create 1 rle with new method : 1.2253921031951904 time for calcul the mask position with numpy : 0.040532827377319336 nb_pixel_total : 31049 time to create 1 rle with old method : 0.03525137901306152 time for calcul the mask position with numpy : 0.04575514793395996 nb_pixel_total : 30643 time to create 1 rle with old method : 0.03478693962097168 time for calcul the mask position with numpy : 0.0429539680480957 nb_pixel_total : 59414 time to create 1 rle with old method : 0.06635689735412598 time for calcul the mask position with numpy : 0.03957486152648926 nb_pixel_total : 130760 time to create 1 rle with old method : 0.14835810661315918 time for calcul the mask position with numpy : 0.04464983940124512 nb_pixel_total : 11043 time to create 1 rle with old method : 0.012570858001708984 time for calcul the mask position with numpy : 0.04113483428955078 nb_pixel_total : 40953 time to create 1 rle with old method : 0.04634237289428711 time for calcul the mask position with numpy : 0.04036378860473633 nb_pixel_total : 34399 time to create 1 rle with old method : 0.04126882553100586 time for calcul the mask position with numpy : 0.03921818733215332 nb_pixel_total : 14643 time to create 1 rle with old method : 0.01664113998413086 time for calcul the mask position with numpy : 0.04041552543640137 nb_pixel_total : 76426 time to create 1 rle with old method : 0.0856180191040039 time for calcul the mask position with numpy : 0.040400028228759766 nb_pixel_total : 7479 time to create 1 rle with old method : 0.008622884750366211 time for calcul the mask position with numpy : 0.04234433174133301 nb_pixel_total : 54617 time to create 1 rle with old method : 0.06079697608947754 create new chi : 5.442956447601318 time to delete rle : 0.0027005672454833984 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 13106 TO DO : save crop sub photo not yet done ! save time : 0.8188638687133789 nb_obj : 19 nb_hashtags : 2 time to prepare the origin masks : 12.25027060508728 time for calcul the mask position with numpy : 0.9084274768829346 nb_pixel_total : 6339603 time to create 1 rle with new method : 1.3305096626281738 time for calcul the mask position with numpy : 0.043641090393066406 nb_pixel_total : 32337 time to create 1 rle with old method : 0.03665018081665039 time for calcul the mask position with numpy : 0.042313575744628906 nb_pixel_total : 33983 time to create 1 rle with old method : 0.037665605545043945 time for calcul the mask position with numpy : 0.04085850715637207 nb_pixel_total : 11426 time to create 1 rle with old method : 0.012806892395019531 time for calcul the mask position with numpy : 0.04173731803894043 nb_pixel_total : 194226 time to create 1 rle with new method : 1.2393958568572998 time for calcul the mask position with numpy : 0.04640603065490723 nb_pixel_total : 589005 time to create 1 rle with new method : 0.8688921928405762 time for calcul the mask position with numpy : 0.04462456703186035 nb_pixel_total : 191979 time to create 1 rle with new method : 2.419440746307373 time for calcul the mask position with numpy : 0.04293107986450195 nb_pixel_total : 21849 time to create 1 rle with old method : 0.02474069595336914 time for calcul the mask position with numpy : 0.040843963623046875 nb_pixel_total : 5193 time to create 1 rle with old method : 0.005650758743286133 time for calcul the mask position with numpy : 0.04111051559448242 nb_pixel_total : 13800 time to create 1 rle with old method : 0.015195131301879883 time for calcul the mask position with numpy : 0.0401911735534668 nb_pixel_total : 57974 time to create 1 rle with old method : 0.06378722190856934 time for calcul the mask position with numpy : 0.04368281364440918 nb_pixel_total : 65964 time to create 1 rle with old method : 0.07359766960144043 time for calcul the mask position with numpy : 0.04335761070251465 nb_pixel_total : 151867 time to create 1 rle with new method : 1.0933780670166016 time for calcul the mask position with numpy : 0.038368940353393555 nb_pixel_total : 111084 time to create 1 rle with old method : 0.12076973915100098 time for calcul the mask position with numpy : 0.038054704666137695 nb_pixel_total : 57977 time to create 1 rle with old method : 0.06190919876098633 time for calcul the mask position with numpy : 0.03741192817687988 nb_pixel_total : 80544 time to create 1 rle with old method : 0.09073615074157715 time for calcul the mask position with numpy : 0.04425954818725586 nb_pixel_total : 128572 time to create 1 rle with old method : 0.14194202423095703 time for calcul the mask position with numpy : 0.03826093673706055 nb_pixel_total : 56617 time to create 1 rle with old method : 0.06308865547180176 time for calcul the mask position with numpy : 0.03653144836425781 nb_pixel_total : 11917 time to create 1 rle with old method : 0.013653039932250977 time for calcul the mask position with numpy : 0.036820173263549805 nb_pixel_total : 138483 time to create 1 rle with old method : 0.14986848831176758 create new chi : 9.717759132385254 time to delete rle : 0.0039865970611572266 batch 1 Loaded 40 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 16361 TO DO : save crop sub photo not yet done ! save time : 0.9850895404815674 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 14.725564241409302 time for calcul the mask position with numpy : 1.8314878940582275 nb_pixel_total : 7759262 time to create 1 rle with new method : 1.7506706714630127 time for calcul the mask position with numpy : 0.03512001037597656 nb_pixel_total : 11318 time to create 1 rle with old method : 0.012650489807128906 time for calcul the mask position with numpy : 0.024366140365600586 nb_pixel_total : 11738 time to create 1 rle with old method : 0.013195037841796875 time for calcul the mask position with numpy : 0.025005102157592773 nb_pixel_total : 88452 time to create 1 rle with old method : 0.09745383262634277 time for calcul the mask position with numpy : 0.026002168655395508 nb_pixel_total : 17070 time to create 1 rle with old method : 0.019176959991455078 time for calcul the mask position with numpy : 0.025979995727539062 nb_pixel_total : 43984 time to create 1 rle with old method : 0.04739069938659668 time for calcul the mask position with numpy : 0.023449182510375977 nb_pixel_total : 14719 time to create 1 rle with old method : 0.01557612419128418 time for calcul the mask position with numpy : 0.023663997650146484 nb_pixel_total : 23495 time to create 1 rle with old method : 0.024619579315185547 time for calcul the mask position with numpy : 0.023607492446899414 nb_pixel_total : 30939 time to create 1 rle with old method : 0.03293323516845703 time for calcul the mask position with numpy : 0.023675203323364258 nb_pixel_total : 16374 time to create 1 rle with old method : 0.01731085777282715 time for calcul the mask position with numpy : 0.031171321868896484 nb_pixel_total : 49807 time to create 1 rle with old method : 0.05396556854248047 time for calcul the mask position with numpy : 0.04107975959777832 nb_pixel_total : 26226 time to create 1 rle with old method : 0.04323744773864746 time for calcul the mask position with numpy : 0.04526257514953613 nb_pixel_total : 150807 time to create 1 rle with new method : 2.8330130577087402 time for calcul the mask position with numpy : 0.0408015251159668 nb_pixel_total : 13737 time to create 1 rle with old method : 0.015571117401123047 time for calcul the mask position with numpy : 0.03397226333618164 nb_pixel_total : 36472 time to create 1 rle with old method : 0.04358029365539551 create new chi : 7.345151662826538 time to delete rle : 0.0016627311706542969 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 9452 TO DO : save crop sub photo not yet done ! save time : 0.5989632606506348 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 10.507693767547607 time for calcul the mask position with numpy : 0.9382336139678955 nb_pixel_total : 7284994 time to create 1 rle with new method : 1.7361359596252441 time for calcul the mask position with numpy : 0.041544437408447266 nb_pixel_total : 52217 time to create 1 rle with old method : 0.057970523834228516 time for calcul the mask position with numpy : 0.04052162170410156 nb_pixel_total : 16789 time to create 1 rle with old method : 0.018201589584350586 time for calcul the mask position with numpy : 0.042388200759887695 nb_pixel_total : 121577 time to create 1 rle with old method : 0.1317603588104248 time for calcul the mask position with numpy : 0.040711402893066406 nb_pixel_total : 98776 time to create 1 rle with old method : 0.1187446117401123 time for calcul the mask position with numpy : 0.04599404335021973 nb_pixel_total : 95464 time to create 1 rle with old method : 0.11113333702087402 time for calcul the mask position with numpy : 0.04055905342102051 nb_pixel_total : 95917 time to create 1 rle with old method : 0.1056830883026123 time for calcul the mask position with numpy : 0.04288005828857422 nb_pixel_total : 22713 time to create 1 rle with old method : 0.025618791580200195 time for calcul the mask position with numpy : 0.038257598876953125 nb_pixel_total : 63030 time to create 1 rle with old method : 0.07038736343383789 time for calcul the mask position with numpy : 0.03671622276306152 nb_pixel_total : 22293 time to create 1 rle with old method : 0.02449655532836914 time for calcul the mask position with numpy : 0.03923225402832031 nb_pixel_total : 95209 time to create 1 rle with old method : 0.10367751121520996 time for calcul the mask position with numpy : 0.038632869720458984 nb_pixel_total : 44413 time to create 1 rle with old method : 0.050394535064697266 time for calcul the mask position with numpy : 0.04668545722961426 nb_pixel_total : 8894 time to create 1 rle with old method : 0.010198593139648438 time for calcul the mask position with numpy : 0.04379892349243164 nb_pixel_total : 21549 time to create 1 rle with old method : 0.025565147399902344 time for calcul the mask position with numpy : 0.04359316825866699 nb_pixel_total : 250565 time to create 1 rle with new method : 1.800795316696167 create new chi : 5.983981609344482 time to delete rle : 0.0019702911376953125 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 11877 TO DO : save crop sub photo not yet done ! save time : 0.7361791133880615 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 5.624953508377075 time for calcul the mask position with numpy : 0.8844606876373291 nb_pixel_total : 7851919 time to create 1 rle with new method : 1.1621460914611816 time for calcul the mask position with numpy : 0.0254361629486084 nb_pixel_total : 19730 time to create 1 rle with old method : 0.02222442626953125 time for calcul the mask position with numpy : 0.02788257598876953 nb_pixel_total : 77493 time to create 1 rle with old method : 0.08615851402282715 time for calcul the mask position with numpy : 0.024748563766479492 nb_pixel_total : 81779 time to create 1 rle with old method : 0.08977246284484863 time for calcul the mask position with numpy : 0.025263547897338867 nb_pixel_total : 15825 time to create 1 rle with old method : 0.018889904022216797 time for calcul the mask position with numpy : 0.029978036880493164 nb_pixel_total : 194819 time to create 1 rle with new method : 0.5099470615386963 time for calcul the mask position with numpy : 0.026261329650878906 nb_pixel_total : 18051 time to create 1 rle with old method : 0.022267818450927734 time for calcul the mask position with numpy : 0.028046846389770508 nb_pixel_total : 34784 time to create 1 rle with old method : 0.03893399238586426 create new chi : 3.1055893898010254 time to delete rle : 0.0013039112091064453 batch 1 Loaded 15 chid ids of type : 3594 +++++++++++Number RLEs to save : 6844 TO DO : save crop sub photo not yet done ! save time : 0.441530704498291 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 8.833651065826416 time for calcul the mask position with numpy : 0.4072885513305664 nb_pixel_total : 7792329 time to create 1 rle with new method : 2.420417308807373 time for calcul the mask position with numpy : 0.024636030197143555 nb_pixel_total : 35057 time to create 1 rle with old method : 0.04018688201904297 time for calcul the mask position with numpy : 0.025243043899536133 nb_pixel_total : 86073 time to create 1 rle with old method : 0.09432244300842285 time for calcul the mask position with numpy : 0.02381443977355957 nb_pixel_total : 5708 time to create 1 rle with old method : 0.0063359737396240234 time for calcul the mask position with numpy : 0.024582624435424805 nb_pixel_total : 21265 time to create 1 rle with old method : 0.02344822883605957 time for calcul the mask position with numpy : 0.025278091430664062 nb_pixel_total : 8806 time to create 1 rle with old method : 0.009440422058105469 time for calcul the mask position with numpy : 0.024858474731445312 nb_pixel_total : 41690 time to create 1 rle with old method : 0.04380941390991211 time for calcul the mask position with numpy : 0.023967266082763672 nb_pixel_total : 14037 time to create 1 rle with old method : 0.015327692031860352 time for calcul the mask position with numpy : 0.025194406509399414 nb_pixel_total : 118575 time to create 1 rle with old method : 0.1275310516357422 time for calcul the mask position with numpy : 0.024939537048339844 nb_pixel_total : 112657 time to create 1 rle with old method : 0.12094426155090332 time for calcul the mask position with numpy : 0.024794578552246094 nb_pixel_total : 32322 time to create 1 rle with old method : 0.03513526916503906 time for calcul the mask position with numpy : 0.02521514892578125 nb_pixel_total : 25881 time to create 1 rle with old method : 0.028043270111083984 create new chi : 3.689272165298462 time to delete rle : 0.0014903545379638672 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 9144 TO DO : save crop sub photo not yet done ! save time : 0.5748040676116943 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 9.19862174987793 time for calcul the mask position with numpy : 1.6000349521636963 nb_pixel_total : 7460304 time to create 1 rle with new method : 1.2511773109436035 time for calcul the mask position with numpy : 0.04113030433654785 nb_pixel_total : 52688 time to create 1 rle with old method : 0.05893135070800781 time for calcul the mask position with numpy : 0.04189324378967285 nb_pixel_total : 35807 time to create 1 rle with old method : 0.04019808769226074 time for calcul the mask position with numpy : 0.04128074645996094 nb_pixel_total : 50834 time to create 1 rle with old method : 0.0565183162689209 time for calcul the mask position with numpy : 0.04264354705810547 nb_pixel_total : 205012 time to create 1 rle with new method : 0.8792359828948975 time for calcul the mask position with numpy : 0.04789423942565918 nb_pixel_total : 79647 time to create 1 rle with old method : 0.08905363082885742 time for calcul the mask position with numpy : 0.046338558197021484 nb_pixel_total : 370890 time to create 1 rle with new method : 1.779195785522461 time for calcul the mask position with numpy : 0.04210305213928223 nb_pixel_total : 24976 time to create 1 rle with old method : 0.02590799331665039 time for calcul the mask position with numpy : 0.03929901123046875 nb_pixel_total : 14242 time to create 1 rle with old method : 0.01740407943725586 create new chi : 6.244477987289429 time to delete rle : 0.0018656253814697266 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 7986 TO DO : save crop sub photo not yet done ! save time : 0.5461556911468506 map_output_result : {1361264160: (0.0, 'Should be the crop_list due to order', 0), 1361264156: (0.0, 'Should be the crop_list due to order', 0), 1361264152: (0.0, 'Should be the crop_list due to order', 0), 1361264147: (0.0, 'Should be the crop_list due to order', 0), 1361264144: (0.0, 'Should be the crop_list due to order', 0), 1361264141: (0.0, 'Should be the crop_list due to order', 0), 1361263883: (0.0, 'Should be the crop_list due to order', 0), 1361263872: (0.0, 'Should be the crop_list due to order', 0), 1361263868: (0.0, 'Should be the crop_list due to order', 0), 1361263838: (0.0, 'Should be the crop_list due to order', 0), 1361263835: (0.0, 'Should be the crop_list due to order', 0), 1361263831: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361264160, 1361264156, 1361264152, 1361264147, 1361264144, 1361264141, 1361263883, 1361263872, 1361263868, 1361263838, 1361263835, 1361263831] Looping around the photos to save general results len do output : 12 /1361264160.Didn't retrieve data . /1361264156.Didn't retrieve data . /1361264152.Didn't retrieve data . /1361264147.Didn't retrieve data . /1361264144.Didn't retrieve data . /1361264141.Didn't retrieve data . /1361263883.Didn't retrieve data . /1361263872.Didn't retrieve data . /1361263868.Didn't retrieve data . /1361263838.Didn't retrieve data . /1361263835.Didn't retrieve data . /1361263831.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264160', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264156', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264152', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264147', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264144', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264141', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263883', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263872', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263868', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263838', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263835', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263831', None, None, None, None, None, '2965961') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.015997648239135742 save_final save missing photos in datou_result : time spend for datou_step_exec : 209.62799215316772 time spend to save output : 0.01653289794921875 total time spend for step 3 : 209.64452505111694 step4:ventilate_hashtags_in_portfolio Tue May 27 12:38:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23375432 get user id for portfolio 23375432 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23375432 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','autre','flou','metal','pehd','mal_croppe','papier','environnement','carton','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23375432 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','autre','flou','metal','pehd','mal_croppe','papier','environnement','carton','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23375432 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','autre','flou','metal','pehd','mal_croppe','papier','environnement','carton','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23376203,23376204,23376205,23376206,23376207,23376208,23376209,23376210,23376211,23376212,23376213?tags=pet_fonce,background,autre,flou,metal,pehd,mal_croppe,papier,environnement,carton,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361264160, 1361264156, 1361264152, 1361264147, 1361264144, 1361264141, 1361263883, 1361263872, 1361263868, 1361263838, 1361263835, 1361263831] Looping around the photos to save general results len do output : 1 /23375432. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264160', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264156', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264152', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264147', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264144', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264141', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263883', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263872', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263868', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263838', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263835', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263831', None, None, None, None, None, '2965961') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.015271425247192383 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.8146100044250488 time spend to save output : 0.015621662139892578 total time spend for step 4 : 1.8302316665649414 step5:final Tue May 27 12:38:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361264160: ('0.11899609977816361',), 1361264156: ('0.11899609977816361',), 1361264152: ('0.11899609977816361',), 1361264147: ('0.11899609977816361',), 1361264144: ('0.11899609977816361',), 1361264141: ('0.11899609977816361',), 1361263883: ('0.11899609977816361',), 1361263872: ('0.11899609977816361',), 1361263868: ('0.11899609977816361',), 1361263838: ('0.11899609977816361',), 1361263835: ('0.11899609977816361',), 1361263831: ('0.11899609977816361',)} new output for save of step final : {1361264160: ('0.11899609977816361',), 1361264156: ('0.11899609977816361',), 1361264152: ('0.11899609977816361',), 1361264147: ('0.11899609977816361',), 1361264144: ('0.11899609977816361',), 1361264141: ('0.11899609977816361',), 1361263883: ('0.11899609977816361',), 1361263872: ('0.11899609977816361',), 1361263868: ('0.11899609977816361',), 1361263838: ('0.11899609977816361',), 1361263835: ('0.11899609977816361',), 1361263831: ('0.11899609977816361',)} [1361264160, 1361264156, 1361264152, 1361264147, 1361264144, 1361264141, 1361263883, 1361263872, 1361263868, 1361263838, 1361263835, 1361263831] Looping around the photos to save general results len do output : 12 /1361264160.Didn't retrieve data . /1361264156.Didn't retrieve data . /1361264152.Didn't retrieve data . /1361264147.Didn't retrieve data . /1361264144.Didn't retrieve data . /1361264141.Didn't retrieve data . /1361263883.Didn't retrieve data . /1361263872.Didn't retrieve data . /1361263868.Didn't retrieve data . /1361263838.Didn't retrieve data . /1361263835.Didn't retrieve data . /1361263831.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264160', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264156', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264152', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264147', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264144', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264141', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263883', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263872', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263868', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263838', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263835', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263831', None, None, None, None, None, '2965961') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.017388343811035156 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11277627944946289 time spend to save output : 0.018088340759277344 total time spend for step 5 : 0.13086462020874023 step6:blur_detection Tue May 27 12:38:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb.jpg resize: (2160, 3840) 1361264160 -5.63068740846313 treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde.jpg resize: (2160, 3840) 1361264156 -5.743326924517814 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a.jpg resize: (2160, 3840) 1361264152 -5.8254165468789285 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a.jpg resize: (2160, 3840) 1361264147 -5.846795575147671 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be.jpg resize: (2160, 3840) 1361264144 -5.734649247561144 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7.jpg resize: (2160, 3840) 1361264141 -5.685073500830008 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051.jpg resize: (2160, 3840) 1361263883 -5.889909373922303 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b.jpg resize: (2160, 3840) 1361263872 -5.721455310724083 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94.jpg resize: (2160, 3840) 1361263868 -5.867929224218872 treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73.jpg resize: (2160, 3840) 1361263838 -5.772379991575636 treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949.jpg resize: (2160, 3840) 1361263835 -5.951221903522676 treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da.jpg resize: (2160, 3840) 1361263831 -5.799500363044701 treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036073_0.png resize: (522, 272) 1361280958 -4.4772827269001185 treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036074_0.png resize: (116, 140) 1361280960 -3.1433239750524824 treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036076_0.png resize: (591, 317) 1361280961 -3.437214635543524 treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036077_0.png resize: (363, 339) 1361280963 -2.114477662584234 treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036078_0.png resize: (618, 233) 1361280965 -2.0906023458011256 treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036080_0.png resize: (144, 156) 1361280966 1.0081698219885544 treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036081_0.png resize: (240, 205) 1361280967 -4.393461626237152 treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036082_0.png resize: (206, 265) 1361280969 -1.6505180425927197 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036083_0.png resize: (205, 130) 1361280971 -2.024620527291348 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036084_0.png resize: (279, 335) 1361280973 -1.5164375093768032 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036088_0.png resize: (133, 140) 1361280975 -2.111886352232823 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036091_0.png resize: (107, 102) 1361280977 -3.3827049817702357 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036092_0.png resize: (91, 149) 1361280978 -3.7550864212182886 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036095_0.png resize: (326, 128) 1361280979 -3.7043775191269743 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036096_0.png resize: (398, 155) 1361280982 -4.133091297381252 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036097_0.png resize: (221, 256) 1361280983 -2.507587696944006 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036100_0.png resize: (392, 368) 1361280984 -3.179398310081369 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036101_0.png resize: (220, 219) 1361280986 -3.7358224659257817 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036103_0.png resize: (167, 222) 1361280988 2.368280598378042 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036104_0.png resize: (283, 230) 1361280989 -2.3502710562617413 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036106_0.png resize: (168, 292) 1361280991 -2.885548712059112 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036108_0.png resize: (320, 334) 1361280993 -3.287724420562862 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036109_0.png resize: (385, 112) 1361280994 -3.4536916217895084 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036112_0.png resize: (500, 309) 1361280995 -3.6702882434632573 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036116_0.png resize: (186, 88) 1361280998 -4.231426183645706 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036117_0.png resize: (242, 224) 1361280999 -1.3288507203928424 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036118_0.png resize: (226, 236) 1361281000 -2.7516531267224 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036119_0.png resize: (292, 333) 1361281003 -2.4917593807776375 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036120_0.png resize: (287, 206) 1361281004 -3.264892371279942 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036121_0.png resize: (207, 116) 1361281005 -1.7481442113253816 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036123_0.png resize: (241, 267) 1361281007 -4.115003831501361 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036124_0.png resize: (417, 217) 1361281009 -3.2711465219931046 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036125_0.png resize: (179, 123) 1361281010 -3.879674307447114 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036131_0.png resize: (235, 182) 1361281011 -3.9960250272973674 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036134_0.png resize: (99, 122) 1361281014 -3.0194218865440785 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036137_0.png resize: (239, 195) 1361281015 -3.1676999826020613 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036138_0.png resize: (239, 252) 1361281016 -0.9983927108017113 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036139_0.png resize: (111, 143) 1361281019 -4.22548671895459 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036141_0.png resize: (459, 190) 1361281020 -3.635759272339109 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036142_0.png resize: (367, 126) 1361281021 -3.9944691483785855 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036144_0.png resize: (425, 798) 1361281023 -3.9960376226575547 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036147_0.png resize: (367, 518) 1361281025 -3.705242048386217 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036149_0.png resize: (443, 403) 1361281026 -3.990586693853703 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036150_0.png resize: (93, 182) 1361281027 -4.861064633770458 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036151_0.png resize: (362, 293) 1361281030 -3.0054042229046503 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036154_0.png resize: (363, 246) 1361281031 -3.653601025436322 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036155_0.png resize: (571, 317) 1361281032 -3.9981720102581515 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036157_0.png resize: (323, 267) 1361281035 -4.352345541688661 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036158_0.png resize: (480, 164) 1361281036 -3.1250583822478517 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036159_0.png resize: (188, 120) 1361281037 -1.9946898334573195 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036160_0.png resize: (59, 110) 1361281039 -2.433031363583709 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036161_0.png resize: (158, 278) 1361281041 -2.909654959736358 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036162_0.png resize: (490, 504) 1361281042 -4.603539278384594 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036165_0.png resize: (87, 58) 1361281044 -3.9939543763345835 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036166_0.png resize: (191, 76) 1361281047 -2.7930412462961853 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036167_0.png resize: (219, 220) 1361281048 -2.8713814635345036 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036168_0.png resize: (224, 227) 1361281049 -2.552240390165572 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036170_0.png resize: (204, 89) 1361281051 3.037129944653724 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036172_0.png resize: (228, 199) 1361281053 -3.314149554717907 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036174_0.png resize: (143, 182) 1361281054 -2.9950619031169143 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036176_0.png resize: (193, 190) 1361281056 -2.5268979911890552 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036179_0.png resize: (195, 137) 1361281058 -4.235745075405689 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036181_0.png resize: (124, 174) 1361281059 -3.494225012380158 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036182_0.png resize: (120, 149) 1361281060 -3.0632443120386412 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036183_0.png resize: (523, 606) 1361281063 -1.4294219270147237 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036184_0.png resize: (177, 271) 1361281064 -1.9551571352887518 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036185_0.png resize: (130, 167) 1361281065 -3.8038788072248884 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036186_0.png resize: (283, 215) 1361281067 -3.980309947126013 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036187_0.png resize: (439, 301) 1361281069 -4.077968797414928 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036188_0.png resize: (229, 151) 1361281070 -3.7600167956014774 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036190_0.png resize: (185, 194) 1361281072 -4.594068410746466 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036193_0.png resize: (450, 294) 1361281074 -2.3001048141037126 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036195_0.png resize: (201, 113) 1361281075 -4.112850355111037 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036196_0.png resize: (290, 359) 1361281077 -1.882787712499726 treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036197_0.png resize: (230, 256) 1361281079 -2.8522129440857382 treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036198_0.png resize: (231, 152) 1361281080 -2.423230145874325 treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036200_0.png resize: (136, 165) 1361281081 -1.814677107027531 treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036202_0.png resize: (498, 236) 1361281083 -3.252239843938286 treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036204_0.png resize: (217, 202) 1361281085 -1.5033960037465564 treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036205_0.png resize: (186, 242) 1361281086 -2.3205726653750127 treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036207_0.png resize: (441, 439) 1361281088 -3.821830892559603 treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036208_0.png resize: (125, 171) 1361281090 -3.4383966384921805 treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036209_0.png resize: (512, 130) 1361281091 -3.636631938511251 treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036210_0.png resize: (77, 167) 1361281093 -3.935005149450184 treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036211_0.png resize: (148, 209) 1361281095 -2.2632551226559703 treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036213_0.png resize: (440, 263) 1361281096 -3.8216451309964006 treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036214_0.png resize: (204, 295) 1361281097 -2.982284841963317 treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036215_0.png resize: (210, 102) 1361281099 -2.9098330596272644 treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036216_0.png resize: (96, 334) 1361281101 -3.806813684621558 treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036221_0.png resize: (244, 233) 1361281102 -3.5041706792058944 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036089_0.png resize: (209, 366) 1361281284 -4.335688152385897 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036099_0.png resize: (350, 334) 1361281285 -4.529815297402879 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036105_0.png resize: (310, 463) 1361281287 -4.523831177749133 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036110_0.png resize: (370, 336) 1361281290 -4.837779385610267 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036127_0.png resize: (553, 444) 1361281292 -2.234451165505461 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036136_0.png resize: (190, 93) 1361281294 -3.9408954164003727 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036169_0.png resize: (330, 152) 1361281295 -3.9887552178181034 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036173_0.png resize: (262, 229) 1361281298 -3.268109206870869 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036175_0.png resize: (230, 172) 1361281299 -3.6636234427040177 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036178_0.png resize: (261, 249) 1361281301 -3.728781138204609 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036194_0.png resize: (532, 322) 1361281304 -3.766566274801826 treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036199_0.png resize: (591, 395) 1361281305 -3.4047079765135586 treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036203_0.png resize: (199, 236) 1361281307 -2.66534035964813 treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036212_0.png resize: (88, 79) 1361281308 -1.4813576426803774 treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036220_0.png resize: (322, 259) 1361281311 -4.344674004832961 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036129_0.png resize: (425, 202) 1361281397 -4.235092283760616 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036130_0.png resize: (214, 238) 1361281398 -4.5566031435764485 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036177_0.png resize: (138, 149) 1361281399 -3.1854910950844144 treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036067_0.png resize: (407, 652) 1361281773 -4.962051257122859 treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036068_0.png resize: (333, 573) 1361281774 -3.6358391991831573 treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036069_0.png resize: (312, 861) 1361281775 -4.926359299107765 treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036070_0.png resize: (435, 330) 1361281776 -4.471309451777023 treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036071_0.png resize: (1410, 895) 1361281778 -4.861349021446621 treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036072_0.png resize: (502, 576) 1361281780 -4.48548861743326 treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036075_0.png resize: (404, 207) 1361281781 -5.029054853085096 treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036079_0.png resize: (578, 522) 1361281782 -3.796050144411885 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036086_0.png resize: (297, 335) 1361281783 -3.940791676567194 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036087_0.png resize: (256, 312) 1361281784 -4.053000582169797 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036093_0.png resize: (198, 232) 1361281785 -3.097658714838969 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036094_0.png resize: (636, 568) 1361281786 -4.338756133618498 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036102_0.png resize: (285, 373) 1361281787 -4.374132564435033 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036107_0.png resize: (372, 283) 1361281788 -3.9018237887326768 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036111_0.png resize: (774, 488) 1361281789 -5.284873552321273 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036113_0.png resize: (458, 224) 1361281790 -4.922857428310194 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036114_0.png resize: (421, 443) 1361281791 -3.9812703337659006 treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036115_0.png resize: (332, 860) 1361281792 -2.8883879800654078 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036122_0.png resize: (266, 338) 1361281793 -3.1868980715197037 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036126_0.png resize: (527, 492) 1361281794 -4.458483927462589 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036128_0.png resize: (213, 221) 1361281795 -4.457832756517671 treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036132_0.png resize: (407, 449) 1361281796 -3.2524010996396773 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036133_0.png resize: (305, 258) 1361281797 -4.653460915398354 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036135_0.png resize: (279, 372) 1361281798 -4.179621818008359 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036140_0.png resize: (452, 454) 1361281799 -4.122015964251118 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036146_0.png resize: (444, 397) 1361281800 -1.985150350220223 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036148_0.png resize: (531, 502) 1361281801 -3.2501129416629797 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036152_0.png resize: (572, 461) 1361281802 -4.4676258745807935 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036153_0.png resize: (294, 426) 1361281803 -3.060665241962493 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036156_0.png resize: (449, 430) 1361281804 -5.114379927411643 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036163_0.png resize: (787, 1213) 1361281805 -3.9433641101285706 treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036164_0.png resize: (361, 721) 1361281806 -4.855047265309966 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036171_0.png resize: (605, 396) 1361281807 -4.6410543492910605 treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036180_0.png resize: (534, 217) 1361281808 -2.9611254423638567 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036189_0.png resize: (391, 239) 1361281809 -4.2943649312058305 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036191_0.png resize: (374, 480) 1361281810 -3.9911074819543413 treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036192_0.png resize: (338, 371) 1361281811 -4.592244085396144 treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036201_0.png resize: (266, 441) 1361281812 -4.327051207434732 treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036217_0.png resize: (893, 757) 1361281813 -3.855838170129509 treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036218_0.png resize: (398, 247) 1361281814 -3.286578711442035 treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036219_0.png resize: (416, 818) 1361281815 -4.0027777727182245 treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036222_0.png resize: (365, 293) 1361281816 -4.211397881609427 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036085_0.png resize: (199, 331) 1361281850 -2.4443133274343705 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036090_0.png resize: (406, 258) 1361281851 -2.960072152425586 treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036098_0.png resize: (203, 165) 1361281852 -4.1971337646881235 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036143_0.png resize: (233, 208) 1361281854 -4.346008747589751 treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036145_0.png resize: (267, 197) 1361281886 -3.567449962400434 treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036206_0.png resize: (398, 397) 1361281888 -3.6435343347723324 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 168 time used for this insertion : 0.02029561996459961 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 168 time used for this insertion : 0.03219008445739746 save missing photos in datou_result : time spend for datou_step_exec : 56.829195737838745 time spend to save output : 0.05754542350769043 total time spend for step 6 : 56.886741161346436 step7:brightness Tue May 27 12:39:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb.jpg treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde.jpg treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a.jpg treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a.jpg treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be.jpg treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7.jpg treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051.jpg treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b.jpg treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94.jpg treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73.jpg treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949.jpg treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da.jpg treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036073_0.png treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036074_0.png treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036076_0.png treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036077_0.png treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036078_0.png treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036080_0.png treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036081_0.png treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036082_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036083_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036084_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036088_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036091_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036092_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036095_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036096_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036097_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036100_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036101_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036103_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036104_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036106_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036108_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036109_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036112_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036116_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036117_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036118_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036119_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036120_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036121_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036123_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036124_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036125_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036131_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036134_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036137_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036138_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036139_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036141_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036142_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036144_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036147_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036149_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036150_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036151_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036154_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036155_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036157_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036158_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036159_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036160_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036161_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036162_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036165_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036166_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036167_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036168_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036170_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036172_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036174_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036176_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036179_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036181_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036182_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036183_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036184_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036185_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036186_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036187_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036188_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036190_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036193_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036195_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036196_0.png treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036197_0.png treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036198_0.png treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036200_0.png treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036202_0.png treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036204_0.png treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036205_0.png treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036207_0.png treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036208_0.png treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036209_0.png treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036210_0.png treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036211_0.png treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036213_0.png treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036214_0.png treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036215_0.png treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036216_0.png treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036221_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036089_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036099_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036105_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036110_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036127_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036136_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036169_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036173_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036175_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036178_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036194_0.png treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036199_0.png treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036203_0.png treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036212_0.png treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036220_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036129_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036130_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036177_0.png treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036067_0.png treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036068_0.png treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036069_0.png treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036070_0.png treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036071_0.png treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036072_0.png treat image : temp/1748341827_193040_1361264160_7957730e276734e48e013a6a39e0e5cb_rle_crop_3814036075_0.png treat image : temp/1748341827_193040_1361264156_24986dd824bd52efb7569337f38c4bde_rle_crop_3814036079_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036086_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036087_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036093_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036094_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036102_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036107_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036111_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036113_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036114_0.png treat image : temp/1748341827_193040_1361264147_5b49ef70747bc56b59bc2c52f0a5340a_rle_crop_3814036115_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036122_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036126_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036128_0.png treat image : temp/1748341827_193040_1361264144_5aa0160e378bf63259be43380fec56be_rle_crop_3814036132_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036133_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036135_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036140_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036146_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036148_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036152_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036153_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036156_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036163_0.png treat image : temp/1748341827_193040_1361263883_517822be6794c797423fc0f3ad662051_rle_crop_3814036164_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036171_0.png treat image : temp/1748341827_193040_1361263872_41c2710de9a9a755d62cfad2b302c52b_rle_crop_3814036180_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036189_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036191_0.png treat image : temp/1748341827_193040_1361263868_6e79360abbf3bb3ae0a198d41eb95b94_rle_crop_3814036192_0.png treat image : temp/1748341827_193040_1361263838_f5eb91287a627ca9fdb92e811b3b1e73_rle_crop_3814036201_0.png treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036217_0.png treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036218_0.png treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036219_0.png treat image : temp/1748341827_193040_1361263831_94ecae079050b68a8187bb442f0658da_rle_crop_3814036222_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036085_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036090_0.png treat image : temp/1748341827_193040_1361264152_8a49a8d1f87542cf54ebccca5e77b44a_rle_crop_3814036098_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036143_0.png treat image : temp/1748341827_193040_1361264141_ca3e1c45f5b3b6acef2953d6d6a028d7_rle_crop_3814036145_0.png treat image : temp/1748341827_193040_1361263835_800d66472974d9d75f7a6bf53260f949_rle_crop_3814036206_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 168 time used for this insertion : 0.020425081253051758 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 168 time used for this insertion : 0.03606867790222168 save missing photos in datou_result : time spend for datou_step_exec : 13.107802867889404 time spend to save output : 0.0623321533203125 total time spend for step 7 : 13.170135021209717 step8:velours_tree Tue May 27 12:39:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.6703155040740967 time spend to save output : 3.4332275390625e-05 total time spend for step 8 : 0.6703498363494873 step9:send_mail_cod Tue May 27 12:39:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23375432_27-05-2025_12_39_28.pdf 23376203 change filename to text .change filename to text .imagette233762031748342368 23376204 imagette233762041748342368 23376205 change filename to text .change filename to text .change filename to text .change filename to text .imagette233762051748342368 23376206 imagette233762061748342368 23376207 change filename to text .change filename to text .change filename to text .imagette233762071748342368 23376208 imagette233762081748342369 23376209 imagette233762091748342369 23376210 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233762101748342369 23376212 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233762121748342370 23376213 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233762131748342371 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23375432 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23376203,23376204,23376205,23376206,23376207,23376208,23376209,23376210,23376211,23376212,23376213?tags=pet_fonce,background,autre,flou,metal,pehd,mal_croppe,papier,environnement,carton,pet_clair args[1361264160] : ((1361264160, -5.63068740846313, 492609224), (1361264160, 0.10290581251506686, 2107752395), '0.11899609977816361') We are sending mail with results at report@fotonower.com args[1361264156] : ((1361264156, -5.743326924517814, 492609224), (1361264156, 0.5710967329236971, 2107752395), '0.11899609977816361') We are sending mail with results at report@fotonower.com args[1361264152] : ((1361264152, -5.8254165468789285, 492609224), (1361264152, 0.5510082748601338, 2107752395), '0.11899609977816361') We are sending mail with results at report@fotonower.com args[1361264147] : ((1361264147, -5.846795575147671, 492609224), (1361264147, 0.4738698294104492, 2107752395), '0.11899609977816361') We are sending mail with results at report@fotonower.com args[1361264144] : ((1361264144, -5.734649247561144, 492609224), (1361264144, 0.5699607743895873, 2107752395), '0.11899609977816361') We are sending mail with results at report@fotonower.com args[1361264141] : ((1361264141, -5.685073500830008, 492609224), (1361264141, 0.419558332337263, 2107752395), '0.11899609977816361') We are sending mail with results at report@fotonower.com args[1361263883] : ((1361263883, -5.889909373922303, 492609224), (1361263883, 0.3616493051356395, 2107752395), '0.11899609977816361') We are sending mail with results at report@fotonower.com args[1361263872] : ((1361263872, -5.721455310724083, 492609224), (1361263872, 0.5269078149179696, 2107752395), '0.11899609977816361') We are sending mail with results at report@fotonower.com args[1361263868] : ((1361263868, -5.867929224218872, 492609224), (1361263868, 0.5992489528817488, 2107752395), '0.11899609977816361') We are sending mail with results at report@fotonower.com args[1361263838] : ((1361263838, -5.772379991575636, 492609224), (1361263838, 0.5366592433750036, 2107752395), '0.11899609977816361') We are sending mail with results at report@fotonower.com args[1361263835] : ((1361263835, -5.951221903522676, 492609224), (1361263835, 0.6624326209886798, 2107752395), '0.11899609977816361') We are sending mail with results at report@fotonower.com args[1361263831] : ((1361263831, -5.799500363044701, 492609224), (1361263831, 0.5793367771595029, 2107752395), '0.11899609977816361') We are sending mail with results at report@fotonower.com refus_total : 0.11899609977816361 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23375432 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23375432_27-05-2025_12_39_28.pdf results_Auto_P23375432_27-05-2025_12_39_28.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23375432_27-05-2025_12_39_28.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23375432','results_Auto_P23375432_27-05-2025_12_39_28.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23375432_27-05-2025_12_39_28.pdf','pdf','','1.07','0.11899609977816361') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23375432

https://www.fotonower.com/image?json=false&list_photos_id=1361264160
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361264156
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361264152
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361264147
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361264144
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361264141
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361263883
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361263872
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361263868
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361263838
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361263835
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361263831
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.90%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23376203?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23376205?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23376207?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23376210?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23376212?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23376213?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23375432_27-05-2025_12_39_28.pdf.

Lien vers velours :https://www.fotonower.com/velours/23376203,23376204,23376205,23376206,23376207,23376208,23376209,23376210,23376211,23376212,23376213?tags=pet_fonce,background,autre,flou,metal,pehd,mal_croppe,papier,environnement,carton,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 27 May 2025 10:39:36 GMT Content-Length: 0 Connection: close X-Message-Id: IOtYJGFWQXC4TlgfvWJduA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361264160, 1361264156, 1361264152, 1361264147, 1361264144, 1361264141, 1361263883, 1361263872, 1361263868, 1361263838, 1361263835, 1361263831] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264160', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264156', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264152', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264147', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264144', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264141', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263883', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263872', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263868', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263838', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263835', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263831', None, None, None, None, None, '2965961') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.01582503318786621 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.731778144836426 time spend to save output : 0.016126155853271484 total time spend for step 9 : 8.747904300689697 step10:split_time_score Tue May 27 12:39:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 12),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 27052025 23375432 Nombre de photos uploadées : 12 / 23040 (0%) 27052025 23375432 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 27052025 23375432 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005905628204345703 elapsed_time : insert_dashboard_record_day_entry 0.025605201721191406 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.057306423611111115 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23366972_27-05-2025_07_22_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23366972 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23366972 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23367704 order by id desc limit 1 Qualite : 0.10074890136718752 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23367726_27-05-2025_08_02_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23367726 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23367726 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23367730 order by id desc limit 1 Qualite : 0.10462909570656968 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23371486_27-05-2025_10_29_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23371486 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23371486 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23375418 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23375421 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23375429 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23375431 order by id desc limit 1 Qualite : 0.11899609977816361 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23375432_27-05-2025_12_39_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23375432 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23375432 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'27052025': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361264160, 1361264156, 1361264152, 1361264147, 1361264144, 1361264141, 1361263883, 1361263872, 1361263868, 1361263838, 1361263835, 1361263831] Looping around the photos to save general results len do output : 1 /23375432Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264160', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264156', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264152', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264147', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264144', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361264141', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263883', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263872', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263868', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263838', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263835', None, None, None, None, None, '2965961') ('3318', None, None, None, None, None, None, None, '2965961') ('3318', '23375432', '1361263831', None, None, None, None, None, '2965961') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.020204544067382812 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.557441473007202 time spend to save output : 0.020411252975463867 total time spend for step 10 : 5.577852725982666 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 190.29user 267.16system 9:17.26elapsed 82%CPU (0avgtext+0avgdata 5803800maxresident)k 731104inputs+204984outputs (7314major+19756282minor)pagefaults 0swaps