python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2383612 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2584394'] with mtr_portfolio_ids : ['20528872'] and first list_photo_ids : [] new path : /proc/2383612/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 1.9162673950195312 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Feb 14 00:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5801 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-14 00:40:33.667408: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-14 00:40:33.691047: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-14 00:40:33.693109: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3ec8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-14 00:40:33.693156: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-14 00:40:33.696620: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-14 00:40:33.952440: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1895ba90 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-14 00:40:33.952500: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-14 00:40:33.953770: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 00:40:33.954511: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 00:40:33.959790: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 00:40:33.963351: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 00:40:33.964618: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 00:40:33.967688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 00:40:33.969265: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 00:40:33.975118: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 00:40:33.976462: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 00:40:33.976552: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 00:40:33.977241: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-14 00:40:33.977259: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-14 00:40:33.977271: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-14 00:40:33.978519: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5310 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-14 00:40:34.315508: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 00:40:34.315612: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 00:40:34.315642: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 00:40:34.315670: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 00:40:34.315698: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 00:40:34.315724: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 00:40:34.315750: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 00:40:34.315778: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 00:40:34.317274: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 00:40:34.319725: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 00:40:34.319819: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 00:40:34.319848: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 00:40:34.319874: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 00:40:34.319900: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 00:40:34.319926: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 00:40:34.319951: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 00:40:34.319980: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 00:40:34.321424: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 00:40:34.321459: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-14 00:40:34.321473: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-14 00:40:34.321486: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-14 00:40:34.322954: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5310 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-14 00:40:45.775403: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 00:40:45.966506: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 00:40:47.303535: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 47 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 58 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 48 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 Detection mask done ! Trying to reset tf kernel 2384192 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1141 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6022 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.004781007766723633 nb_pixel_total : 78552 time to create 1 rle with old method : 0.09104776382446289 length of segment : 291 time for calcul the mask position with numpy : 0.010309457778930664 nb_pixel_total : 241021 time to create 1 rle with new method : 0.019008159637451172 length of segment : 529 time for calcul the mask position with numpy : 0.00038933753967285156 nb_pixel_total : 9754 time to create 1 rle with old method : 0.012770891189575195 length of segment : 95 time for calcul the mask position with numpy : 0.0024979114532470703 nb_pixel_total : 90426 time to create 1 rle with old method : 0.11501789093017578 length of segment : 675 time for calcul the mask position with numpy : 0.002712726593017578 nb_pixel_total : 60898 time to create 1 rle with old method : 0.07973432540893555 length of segment : 288 time for calcul the mask position with numpy : 0.0005068778991699219 nb_pixel_total : 20050 time to create 1 rle with old method : 0.023701190948486328 length of segment : 173 time for calcul the mask position with numpy : 0.0004639625549316406 nb_pixel_total : 21165 time to create 1 rle with old method : 0.0246889591217041 length of segment : 207 time for calcul the mask position with numpy : 0.00019669532775878906 nb_pixel_total : 7643 time to create 1 rle with old method : 0.009289979934692383 length of segment : 101 time for calcul the mask position with numpy : 0.0005786418914794922 nb_pixel_total : 30307 time to create 1 rle with old method : 0.03490877151489258 length of segment : 335 time for calcul the mask position with numpy : 0.002240896224975586 nb_pixel_total : 123321 time to create 1 rle with old method : 0.14725756645202637 length of segment : 548 time for calcul the mask position with numpy : 0.0006594657897949219 nb_pixel_total : 30995 time to create 1 rle with old method : 0.036002159118652344 length of segment : 271 time for calcul the mask position with numpy : 0.0005071163177490234 nb_pixel_total : 18545 time to create 1 rle with old method : 0.022290706634521484 length of segment : 210 time for calcul the mask position with numpy : 0.001180887222290039 nb_pixel_total : 15502 time to create 1 rle with old method : 0.018478870391845703 length of segment : 252 time for calcul the mask position with numpy : 0.0007240772247314453 nb_pixel_total : 15379 time to create 1 rle with old method : 0.018674135208129883 length of segment : 128 time for calcul the mask position with numpy : 0.008479833602905273 nb_pixel_total : 212893 time to create 1 rle with new method : 0.012829303741455078 length of segment : 769 time for calcul the mask position with numpy : 0.0008616447448730469 nb_pixel_total : 17092 time to create 1 rle with old method : 0.02003026008605957 length of segment : 238 time for calcul the mask position with numpy : 0.0004107952117919922 nb_pixel_total : 6167 time to create 1 rle with old method : 0.007349729537963867 length of segment : 93 time for calcul the mask position with numpy : 0.01900482177734375 nb_pixel_total : 371472 time to create 1 rle with new method : 0.026535749435424805 length of segment : 864 time for calcul the mask position with numpy : 0.0018720626831054688 nb_pixel_total : 50994 time to create 1 rle with old method : 0.056870222091674805 length of segment : 334 time for calcul the mask position with numpy : 0.0016245841979980469 nb_pixel_total : 40632 time to create 1 rle with old method : 0.047783613204956055 length of segment : 402 time for calcul the mask position with numpy : 0.00046372413635253906 nb_pixel_total : 8762 time to create 1 rle with old method : 0.01100301742553711 length of segment : 119 time for calcul the mask position with numpy : 0.0012459754943847656 nb_pixel_total : 33907 time to create 1 rle with old method : 0.04066133499145508 length of segment : 180 time for calcul the mask position with numpy : 0.0009167194366455078 nb_pixel_total : 38519 time to create 1 rle with old method : 0.04507851600646973 length of segment : 296 time for calcul the mask position with numpy : 0.0003578662872314453 nb_pixel_total : 7997 time to create 1 rle with old method : 0.009734153747558594 length of segment : 102 time for calcul the mask position with numpy : 0.0007679462432861328 nb_pixel_total : 13091 time to create 1 rle with old method : 0.015609025955200195 length of segment : 141 time for calcul the mask position with numpy : 0.02406907081604004 nb_pixel_total : 421050 time to create 1 rle with new method : 0.034233808517456055 length of segment : 819 time for calcul the mask position with numpy : 0.0013968944549560547 nb_pixel_total : 32381 time to create 1 rle with old method : 0.03911113739013672 length of segment : 243 time for calcul the mask position with numpy : 0.0074977874755859375 nb_pixel_total : 208486 time to create 1 rle with new method : 0.013017416000366211 length of segment : 622 time for calcul the mask position with numpy : 0.003989219665527344 nb_pixel_total : 107470 time to create 1 rle with old method : 0.12358379364013672 length of segment : 439 time for calcul the mask position with numpy : 0.0017933845520019531 nb_pixel_total : 47513 time to create 1 rle with old method : 0.053664207458496094 length of segment : 434 time for calcul the mask position with numpy : 0.01018524169921875 nb_pixel_total : 329146 time to create 1 rle with new method : 0.01704716682434082 length of segment : 934 time for calcul the mask position with numpy : 0.003165006637573242 nb_pixel_total : 136913 time to create 1 rle with old method : 0.16037631034851074 length of segment : 499 time for calcul the mask position with numpy : 0.0007174015045166016 nb_pixel_total : 16232 time to create 1 rle with old method : 0.019040346145629883 length of segment : 191 time for calcul the mask position with numpy : 0.00041413307189941406 nb_pixel_total : 11034 time to create 1 rle with old method : 0.013749122619628906 length of segment : 93 time for calcul the mask position with numpy : 0.0019676685333251953 nb_pixel_total : 39943 time to create 1 rle with old method : 0.04745316505432129 length of segment : 280 time for calcul the mask position with numpy : 0.004690408706665039 nb_pixel_total : 159500 time to create 1 rle with new method : 0.008099555969238281 length of segment : 443 time for calcul the mask position with numpy : 0.00397944450378418 nb_pixel_total : 113500 time to create 1 rle with old method : 0.12798595428466797 length of segment : 346 time for calcul the mask position with numpy : 0.0023577213287353516 nb_pixel_total : 46374 time to create 1 rle with old method : 0.0546114444732666 length of segment : 422 time for calcul the mask position with numpy : 0.001483917236328125 nb_pixel_total : 13570 time to create 1 rle with old method : 0.016429901123046875 length of segment : 253 time for calcul the mask position with numpy : 0.0007307529449462891 nb_pixel_total : 20661 time to create 1 rle with old method : 0.024198532104492188 length of segment : 176 time for calcul the mask position with numpy : 0.00127410888671875 nb_pixel_total : 21099 time to create 1 rle with old method : 0.0243988037109375 length of segment : 300 time for calcul the mask position with numpy : 0.0032389163970947266 nb_pixel_total : 72575 time to create 1 rle with old method : 0.08332943916320801 length of segment : 535 time for calcul the mask position with numpy : 0.002157449722290039 nb_pixel_total : 41073 time to create 1 rle with old method : 0.05061674118041992 length of segment : 223 time for calcul the mask position with numpy : 0.0009462833404541016 nb_pixel_total : 16529 time to create 1 rle with old method : 0.021924257278442383 length of segment : 149 time for calcul the mask position with numpy : 0.006566762924194336 nb_pixel_total : 185750 time to create 1 rle with new method : 0.011544942855834961 length of segment : 483 time for calcul the mask position with numpy : 0.0017743110656738281 nb_pixel_total : 33504 time to create 1 rle with old method : 0.0397183895111084 length of segment : 241 time for calcul the mask position with numpy : 0.0007538795471191406 nb_pixel_total : 17048 time to create 1 rle with old method : 0.019824504852294922 length of segment : 215 time for calcul the mask position with numpy : 0.23162484169006348 nb_pixel_total : 525136 time to create 1 rle with new method : 0.08810591697692871 length of segment : 830 time for calcul the mask position with numpy : 0.0024487972259521484 nb_pixel_total : 58056 time to create 1 rle with old method : 0.06637120246887207 length of segment : 384 time for calcul the mask position with numpy : 0.003810882568359375 nb_pixel_total : 136183 time to create 1 rle with old method : 0.2017834186553955 length of segment : 460 time for calcul the mask position with numpy : 0.001035451889038086 nb_pixel_total : 23428 time to create 1 rle with old method : 0.027312040328979492 length of segment : 171 time for calcul the mask position with numpy : 0.0007650852203369141 nb_pixel_total : 26504 time to create 1 rle with old method : 0.032392263412475586 length of segment : 278 time for calcul the mask position with numpy : 0.0008485317230224609 nb_pixel_total : 16010 time to create 1 rle with old method : 0.018961191177368164 length of segment : 237 time for calcul the mask position with numpy : 0.0014007091522216797 nb_pixel_total : 34729 time to create 1 rle with old method : 0.04069352149963379 length of segment : 343 time for calcul the mask position with numpy : 0.0019481182098388672 nb_pixel_total : 46022 time to create 1 rle with old method : 0.06285524368286133 length of segment : 369 time for calcul the mask position with numpy : 0.0003979206085205078 nb_pixel_total : 14855 time to create 1 rle with old method : 0.018002986907958984 length of segment : 159 time for calcul the mask position with numpy : 0.000457763671875 nb_pixel_total : 16555 time to create 1 rle with old method : 0.020183324813842773 length of segment : 193 time for calcul the mask position with numpy : 0.0026476383209228516 nb_pixel_total : 131176 time to create 1 rle with old method : 0.14798498153686523 length of segment : 521 time for calcul the mask position with numpy : 0.0010559558868408203 nb_pixel_total : 36448 time to create 1 rle with old method : 0.04696154594421387 length of segment : 351 time for calcul the mask position with numpy : 0.0010797977447509766 nb_pixel_total : 35590 time to create 1 rle with old method : 0.04490327835083008 length of segment : 202 time for calcul the mask position with numpy : 0.0022928714752197266 nb_pixel_total : 79795 time to create 1 rle with old method : 0.08954524993896484 length of segment : 646 time for calcul the mask position with numpy : 0.0012891292572021484 nb_pixel_total : 32402 time to create 1 rle with old method : 0.041113853454589844 length of segment : 333 time for calcul the mask position with numpy : 0.0016179084777832031 nb_pixel_total : 57135 time to create 1 rle with old method : 0.06680583953857422 length of segment : 320 time for calcul the mask position with numpy : 0.0013892650604248047 nb_pixel_total : 62553 time to create 1 rle with old method : 0.07023262977600098 length of segment : 227 time for calcul the mask position with numpy : 0.0004553794860839844 nb_pixel_total : 14286 time to create 1 rle with old method : 0.01691746711730957 length of segment : 216 time for calcul the mask position with numpy : 0.0011219978332519531 nb_pixel_total : 38132 time to create 1 rle with old method : 0.04433870315551758 length of segment : 177 time for calcul the mask position with numpy : 0.0019385814666748047 nb_pixel_total : 49832 time to create 1 rle with old method : 0.05870461463928223 length of segment : 253 time for calcul the mask position with numpy : 0.0013837814331054688 nb_pixel_total : 51856 time to create 1 rle with old method : 0.06019306182861328 length of segment : 292 time for calcul the mask position with numpy : 0.0006680488586425781 nb_pixel_total : 31448 time to create 1 rle with old method : 0.035697221755981445 length of segment : 330 time for calcul the mask position with numpy : 0.0015311241149902344 nb_pixel_total : 55717 time to create 1 rle with old method : 0.06417608261108398 length of segment : 304 time for calcul the mask position with numpy : 0.0003800392150878906 nb_pixel_total : 9639 time to create 1 rle with old method : 0.011955976486206055 length of segment : 100 time for calcul the mask position with numpy : 0.002282857894897461 nb_pixel_total : 85384 time to create 1 rle with old method : 0.09936690330505371 length of segment : 316 time for calcul the mask position with numpy : 0.0014498233795166016 nb_pixel_total : 40793 time to create 1 rle with old method : 0.04946780204772949 length of segment : 240 time for calcul the mask position with numpy : 0.0002701282501220703 nb_pixel_total : 7346 time to create 1 rle with old method : 0.009012460708618164 length of segment : 70 time for calcul the mask position with numpy : 0.0015535354614257812 nb_pixel_total : 37619 time to create 1 rle with old method : 0.05001640319824219 length of segment : 152 time for calcul the mask position with numpy : 0.0009710788726806641 nb_pixel_total : 41925 time to create 1 rle with old method : 0.04879140853881836 length of segment : 172 time for calcul the mask position with numpy : 0.0003159046173095703 nb_pixel_total : 10685 time to create 1 rle with old method : 0.012806177139282227 length of segment : 76 time for calcul the mask position with numpy : 0.0015897750854492188 nb_pixel_total : 29833 time to create 1 rle with old method : 0.03507876396179199 length of segment : 211 time for calcul the mask position with numpy : 0.0013804435729980469 nb_pixel_total : 32061 time to create 1 rle with old method : 0.03651022911071777 length of segment : 253 time for calcul the mask position with numpy : 0.003075838088989258 nb_pixel_total : 89924 time to create 1 rle with old method : 0.1018826961517334 length of segment : 298 time for calcul the mask position with numpy : 0.004869699478149414 nb_pixel_total : 151733 time to create 1 rle with new method : 0.006478309631347656 length of segment : 470 time for calcul the mask position with numpy : 0.0013239383697509766 nb_pixel_total : 29799 time to create 1 rle with old method : 0.034235477447509766 length of segment : 255 time for calcul the mask position with numpy : 0.000988006591796875 nb_pixel_total : 28698 time to create 1 rle with old method : 0.03389382362365723 length of segment : 235 time for calcul the mask position with numpy : 0.0007059574127197266 nb_pixel_total : 13024 time to create 1 rle with old method : 0.01609015464782715 length of segment : 154 time for calcul the mask position with numpy : 0.0005609989166259766 nb_pixel_total : 19546 time to create 1 rle with old method : 0.02245306968688965 length of segment : 197 time for calcul the mask position with numpy : 0.004441976547241211 nb_pixel_total : 139024 time to create 1 rle with old method : 0.15834593772888184 length of segment : 475 time for calcul the mask position with numpy : 0.0028738975524902344 nb_pixel_total : 58300 time to create 1 rle with old method : 0.06630921363830566 length of segment : 409 time for calcul the mask position with numpy : 0.0017037391662597656 nb_pixel_total : 39135 time to create 1 rle with old method : 0.045511484146118164 length of segment : 303 time for calcul the mask position with numpy : 0.003681659698486328 nb_pixel_total : 117354 time to create 1 rle with old method : 0.13274931907653809 length of segment : 316 time for calcul the mask position with numpy : 0.004209756851196289 nb_pixel_total : 141029 time to create 1 rle with old method : 0.15977239608764648 length of segment : 393 time for calcul the mask position with numpy : 0.0025103092193603516 nb_pixel_total : 47486 time to create 1 rle with old method : 0.054572343826293945 length of segment : 337 time for calcul the mask position with numpy : 0.0017197132110595703 nb_pixel_total : 28267 time to create 1 rle with old method : 0.03340005874633789 length of segment : 258 time for calcul the mask position with numpy : 0.0021047592163085938 nb_pixel_total : 54329 time to create 1 rle with old method : 0.062157392501831055 length of segment : 452 time for calcul the mask position with numpy : 0.0011153221130371094 nb_pixel_total : 18874 time to create 1 rle with old method : 0.02379322052001953 length of segment : 186 time for calcul the mask position with numpy : 0.0007271766662597656 nb_pixel_total : 13184 time to create 1 rle with old method : 0.0187835693359375 length of segment : 140 time for calcul the mask position with numpy : 0.0019521713256835938 nb_pixel_total : 37396 time to create 1 rle with old method : 0.04470086097717285 length of segment : 242 time for calcul the mask position with numpy : 0.0014126300811767578 nb_pixel_total : 29494 time to create 1 rle with old method : 0.03499603271484375 length of segment : 139 time for calcul the mask position with numpy : 0.001482248306274414 nb_pixel_total : 23268 time to create 1 rle with old method : 0.02701711654663086 length of segment : 282 time for calcul the mask position with numpy : 0.001985788345336914 nb_pixel_total : 39034 time to create 1 rle with old method : 0.05623459815979004 length of segment : 352 time for calcul the mask position with numpy : 0.0011146068572998047 nb_pixel_total : 41430 time to create 1 rle with old method : 0.04818129539489746 length of segment : 162 time for calcul the mask position with numpy : 0.0006055831909179688 nb_pixel_total : 14231 time to create 1 rle with old method : 0.0173494815826416 length of segment : 108 time for calcul the mask position with numpy : 0.001491546630859375 nb_pixel_total : 37851 time to create 1 rle with old method : 0.04602456092834473 length of segment : 218 time for calcul the mask position with numpy : 0.0024743080139160156 nb_pixel_total : 40432 time to create 1 rle with old method : 0.05455136299133301 length of segment : 270 time for calcul the mask position with numpy : 0.00202178955078125 nb_pixel_total : 40176 time to create 1 rle with old method : 0.04645872116088867 length of segment : 286 time for calcul the mask position with numpy : 0.0008366107940673828 nb_pixel_total : 15049 time to create 1 rle with old method : 0.019312620162963867 length of segment : 165 time for calcul the mask position with numpy : 0.0008080005645751953 nb_pixel_total : 13256 time to create 1 rle with old method : 0.01551365852355957 length of segment : 177 time for calcul the mask position with numpy : 0.0003864765167236328 nb_pixel_total : 7665 time to create 1 rle with old method : 0.009250164031982422 length of segment : 143 time for calcul the mask position with numpy : 0.0016102790832519531 nb_pixel_total : 50943 time to create 1 rle with old method : 0.05912923812866211 length of segment : 270 time for calcul the mask position with numpy : 0.0065610408782958984 nb_pixel_total : 158092 time to create 1 rle with new method : 0.010321855545043945 length of segment : 496 time for calcul the mask position with numpy : 0.0005600452423095703 nb_pixel_total : 11994 time to create 1 rle with old method : 0.014505863189697266 length of segment : 84 time for calcul the mask position with numpy : 0.0025243759155273438 nb_pixel_total : 82920 time to create 1 rle with old method : 0.09620857238769531 length of segment : 269 time for calcul the mask position with numpy : 0.00018858909606933594 nb_pixel_total : 4157 time to create 1 rle with old method : 0.004968166351318359 length of segment : 89 time for calcul the mask position with numpy : 0.0036551952362060547 nb_pixel_total : 79977 time to create 1 rle with old method : 0.10522913932800293 length of segment : 482 time for calcul the mask position with numpy : 0.0031926631927490234 nb_pixel_total : 74965 time to create 1 rle with old method : 0.08560585975646973 length of segment : 380 time for calcul the mask position with numpy : 0.0005490779876708984 nb_pixel_total : 19285 time to create 1 rle with old method : 0.023009777069091797 length of segment : 181 time for calcul the mask position with numpy : 0.000377655029296875 nb_pixel_total : 11033 time to create 1 rle with old method : 0.01281285285949707 length of segment : 117 time for calcul the mask position with numpy : 0.0037851333618164062 nb_pixel_total : 107157 time to create 1 rle with old method : 0.12112259864807129 length of segment : 449 time for calcul the mask position with numpy : 0.0015950202941894531 nb_pixel_total : 67504 time to create 1 rle with old method : 0.07698583602905273 length of segment : 282 time for calcul the mask position with numpy : 0.0020706653594970703 nb_pixel_total : 47581 time to create 1 rle with old method : 0.054813385009765625 length of segment : 394 time for calcul the mask position with numpy : 0.0041730403900146484 nb_pixel_total : 119529 time to create 1 rle with old method : 0.13556718826293945 length of segment : 356 time for calcul the mask position with numpy : 0.005822420120239258 nb_pixel_total : 119857 time to create 1 rle with old method : 0.13447999954223633 length of segment : 372 time for calcul the mask position with numpy : 0.004305362701416016 nb_pixel_total : 106897 time to create 1 rle with old method : 0.12039017677307129 length of segment : 400 time for calcul the mask position with numpy : 0.001041412353515625 nb_pixel_total : 27701 time to create 1 rle with old method : 0.03182077407836914 length of segment : 118 time for calcul the mask position with numpy : 0.0022361278533935547 nb_pixel_total : 59024 time to create 1 rle with old method : 0.07125282287597656 length of segment : 311 time for calcul the mask position with numpy : 0.0008544921875 nb_pixel_total : 23434 time to create 1 rle with old method : 0.02796649932861328 length of segment : 151 time for calcul the mask position with numpy : 0.0024559497833251953 nb_pixel_total : 90731 time to create 1 rle with old method : 0.10664749145507812 length of segment : 419 time for calcul the mask position with numpy : 0.011397123336791992 nb_pixel_total : 299592 time to create 1 rle with new method : 0.1895766258239746 length of segment : 914 time for calcul the mask position with numpy : 0.004147768020629883 nb_pixel_total : 86836 time to create 1 rle with old method : 0.10114073753356934 length of segment : 595 time for calcul the mask position with numpy : 0.0012030601501464844 nb_pixel_total : 35352 time to create 1 rle with old method : 0.04044055938720703 length of segment : 153 time for calcul the mask position with numpy : 0.00041294097900390625 nb_pixel_total : 22088 time to create 1 rle with old method : 0.026238441467285156 length of segment : 152 time for calcul the mask position with numpy : 0.0004899501800537109 nb_pixel_total : 7841 time to create 1 rle with old method : 0.00927734375 length of segment : 99 time for calcul the mask position with numpy : 0.00829625129699707 nb_pixel_total : 184414 time to create 1 rle with new method : 0.009531974792480469 length of segment : 465 time for calcul the mask position with numpy : 0.001016378402709961 nb_pixel_total : 16024 time to create 1 rle with old method : 0.019031047821044922 length of segment : 147 time for calcul the mask position with numpy : 0.013145208358764648 nb_pixel_total : 320331 time to create 1 rle with new method : 0.01639270782470703 length of segment : 951 time for calcul the mask position with numpy : 0.001209259033203125 nb_pixel_total : 24680 time to create 1 rle with old method : 0.029356718063354492 length of segment : 188 time for calcul the mask position with numpy : 0.0004405975341796875 nb_pixel_total : 7563 time to create 1 rle with old method : 0.00894618034362793 length of segment : 90 time for calcul the mask position with numpy : 0.0010421276092529297 nb_pixel_total : 23822 time to create 1 rle with old method : 0.02737736701965332 length of segment : 142 time for calcul the mask position with numpy : 0.0023915767669677734 nb_pixel_total : 32966 time to create 1 rle with old method : 0.03828310966491699 length of segment : 414 time for calcul the mask position with numpy : 0.021441936492919922 nb_pixel_total : 439333 time to create 1 rle with new method : 0.06023812294006348 length of segment : 1010 time for calcul the mask position with numpy : 0.0008971691131591797 nb_pixel_total : 8463 time to create 1 rle with old method : 0.013076543807983398 length of segment : 149 time for calcul the mask position with numpy : 0.002529144287109375 nb_pixel_total : 72917 time to create 1 rle with old method : 0.08560609817504883 length of segment : 267 time for calcul the mask position with numpy : 0.0021469593048095703 nb_pixel_total : 52782 time to create 1 rle with old method : 0.06291604042053223 length of segment : 287 time for calcul the mask position with numpy : 0.0005745887756347656 nb_pixel_total : 9012 time to create 1 rle with old method : 0.010618448257446289 length of segment : 201 time for calcul the mask position with numpy : 0.0026895999908447266 nb_pixel_total : 50642 time to create 1 rle with old method : 0.05799555778503418 length of segment : 236 time for calcul the mask position with numpy : 0.0011053085327148438 nb_pixel_total : 16943 time to create 1 rle with old method : 0.0197598934173584 length of segment : 169 time for calcul the mask position with numpy : 0.0005342960357666016 nb_pixel_total : 14365 time to create 1 rle with old method : 0.016800880432128906 length of segment : 157 time for calcul the mask position with numpy : 0.0003707408905029297 nb_pixel_total : 6448 time to create 1 rle with old method : 0.008020639419555664 length of segment : 88 time for calcul the mask position with numpy : 0.002519369125366211 nb_pixel_total : 35770 time to create 1 rle with old method : 0.04186844825744629 length of segment : 387 time for calcul the mask position with numpy : 0.009275674819946289 nb_pixel_total : 244934 time to create 1 rle with new method : 0.013569355010986328 length of segment : 299 time for calcul the mask position with numpy : 0.0005743503570556641 nb_pixel_total : 10420 time to create 1 rle with old method : 0.015390634536743164 length of segment : 301 time for calcul the mask position with numpy : 0.0057141780853271484 nb_pixel_total : 106755 time to create 1 rle with old method : 0.12099504470825195 length of segment : 788 time for calcul the mask position with numpy : 0.0009148120880126953 nb_pixel_total : 15345 time to create 1 rle with old method : 0.01784348487854004 length of segment : 167 time for calcul the mask position with numpy : 0.0029609203338623047 nb_pixel_total : 61699 time to create 1 rle with old method : 0.06992888450622559 length of segment : 327 time for calcul the mask position with numpy : 0.006803274154663086 nb_pixel_total : 189319 time to create 1 rle with new method : 0.007795572280883789 length of segment : 478 time for calcul the mask position with numpy : 0.00040221214294433594 nb_pixel_total : 7538 time to create 1 rle with old method : 0.008866310119628906 length of segment : 95 time for calcul the mask position with numpy : 0.002259969711303711 nb_pixel_total : 58373 time to create 1 rle with old method : 0.06920409202575684 length of segment : 246 time for calcul the mask position with numpy : 0.0005307197570800781 nb_pixel_total : 13485 time to create 1 rle with old method : 0.01622486114501953 length of segment : 123 time for calcul the mask position with numpy : 0.009585142135620117 nb_pixel_total : 272502 time to create 1 rle with new method : 0.013338327407836914 length of segment : 821 time for calcul the mask position with numpy : 0.018826007843017578 nb_pixel_total : 435635 time to create 1 rle with new method : 0.03868579864501953 length of segment : 953 time for calcul the mask position with numpy : 0.0008857250213623047 nb_pixel_total : 25071 time to create 1 rle with old method : 0.030356884002685547 length of segment : 142 time for calcul the mask position with numpy : 0.003613710403442383 nb_pixel_total : 67810 time to create 1 rle with old method : 0.07811927795410156 length of segment : 419 time for calcul the mask position with numpy : 0.0005884170532226562 nb_pixel_total : 14466 time to create 1 rle with old method : 0.016653776168823242 length of segment : 238 time for calcul the mask position with numpy : 0.0011522769927978516 nb_pixel_total : 30855 time to create 1 rle with old method : 0.03552985191345215 length of segment : 238 time for calcul the mask position with numpy : 0.00047206878662109375 nb_pixel_total : 15653 time to create 1 rle with old method : 0.01920461654663086 length of segment : 246 time for calcul the mask position with numpy : 0.0009958744049072266 nb_pixel_total : 15451 time to create 1 rle with old method : 0.018730878829956055 length of segment : 137 time for calcul the mask position with numpy : 0.0005867481231689453 nb_pixel_total : 26391 time to create 1 rle with old method : 0.03173971176147461 length of segment : 190 time for calcul the mask position with numpy : 0.0015714168548583984 nb_pixel_total : 36502 time to create 1 rle with old method : 0.044248104095458984 length of segment : 276 time for calcul the mask position with numpy : 0.0022585391998291016 nb_pixel_total : 45495 time to create 1 rle with old method : 0.05272221565246582 length of segment : 202 time for calcul the mask position with numpy : 0.0029449462890625 nb_pixel_total : 76515 time to create 1 rle with old method : 0.08658146858215332 length of segment : 378 time for calcul the mask position with numpy : 0.0014300346374511719 nb_pixel_total : 56483 time to create 1 rle with old method : 0.06684398651123047 length of segment : 298 time for calcul the mask position with numpy : 0.00067138671875 nb_pixel_total : 39278 time to create 1 rle with old method : 0.047781944274902344 length of segment : 192 time for calcul the mask position with numpy : 0.00039315223693847656 nb_pixel_total : 6796 time to create 1 rle with old method : 0.008364439010620117 length of segment : 130 time for calcul the mask position with numpy : 0.007256984710693359 nb_pixel_total : 59369 time to create 1 rle with old method : 0.06861352920532227 length of segment : 393 time for calcul the mask position with numpy : 0.007470846176147461 nb_pixel_total : 255802 time to create 1 rle with new method : 0.02026820182800293 length of segment : 721 time for calcul the mask position with numpy : 0.0006444454193115234 nb_pixel_total : 33955 time to create 1 rle with old method : 0.03956246376037598 length of segment : 237 time for calcul the mask position with numpy : 0.0006201267242431641 nb_pixel_total : 10115 time to create 1 rle with old method : 0.013384342193603516 length of segment : 105 time for calcul the mask position with numpy : 0.0004856586456298828 nb_pixel_total : 21419 time to create 1 rle with old method : 0.024587392807006836 length of segment : 155 time for calcul the mask position with numpy : 0.0004711151123046875 nb_pixel_total : 11248 time to create 1 rle with old method : 0.013385534286499023 length of segment : 118 time for calcul the mask position with numpy : 0.000579833984375 nb_pixel_total : 16044 time to create 1 rle with old method : 0.018985509872436523 length of segment : 125 time for calcul the mask position with numpy : 0.0004954338073730469 nb_pixel_total : 23223 time to create 1 rle with old method : 0.026932477951049805 length of segment : 249 time for calcul the mask position with numpy : 0.0011289119720458984 nb_pixel_total : 31992 time to create 1 rle with old method : 0.038645267486572266 length of segment : 221 time for calcul the mask position with numpy : 0.0011191368103027344 nb_pixel_total : 15287 time to create 1 rle with old method : 0.029163360595703125 length of segment : 152 time for calcul the mask position with numpy : 0.004156351089477539 nb_pixel_total : 86262 time to create 1 rle with old method : 0.09956693649291992 length of segment : 349 time for calcul the mask position with numpy : 0.001096963882446289 nb_pixel_total : 37449 time to create 1 rle with old method : 0.04244494438171387 length of segment : 162 time for calcul the mask position with numpy : 0.0007643699645996094 nb_pixel_total : 21395 time to create 1 rle with old method : 0.024980783462524414 length of segment : 257 time for calcul the mask position with numpy : 0.0011751651763916016 nb_pixel_total : 32113 time to create 1 rle with old method : 0.03736758232116699 length of segment : 151 time for calcul the mask position with numpy : 0.006265163421630859 nb_pixel_total : 149955 time to create 1 rle with old method : 0.16704034805297852 length of segment : 619 time for calcul the mask position with numpy : 0.00029587745666503906 nb_pixel_total : 8015 time to create 1 rle with old method : 0.00939321517944336 length of segment : 115 time for calcul the mask position with numpy : 0.006941795349121094 nb_pixel_total : 186347 time to create 1 rle with new method : 0.00805211067199707 length of segment : 533 time for calcul the mask position with numpy : 0.0043048858642578125 nb_pixel_total : 129471 time to create 1 rle with old method : 0.14600467681884766 length of segment : 405 time for calcul the mask position with numpy : 0.0010328292846679688 nb_pixel_total : 38475 time to create 1 rle with old method : 0.04380226135253906 length of segment : 209 time for calcul the mask position with numpy : 0.007847309112548828 nb_pixel_total : 52013 time to create 1 rle with old method : 0.061192989349365234 length of segment : 439 time for calcul the mask position with numpy : 0.0057032108306884766 nb_pixel_total : 191757 time to create 1 rle with new method : 0.008304834365844727 length of segment : 459 time for calcul the mask position with numpy : 0.010171175003051758 nb_pixel_total : 265022 time to create 1 rle with new method : 0.013859987258911133 length of segment : 881 time for calcul the mask position with numpy : 0.0013446807861328125 nb_pixel_total : 43162 time to create 1 rle with old method : 0.052896976470947266 length of segment : 260 time for calcul the mask position with numpy : 0.000774383544921875 nb_pixel_total : 13004 time to create 1 rle with old method : 0.015679121017456055 length of segment : 196 time for calcul the mask position with numpy : 0.005435466766357422 nb_pixel_total : 184651 time to create 1 rle with new method : 0.008513212203979492 length of segment : 540 time for calcul the mask position with numpy : 0.0005803108215332031 nb_pixel_total : 13691 time to create 1 rle with old method : 0.01637554168701172 length of segment : 208 time for calcul the mask position with numpy : 0.0012040138244628906 nb_pixel_total : 28464 time to create 1 rle with old method : 0.03403520584106445 length of segment : 177 time for calcul the mask position with numpy : 0.006139516830444336 nb_pixel_total : 184326 time to create 1 rle with new method : 0.00835108757019043 length of segment : 554 time for calcul the mask position with numpy : 0.002923727035522461 nb_pixel_total : 113672 time to create 1 rle with old method : 0.12993144989013672 length of segment : 434 time for calcul the mask position with numpy : 0.004667520523071289 nb_pixel_total : 196210 time to create 1 rle with new method : 0.007927656173706055 length of segment : 709 time for calcul the mask position with numpy : 0.0003809928894042969 nb_pixel_total : 12112 time to create 1 rle with old method : 0.015031576156616211 length of segment : 201 time for calcul the mask position with numpy : 0.003342151641845703 nb_pixel_total : 88835 time to create 1 rle with old method : 0.1012420654296875 length of segment : 372 time for calcul the mask position with numpy : 0.005453586578369141 nb_pixel_total : 283503 time to create 1 rle with new method : 0.009609222412109375 length of segment : 763 time for calcul the mask position with numpy : 0.0002562999725341797 nb_pixel_total : 5209 time to create 1 rle with old method : 0.006337404251098633 length of segment : 80 time for calcul the mask position with numpy : 0.0002593994140625 nb_pixel_total : 10774 time to create 1 rle with old method : 0.01302647590637207 length of segment : 197 time for calcul the mask position with numpy : 0.0036318302154541016 nb_pixel_total : 174274 time to create 1 rle with new method : 0.006566286087036133 length of segment : 519 time for calcul the mask position with numpy : 0.000499725341796875 nb_pixel_total : 14722 time to create 1 rle with old method : 0.017297744750976562 length of segment : 314 time spent for convertir_results : 21.542436122894287 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 209 chid ids of type : 3594 Number RLEs to save : 65733 save missing photos in datou_result : time spend for datou_step_exec : 104.70279049873352 time spend to save output : 10.398566722869873 total time spend for step 1 : 115.1013572216034 step2:crop_condition Fri Feb 14 00:42:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 209 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 114 About to insert : list_path_to_insert length 114 new photo from crops ! About to upload 114 photos upload in portfolio : 3736932 init cache_photo without model_param we have 114 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739490178_2383612 we have uploaded 114 photos in the portfolio 3736932 time of upload the photos Elapsed time : 32.982506275177 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 49 About to insert : list_path_to_insert length 49 new photo from crops ! About to upload 49 photos upload in portfolio : 3736932 init cache_photo without model_param we have 49 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739490231_2383612 we have uploaded 49 photos in the portfolio 3736932 time of upload the photos Elapsed time : 15.036576271057129 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739490248_2383612 we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.1432113647460938 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 3736932 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739490262_2383612 we have uploaded 25 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.731554269790649 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739490276_2383612 we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.2780721187591553 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739490281_2383612 we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.4891927242279053 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739490284_2383612 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0564618110656738 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1337460268, 1337460266, 1337460216, 1337460214, 1337460213, 1337343071, 1337340805, 1337340804, 1337340803, 1337340771, 1337340566, 1337340560] Looping around the photos to save general results len do output : 209 /1337471854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337471999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337472109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460268', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460266', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460216', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460214', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460213', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337343071', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340805', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340804', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340803', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340771', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340566', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340560', None, None, None, None, None, '2584394') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 639 time used for this insertion : 1.320253849029541 save_final save missing photos in datou_result : time spend for datou_step_exec : 139.06389451026917 time spend to save output : 1.3249809741973877 total time spend for step 2 : 140.38887548446655 step3:rle_unique_nms_with_priority Fri Feb 14 00:44:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 209 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 26 nb_hashtags : 4 time to prepare the origin masks : 4.281117916107178 time for calcul the mask position with numpy : 0.88539719581604 nb_pixel_total : 5078417 time to create 1 rle with new method : 0.5608820915222168 time for calcul the mask position with numpy : 0.029354095458984375 nb_pixel_total : 9754 time to create 1 rle with old method : 0.011548757553100586 time for calcul the mask position with numpy : 0.030809640884399414 nb_pixel_total : 241021 time to create 1 rle with new method : 0.6959738731384277 time for calcul the mask position with numpy : 0.029699087142944336 nb_pixel_total : 212893 time to create 1 rle with new method : 0.5444719791412354 time for calcul the mask position with numpy : 0.030159950256347656 nb_pixel_total : 78552 time to create 1 rle with old method : 0.08766937255859375 time for calcul the mask position with numpy : 0.030569791793823242 nb_pixel_total : 421050 time to create 1 rle with new method : 0.6052772998809814 time for calcul the mask position with numpy : 0.02953815460205078 nb_pixel_total : 33907 time to create 1 rle with old method : 0.038156986236572266 time for calcul the mask position with numpy : 0.031731367111206055 nb_pixel_total : 38519 time to create 1 rle with old method : 0.04384469985961914 time for calcul the mask position with numpy : 0.029367446899414062 nb_pixel_total : 50994 time to create 1 rle with old method : 0.05648970603942871 time for calcul the mask position with numpy : 0.029004335403442383 nb_pixel_total : 40632 time to create 1 rle with old method : 0.04670381546020508 time for calcul the mask position with numpy : 0.03127884864807129 nb_pixel_total : 8762 time to create 1 rle with old method : 0.010283470153808594 time for calcul the mask position with numpy : 0.03204822540283203 nb_pixel_total : 60898 time to create 1 rle with old method : 0.06744027137756348 time for calcul the mask position with numpy : 0.03127241134643555 nb_pixel_total : 371472 time to create 1 rle with new method : 0.5601394176483154 time for calcul the mask position with numpy : 0.03058171272277832 nb_pixel_total : 18359 time to create 1 rle with old method : 0.020554780960083008 time for calcul the mask position with numpy : 0.02924060821533203 nb_pixel_total : 90426 time to create 1 rle with old method : 0.09966349601745605 time for calcul the mask position with numpy : 0.029460430145263672 nb_pixel_total : 123321 time to create 1 rle with old method : 0.1360912322998047 time for calcul the mask position with numpy : 0.02801966667175293 nb_pixel_total : 15379 time to create 1 rle with old method : 0.016776084899902344 time for calcul the mask position with numpy : 0.028040170669555664 nb_pixel_total : 3594 time to create 1 rle with old method : 0.004086017608642578 time for calcul the mask position with numpy : 0.027973175048828125 nb_pixel_total : 243 time to create 1 rle with old method : 0.00030517578125 time for calcul the mask position with numpy : 0.027605533599853516 nb_pixel_total : 13091 time to create 1 rle with old method : 0.014482498168945312 time for calcul the mask position with numpy : 0.028481483459472656 nb_pixel_total : 21165 time to create 1 rle with old method : 0.02420186996459961 time for calcul the mask position with numpy : 0.028867483139038086 nb_pixel_total : 18545 time to create 1 rle with old method : 0.020772695541381836 time for calcul the mask position with numpy : 0.02913188934326172 nb_pixel_total : 30995 time to create 1 rle with old method : 0.034407854080200195 time for calcul the mask position with numpy : 0.02831125259399414 nb_pixel_total : 7643 time to create 1 rle with old method : 0.008940935134887695 time for calcul the mask position with numpy : 0.028468847274780273 nb_pixel_total : 17092 time to create 1 rle with old method : 0.01924610137939453 time for calcul the mask position with numpy : 0.02829599380493164 nb_pixel_total : 13209 time to create 1 rle with old method : 0.014189481735229492 time for calcul the mask position with numpy : 0.027423381805419922 nb_pixel_total : 30307 time to create 1 rle with old method : 0.03252005577087402 create new chi : 5.564925909042358 time to delete rle : 0.03911185264587402 batch 1 Loaded 53 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 18535 TO DO : save crop sub photo not yet done ! save time : 2.5666277408599854 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 7.997298955917358 time for calcul the mask position with numpy : 0.27817416191101074 nb_pixel_total : 5634459 time to create 1 rle with new method : 0.9320487976074219 time for calcul the mask position with numpy : 0.03773379325866699 nb_pixel_total : 41073 time to create 1 rle with old method : 0.04557442665100098 time for calcul the mask position with numpy : 0.02340078353881836 nb_pixel_total : 72575 time to create 1 rle with old method : 0.09737229347229004 time for calcul the mask position with numpy : 0.025011301040649414 nb_pixel_total : 21099 time to create 1 rle with old method : 0.025530576705932617 time for calcul the mask position with numpy : 0.024018287658691406 nb_pixel_total : 18993 time to create 1 rle with old method : 0.023177146911621094 time for calcul the mask position with numpy : 0.02326798439025879 nb_pixel_total : 13570 time to create 1 rle with old method : 0.01667618751525879 time for calcul the mask position with numpy : 0.0230867862701416 nb_pixel_total : 46374 time to create 1 rle with old method : 0.053531646728515625 time for calcul the mask position with numpy : 0.024897336959838867 nb_pixel_total : 113500 time to create 1 rle with old method : 0.1375410556793213 time for calcul the mask position with numpy : 0.030199289321899414 nb_pixel_total : 159500 time to create 1 rle with new method : 1.023163080215454 time for calcul the mask position with numpy : 0.03555560111999512 nb_pixel_total : 39943 time to create 1 rle with old method : 0.04242873191833496 time for calcul the mask position with numpy : 0.03589153289794922 nb_pixel_total : 11034 time to create 1 rle with old method : 0.01218104362487793 time for calcul the mask position with numpy : 0.03723597526550293 nb_pixel_total : 16232 time to create 1 rle with old method : 0.0210573673248291 time for calcul the mask position with numpy : 0.03484940528869629 nb_pixel_total : 136913 time to create 1 rle with old method : 0.15645623207092285 time for calcul the mask position with numpy : 0.039423227310180664 nb_pixel_total : 329125 time to create 1 rle with new method : 0.6166763305664062 time for calcul the mask position with numpy : 0.04078936576843262 nb_pixel_total : 47513 time to create 1 rle with old method : 0.0546879768371582 time for calcul the mask position with numpy : 0.03599405288696289 nb_pixel_total : 107470 time to create 1 rle with old method : 0.1261751651763916 time for calcul the mask position with numpy : 0.03969287872314453 nb_pixel_total : 208486 time to create 1 rle with new method : 0.41073060035705566 time for calcul the mask position with numpy : 0.03805398941040039 nb_pixel_total : 32381 time to create 1 rle with old method : 0.03707408905029297 create new chi : 4.781558990478516 time to delete rle : 0.003545045852661133 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 14931 TO DO : save crop sub photo not yet done ! save time : 2.4351305961608887 nb_obj : 20 nb_hashtags : 6 time to prepare the origin masks : 7.522554397583008 time for calcul the mask position with numpy : 0.7293477058410645 nb_pixel_total : 5536664 time to create 1 rle with new method : 0.8864359855651855 time for calcul the mask position with numpy : 0.03816580772399902 nb_pixel_total : 57120 time to create 1 rle with old method : 0.06454634666442871 time for calcul the mask position with numpy : 0.04103589057922363 nb_pixel_total : 32402 time to create 1 rle with old method : 0.047785282135009766 time for calcul the mask position with numpy : 0.07464218139648438 nb_pixel_total : 70543 time to create 1 rle with old method : 0.07882499694824219 time for calcul the mask position with numpy : 0.038819313049316406 nb_pixel_total : 35590 time to create 1 rle with old method : 0.03815865516662598 time for calcul the mask position with numpy : 0.03626203536987305 nb_pixel_total : 36448 time to create 1 rle with old method : 0.04053997993469238 time for calcul the mask position with numpy : 0.03827548027038574 nb_pixel_total : 131176 time to create 1 rle with old method : 0.1463332176208496 time for calcul the mask position with numpy : 0.02691054344177246 nb_pixel_total : 16555 time to create 1 rle with old method : 0.01838088035583496 time for calcul the mask position with numpy : 0.024435043334960938 nb_pixel_total : 14843 time to create 1 rle with old method : 0.016554594039916992 time for calcul the mask position with numpy : 0.023465394973754883 nb_pixel_total : 46022 time to create 1 rle with old method : 0.05195331573486328 time for calcul the mask position with numpy : 0.022938251495361328 nb_pixel_total : 34729 time to create 1 rle with old method : 0.03894472122192383 time for calcul the mask position with numpy : 0.021193504333496094 nb_pixel_total : 16010 time to create 1 rle with old method : 0.01811528205871582 time for calcul the mask position with numpy : 0.02207207679748535 nb_pixel_total : 26504 time to create 1 rle with old method : 0.02887892723083496 time for calcul the mask position with numpy : 0.022978782653808594 nb_pixel_total : 23428 time to create 1 rle with old method : 0.0257875919342041 time for calcul the mask position with numpy : 0.02547621726989746 nb_pixel_total : 136183 time to create 1 rle with old method : 0.14803028106689453 time for calcul the mask position with numpy : 0.0337681770324707 nb_pixel_total : 58056 time to create 1 rle with old method : 0.06673717498779297 time for calcul the mask position with numpy : 0.043100595474243164 nb_pixel_total : 525136 time to create 1 rle with new method : 0.4961583614349365 time for calcul the mask position with numpy : 0.056580543518066406 nb_pixel_total : 17048 time to create 1 rle with old method : 0.019832134246826172 time for calcul the mask position with numpy : 0.0871424674987793 nb_pixel_total : 33504 time to create 1 rle with old method : 0.07181549072265625 time for calcul the mask position with numpy : 0.030777931213378906 nb_pixel_total : 185750 time to create 1 rle with new method : 0.554985761642456 time for calcul the mask position with numpy : 0.025646209716796875 nb_pixel_total : 16529 time to create 1 rle with old method : 0.02000260353088379 create new chi : 4.438693523406982 time to delete rle : 0.004589080810546875 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++Number RLEs to save : 15674 TO DO : save crop sub photo not yet done ! save time : 3.3421390056610107 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 12.155225276947021 time for calcul the mask position with numpy : 0.6879172325134277 nb_pixel_total : 6179773 time to create 1 rle with new method : 0.8534274101257324 time for calcul the mask position with numpy : 0.03374767303466797 nb_pixel_total : 29799 time to create 1 rle with old method : 0.0363619327545166 time for calcul the mask position with numpy : 0.04160666465759277 nb_pixel_total : 151733 time to create 1 rle with new method : 1.187347412109375 time for calcul the mask position with numpy : 0.04363608360290527 nb_pixel_total : 89924 time to create 1 rle with old method : 0.14063048362731934 time for calcul the mask position with numpy : 0.04333925247192383 nb_pixel_total : 32061 time to create 1 rle with old method : 0.05386686325073242 time for calcul the mask position with numpy : 0.04142117500305176 nb_pixel_total : 29833 time to create 1 rle with old method : 0.039064884185791016 time for calcul the mask position with numpy : 0.03880119323730469 nb_pixel_total : 10685 time to create 1 rle with old method : 0.012963533401489258 time for calcul the mask position with numpy : 0.03620481491088867 nb_pixel_total : 41925 time to create 1 rle with old method : 0.04874467849731445 time for calcul the mask position with numpy : 0.03814840316772461 nb_pixel_total : 37521 time to create 1 rle with old method : 0.04404807090759277 time for calcul the mask position with numpy : 0.03894209861755371 nb_pixel_total : 7346 time to create 1 rle with old method : 0.008707523345947266 time for calcul the mask position with numpy : 0.039420127868652344 nb_pixel_total : 40793 time to create 1 rle with old method : 0.048775672912597656 time for calcul the mask position with numpy : 0.03780984878540039 nb_pixel_total : 85384 time to create 1 rle with old method : 0.09756875038146973 time for calcul the mask position with numpy : 0.028748273849487305 nb_pixel_total : 9639 time to create 1 rle with old method : 0.011453866958618164 time for calcul the mask position with numpy : 0.02256298065185547 nb_pixel_total : 55717 time to create 1 rle with old method : 0.06206941604614258 time for calcul the mask position with numpy : 0.023214101791381836 nb_pixel_total : 31448 time to create 1 rle with old method : 0.03540635108947754 time for calcul the mask position with numpy : 0.02390289306640625 nb_pixel_total : 51856 time to create 1 rle with old method : 0.0588681697845459 time for calcul the mask position with numpy : 0.022686243057250977 nb_pixel_total : 49832 time to create 1 rle with old method : 0.05551028251647949 time for calcul the mask position with numpy : 0.02344226837158203 nb_pixel_total : 38132 time to create 1 rle with old method : 0.042301177978515625 time for calcul the mask position with numpy : 0.021855831146240234 nb_pixel_total : 14286 time to create 1 rle with old method : 0.016653060913085938 time for calcul the mask position with numpy : 0.023307085037231445 nb_pixel_total : 62553 time to create 1 rle with old method : 0.06991958618164062 create new chi : 4.3230063915252686 time to delete rle : 0.0017116069793701172 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 10968 TO DO : save crop sub photo not yet done ! save time : 0.9761478900909424 nb_obj : 13 nb_hashtags : 5 time to prepare the origin masks : 7.348663330078125 time for calcul the mask position with numpy : 0.645920991897583 nb_pixel_total : 6335133 time to create 1 rle with new method : 0.6136646270751953 time for calcul the mask position with numpy : 0.038626909255981445 nb_pixel_total : 13150 time to create 1 rle with old method : 0.015068292617797852 time for calcul the mask position with numpy : 0.03606772422790527 nb_pixel_total : 18874 time to create 1 rle with old method : 0.024620771408081055 time for calcul the mask position with numpy : 0.037749290466308594 nb_pixel_total : 54329 time to create 1 rle with old method : 0.061846017837524414 time for calcul the mask position with numpy : 0.030703306198120117 nb_pixel_total : 28267 time to create 1 rle with old method : 0.03556680679321289 time for calcul the mask position with numpy : 0.021883487701416016 nb_pixel_total : 47486 time to create 1 rle with old method : 0.053237199783325195 time for calcul the mask position with numpy : 0.026653528213500977 nb_pixel_total : 141029 time to create 1 rle with old method : 0.16782569885253906 time for calcul the mask position with numpy : 0.02589726448059082 nb_pixel_total : 117354 time to create 1 rle with old method : 0.13883423805236816 time for calcul the mask position with numpy : 0.023348331451416016 nb_pixel_total : 39135 time to create 1 rle with old method : 0.04989147186279297 time for calcul the mask position with numpy : 0.03836321830749512 nb_pixel_total : 55191 time to create 1 rle with old method : 0.06585550308227539 time for calcul the mask position with numpy : 0.04163932800292969 nb_pixel_total : 139024 time to create 1 rle with old method : 0.16385889053344727 time for calcul the mask position with numpy : 0.04018735885620117 nb_pixel_total : 19546 time to create 1 rle with old method : 0.023152828216552734 time for calcul the mask position with numpy : 0.03695869445800781 nb_pixel_total : 13024 time to create 1 rle with old method : 0.01473855972290039 time for calcul the mask position with numpy : 0.0368955135345459 nb_pixel_total : 28698 time to create 1 rle with old method : 0.03295469284057617 create new chi : 2.5837295055389404 time to delete rle : 0.0022461414337158203 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 9822 TO DO : save crop sub photo not yet done ! save time : 1.7921879291534424 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 11.985259294509888 time for calcul the mask position with numpy : 0.6085991859436035 nb_pixel_total : 6043044 time to create 1 rle with new method : 1.0121498107910156 time for calcul the mask position with numpy : 0.03931832313537598 nb_pixel_total : 67504 time to create 1 rle with old method : 0.07771825790405273 time for calcul the mask position with numpy : 0.04160308837890625 nb_pixel_total : 107157 time to create 1 rle with old method : 0.12112236022949219 time for calcul the mask position with numpy : 0.03603196144104004 nb_pixel_total : 11033 time to create 1 rle with old method : 0.012862443923950195 time for calcul the mask position with numpy : 0.03549361228942871 nb_pixel_total : 19285 time to create 1 rle with old method : 0.02324509620666504 time for calcul the mask position with numpy : 0.046030521392822266 nb_pixel_total : 74852 time to create 1 rle with old method : 0.08653521537780762 time for calcul the mask position with numpy : 0.036124229431152344 nb_pixel_total : 79977 time to create 1 rle with old method : 0.09789752960205078 time for calcul the mask position with numpy : 0.03693866729736328 nb_pixel_total : 4157 time to create 1 rle with old method : 0.0050089359283447266 time for calcul the mask position with numpy : 0.05316758155822754 nb_pixel_total : 82920 time to create 1 rle with old method : 0.09842872619628906 time for calcul the mask position with numpy : 0.03659391403198242 nb_pixel_total : 11994 time to create 1 rle with old method : 0.014009952545166016 time for calcul the mask position with numpy : 0.03954124450683594 nb_pixel_total : 158092 time to create 1 rle with new method : 0.6259839534759521 time for calcul the mask position with numpy : 0.044342756271362305 nb_pixel_total : 50943 time to create 1 rle with old method : 0.058441877365112305 time for calcul the mask position with numpy : 0.03747153282165527 nb_pixel_total : 7665 time to create 1 rle with old method : 0.009060859680175781 time for calcul the mask position with numpy : 0.04035687446594238 nb_pixel_total : 13256 time to create 1 rle with old method : 0.015233039855957031 time for calcul the mask position with numpy : 0.0355677604675293 nb_pixel_total : 15049 time to create 1 rle with old method : 0.018556594848632812 time for calcul the mask position with numpy : 0.03731203079223633 nb_pixel_total : 40176 time to create 1 rle with old method : 0.04617810249328613 time for calcul the mask position with numpy : 0.038671255111694336 nb_pixel_total : 40432 time to create 1 rle with old method : 0.04616808891296387 time for calcul the mask position with numpy : 0.047524213790893555 nb_pixel_total : 37851 time to create 1 rle with old method : 0.04275918006896973 time for calcul the mask position with numpy : 0.03950977325439453 nb_pixel_total : 14231 time to create 1 rle with old method : 0.015883207321166992 time for calcul the mask position with numpy : 0.03760933876037598 nb_pixel_total : 41430 time to create 1 rle with old method : 0.04615378379821777 time for calcul the mask position with numpy : 0.0347900390625 nb_pixel_total : 39034 time to create 1 rle with old method : 0.04373931884765625 time for calcul the mask position with numpy : 0.03632092475891113 nb_pixel_total : 23268 time to create 1 rle with old method : 0.02671504020690918 time for calcul the mask position with numpy : 0.03586626052856445 nb_pixel_total : 29494 time to create 1 rle with old method : 0.03345322608947754 time for calcul the mask position with numpy : 0.039049386978149414 nb_pixel_total : 37396 time to create 1 rle with old method : 0.04349255561828613 create new chi : 4.203142404556274 time to delete rle : 0.0036666393280029297 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 13446 TO DO : save crop sub photo not yet done ! save time : 2.240368127822876 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 6.634812593460083 time for calcul the mask position with numpy : 1.2617592811584473 nb_pixel_total : 6022105 time to create 1 rle with new method : 1.2299230098724365 time for calcul the mask position with numpy : 0.04746246337890625 nb_pixel_total : 11601 time to create 1 rle with old method : 0.014014720916748047 time for calcul the mask position with numpy : 0.05284738540649414 nb_pixel_total : 35352 time to create 1 rle with old method : 0.05600380897521973 time for calcul the mask position with numpy : 0.04203629493713379 nb_pixel_total : 86836 time to create 1 rle with old method : 0.10169720649719238 time for calcul the mask position with numpy : 0.03878927230834961 nb_pixel_total : 299592 time to create 1 rle with new method : 0.9881205558776855 time for calcul the mask position with numpy : 0.042107582092285156 nb_pixel_total : 90731 time to create 1 rle with old method : 0.12755227088928223 time for calcul the mask position with numpy : 0.03886532783508301 nb_pixel_total : 23434 time to create 1 rle with old method : 0.034848690032958984 time for calcul the mask position with numpy : 0.021392822265625 nb_pixel_total : 59024 time to create 1 rle with old method : 0.08488011360168457 time for calcul the mask position with numpy : 0.04001760482788086 nb_pixel_total : 27701 time to create 1 rle with old method : 0.03431272506713867 time for calcul the mask position with numpy : 0.03862118721008301 nb_pixel_total : 106897 time to create 1 rle with old method : 0.12538790702819824 time for calcul the mask position with numpy : 0.03641843795776367 nb_pixel_total : 119857 time to create 1 rle with old method : 0.14470601081848145 time for calcul the mask position with numpy : 0.04189586639404297 nb_pixel_total : 119529 time to create 1 rle with old method : 0.15453839302062988 time for calcul the mask position with numpy : 0.037145137786865234 nb_pixel_total : 47581 time to create 1 rle with old method : 0.06866097450256348 create new chi : 4.988575220108032 time to delete rle : 0.0023725032806396484 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 10788 TO DO : save crop sub photo not yet done ! save time : 0.8332920074462891 nb_obj : 22 nb_hashtags : 6 time to prepare the origin masks : 11.741384029388428 time for calcul the mask position with numpy : 0.6078274250030518 nb_pixel_total : 5353674 time to create 1 rle with new method : 0.7631349563598633 time for calcul the mask position with numpy : 0.03490591049194336 nb_pixel_total : 15345 time to create 1 rle with old method : 0.01662921905517578 time for calcul the mask position with numpy : 0.03321957588195801 nb_pixel_total : 106755 time to create 1 rle with old method : 0.1170053482055664 time for calcul the mask position with numpy : 0.03607439994812012 nb_pixel_total : 5539 time to create 1 rle with old method : 0.006751060485839844 time for calcul the mask position with numpy : 0.03532266616821289 nb_pixel_total : 244611 time to create 1 rle with new method : 0.7470912933349609 time for calcul the mask position with numpy : 0.02979278564453125 nb_pixel_total : 35770 time to create 1 rle with old method : 0.03874039649963379 time for calcul the mask position with numpy : 0.03024601936340332 nb_pixel_total : 6448 time to create 1 rle with old method : 0.007364988327026367 time for calcul the mask position with numpy : 0.02321600914001465 nb_pixel_total : 14365 time to create 1 rle with old method : 0.01632833480834961 time for calcul the mask position with numpy : 0.02457571029663086 nb_pixel_total : 16943 time to create 1 rle with old method : 0.019471406936645508 time for calcul the mask position with numpy : 0.024004459381103516 nb_pixel_total : 50642 time to create 1 rle with old method : 0.05655193328857422 time for calcul the mask position with numpy : 0.03684806823730469 nb_pixel_total : 9012 time to create 1 rle with old method : 0.010900735855102539 time for calcul the mask position with numpy : 0.03748941421508789 nb_pixel_total : 52782 time to create 1 rle with old method : 0.05922365188598633 time for calcul the mask position with numpy : 0.03701186180114746 nb_pixel_total : 72917 time to create 1 rle with old method : 0.08093833923339844 time for calcul the mask position with numpy : 0.03423738479614258 nb_pixel_total : 8463 time to create 1 rle with old method : 0.009982109069824219 time for calcul the mask position with numpy : 0.0394444465637207 nb_pixel_total : 439333 time to create 1 rle with new method : 0.3829307556152344 time for calcul the mask position with numpy : 0.034442901611328125 nb_pixel_total : 32966 time to create 1 rle with old method : 0.03610110282897949 time for calcul the mask position with numpy : 0.021369457244873047 nb_pixel_total : 23822 time to create 1 rle with old method : 0.027168989181518555 time for calcul the mask position with numpy : 0.022620201110839844 nb_pixel_total : 7563 time to create 1 rle with old method : 0.008754491806030273 time for calcul the mask position with numpy : 0.02274036407470703 nb_pixel_total : 24680 time to create 1 rle with old method : 0.02786874771118164 time for calcul the mask position with numpy : 0.02384328842163086 nb_pixel_total : 320331 time to create 1 rle with new method : 0.9282987117767334 time for calcul the mask position with numpy : 0.021280527114868164 nb_pixel_total : 16024 time to create 1 rle with old method : 0.01801300048828125 time for calcul the mask position with numpy : 0.024977922439575195 nb_pixel_total : 184414 time to create 1 rle with new method : 0.442626953125 time for calcul the mask position with numpy : 0.02489948272705078 nb_pixel_total : 7841 time to create 1 rle with old method : 0.009472846984863281 create new chi : 5.236865997314453 time to delete rle : 0.0032532215118408203 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 15906 TO DO : save crop sub photo not yet done ! save time : 2.772578477859497 nb_obj : 21 nb_hashtags : 5 time to prepare the origin masks : 14.357465982437134 time for calcul the mask position with numpy : 0.46325230598449707 nb_pixel_total : 5495972 time to create 1 rle with new method : 1.2360739707946777 time for calcul the mask position with numpy : 0.0398104190826416 nb_pixel_total : 59369 time to create 1 rle with old method : 0.06711983680725098 time for calcul the mask position with numpy : 0.03876852989196777 nb_pixel_total : 6796 time to create 1 rle with old method : 0.008030176162719727 time for calcul the mask position with numpy : 0.04572916030883789 nb_pixel_total : 39195 time to create 1 rle with old method : 0.04412579536437988 time for calcul the mask position with numpy : 0.03807878494262695 nb_pixel_total : 56148 time to create 1 rle with old method : 0.06255865097045898 time for calcul the mask position with numpy : 0.03922867774963379 nb_pixel_total : 76515 time to create 1 rle with old method : 0.08488011360168457 time for calcul the mask position with numpy : 0.03789210319519043 nb_pixel_total : 45495 time to create 1 rle with old method : 0.0509037971496582 time for calcul the mask position with numpy : 0.0422210693359375 nb_pixel_total : 36502 time to create 1 rle with old method : 0.040968894958496094 time for calcul the mask position with numpy : 0.040207624435424805 nb_pixel_total : 26391 time to create 1 rle with old method : 0.02959918975830078 time for calcul the mask position with numpy : 0.036931514739990234 nb_pixel_total : 15451 time to create 1 rle with old method : 0.01765275001525879 time for calcul the mask position with numpy : 0.03688836097717285 nb_pixel_total : 15653 time to create 1 rle with old method : 0.019594192504882812 time for calcul the mask position with numpy : 0.03967165946960449 nb_pixel_total : 30855 time to create 1 rle with old method : 0.03503894805908203 time for calcul the mask position with numpy : 0.037947654724121094 nb_pixel_total : 14466 time to create 1 rle with old method : 0.016845226287841797 time for calcul the mask position with numpy : 0.03726792335510254 nb_pixel_total : 67810 time to create 1 rle with old method : 0.07823681831359863 time for calcul the mask position with numpy : 0.04134869575500488 nb_pixel_total : 25071 time to create 1 rle with old method : 0.028207063674926758 time for calcul the mask position with numpy : 0.04327893257141113 nb_pixel_total : 435635 time to create 1 rle with new method : 0.6178059577941895 time for calcul the mask position with numpy : 0.047515869140625 nb_pixel_total : 272502 time to create 1 rle with new method : 0.32987213134765625 time for calcul the mask position with numpy : 0.03855299949645996 nb_pixel_total : 13485 time to create 1 rle with old method : 0.021753311157226562 time for calcul the mask position with numpy : 0.042539358139038086 nb_pixel_total : 58373 time to create 1 rle with old method : 0.06918668746948242 time for calcul the mask position with numpy : 0.04152083396911621 nb_pixel_total : 7538 time to create 1 rle with old method : 0.008578062057495117 time for calcul the mask position with numpy : 0.042838335037231445 nb_pixel_total : 189319 time to create 1 rle with new method : 0.43747687339782715 time for calcul the mask position with numpy : 0.03851819038391113 nb_pixel_total : 61699 time to create 1 rle with old method : 0.06876349449157715 create new chi : 4.890340328216553 time to delete rle : 0.005744457244873047 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 15139 TO DO : save crop sub photo not yet done ! save time : 1.184680461883545 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 3.494370698928833 time for calcul the mask position with numpy : 0.33908653259277344 nb_pixel_total : 6651811 time to create 1 rle with new method : 1.6266732215881348 time for calcul the mask position with numpy : 0.022118568420410156 nb_pixel_total : 31992 time to create 1 rle with old method : 0.038635969161987305 time for calcul the mask position with numpy : 0.025090932846069336 nb_pixel_total : 23223 time to create 1 rle with old method : 0.0273590087890625 time for calcul the mask position with numpy : 0.03809309005737305 nb_pixel_total : 16044 time to create 1 rle with old method : 0.018550634384155273 time for calcul the mask position with numpy : 0.03303408622741699 nb_pixel_total : 11248 time to create 1 rle with old method : 0.013228416442871094 time for calcul the mask position with numpy : 0.034226179122924805 nb_pixel_total : 21410 time to create 1 rle with old method : 0.02453756332397461 time for calcul the mask position with numpy : 0.028939247131347656 nb_pixel_total : 10115 time to create 1 rle with old method : 0.011769294738769531 time for calcul the mask position with numpy : 0.025964736938476562 nb_pixel_total : 28595 time to create 1 rle with old method : 0.03915262222290039 time for calcul the mask position with numpy : 0.03156089782714844 nb_pixel_total : 255802 time to create 1 rle with new method : 0.6185450553894043 create new chi : 3.061052083969116 time to delete rle : 0.0014891624450683594 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 5778 TO DO : save crop sub photo not yet done ! save time : 0.7660660743713379 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 6.102678537368774 time for calcul the mask position with numpy : 0.6603553295135498 nb_pixel_total : 5828079 time to create 1 rle with new method : 0.7007622718811035 time for calcul the mask position with numpy : 0.03910088539123535 nb_pixel_total : 43162 time to create 1 rle with old method : 0.05087399482727051 time for calcul the mask position with numpy : 0.05339670181274414 nb_pixel_total : 265022 time to create 1 rle with new method : 0.6138148307800293 time for calcul the mask position with numpy : 0.039574623107910156 nb_pixel_total : 191757 time to create 1 rle with new method : 0.6837382316589355 time for calcul the mask position with numpy : 0.025272369384765625 nb_pixel_total : 17451 time to create 1 rle with old method : 0.023812294006347656 time for calcul the mask position with numpy : 0.023575305938720703 nb_pixel_total : 38475 time to create 1 rle with old method : 0.05141735076904297 time for calcul the mask position with numpy : 0.02493119239807129 nb_pixel_total : 129471 time to create 1 rle with old method : 0.14999914169311523 time for calcul the mask position with numpy : 0.027087926864624023 nb_pixel_total : 186347 time to create 1 rle with new method : 0.6221210956573486 time for calcul the mask position with numpy : 0.026389598846435547 nb_pixel_total : 8015 time to create 1 rle with old method : 0.014863252639770508 time for calcul the mask position with numpy : 0.028122425079345703 nb_pixel_total : 149955 time to create 1 rle with old method : 0.19910550117492676 time for calcul the mask position with numpy : 0.03263211250305176 nb_pixel_total : 32113 time to create 1 rle with old method : 0.03515768051147461 time for calcul the mask position with numpy : 0.03513956069946289 nb_pixel_total : 21395 time to create 1 rle with old method : 0.02390599250793457 time for calcul the mask position with numpy : 0.04094886779785156 nb_pixel_total : 37449 time to create 1 rle with old method : 0.041541099548339844 time for calcul the mask position with numpy : 0.0346071720123291 nb_pixel_total : 86262 time to create 1 rle with old method : 0.09872102737426758 time for calcul the mask position with numpy : 0.03362274169921875 nb_pixel_total : 15287 time to create 1 rle with old method : 0.01755356788635254 create new chi : 4.580799579620361 time to delete rle : 0.0025725364685058594 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 11660 TO DO : save crop sub photo not yet done ! save time : 2.1663289070129395 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 4.877507448196411 time for calcul the mask position with numpy : 0.4059929847717285 nb_pixel_total : 5741203 time to create 1 rle with new method : 0.49321675300598145 time for calcul the mask position with numpy : 0.033236026763916016 nb_pixel_total : 10748 time to create 1 rle with old method : 0.012550592422485352 time for calcul the mask position with numpy : 0.021863937377929688 nb_pixel_total : 174274 time to create 1 rle with new method : 0.5252459049224854 time for calcul the mask position with numpy : 0.03627347946166992 nb_pixel_total : 5237 time to create 1 rle with old method : 0.008164167404174805 time for calcul the mask position with numpy : 0.03489542007446289 nb_pixel_total : 5209 time to create 1 rle with old method : 0.007755756378173828 time for calcul the mask position with numpy : 0.03610682487487793 nb_pixel_total : 283467 time to create 1 rle with new method : 0.5591473579406738 time for calcul the mask position with numpy : 0.03699946403503418 nb_pixel_total : 83972 time to create 1 rle with old method : 0.09642767906188965 time for calcul the mask position with numpy : 0.0365602970123291 nb_pixel_total : 12112 time to create 1 rle with old method : 0.01381063461303711 time for calcul the mask position with numpy : 0.03797292709350586 nb_pixel_total : 196210 time to create 1 rle with new method : 0.5624003410339355 time for calcul the mask position with numpy : 0.034301042556762695 nb_pixel_total : 113672 time to create 1 rle with old method : 0.12761139869689941 time for calcul the mask position with numpy : 0.0348970890045166 nb_pixel_total : 184326 time to create 1 rle with new method : 0.5009791851043701 time for calcul the mask position with numpy : 0.035364627838134766 nb_pixel_total : 28464 time to create 1 rle with old method : 0.032552480697631836 time for calcul the mask position with numpy : 0.03567147254943848 nb_pixel_total : 13691 time to create 1 rle with old method : 0.015771150588989258 time for calcul the mask position with numpy : 0.03841805458068848 nb_pixel_total : 184651 time to create 1 rle with new method : 0.47614502906799316 time for calcul the mask position with numpy : 0.03520989418029785 nb_pixel_total : 13004 time to create 1 rle with old method : 0.014701604843139648 create new chi : 4.5129714012146 time to delete rle : 0.002871274948120117 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 12380 TO DO : save crop sub photo not yet done ! save time : 1.6860594749450684 map_output_result : {1337460268: (0.0, 'Should be the crop_list due to order', 0.0), 1337460266: (0.0, 'Should be the crop_list due to order', 0.0), 1337460216: (0.0, 'Should be the crop_list due to order', 0.0), 1337460214: (0.0, 'Should be the crop_list due to order', 0.0), 1337460213: (0.0, 'Should be the crop_list due to order', 0.0), 1337343071: (0.0, 'Should be the crop_list due to order', 0.0), 1337340805: (0.0, 'Should be the crop_list due to order', 0.0), 1337340804: (0.0, 'Should be the crop_list due to order', 0.0), 1337340803: (0.0, 'Should be the crop_list due to order', 0.0), 1337340771: (0.0, 'Should be the crop_list due to order', 0.0), 1337340566: (0.0, 'Should be the crop_list due to order', 0.0), 1337340560: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1337460268, 1337460266, 1337460216, 1337460214, 1337460213, 1337343071, 1337340805, 1337340804, 1337340803, 1337340771, 1337340566, 1337340560] Looping around the photos to save general results len do output : 12 /1337460268.Didn't retrieve data . /1337460266.Didn't retrieve data . /1337460216.Didn't retrieve data . /1337460214.Didn't retrieve data . /1337460213.Didn't retrieve data . /1337343071.Didn't retrieve data . /1337340805.Didn't retrieve data . /1337340804.Didn't retrieve data . /1337340803.Didn't retrieve data . /1337340771.Didn't retrieve data . /1337340566.Didn't retrieve data . /1337340560.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460268', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460266', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460216', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460214', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460213', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337343071', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340805', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340804', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340803', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340771', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340566', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340560', None, None, None, None, None, '2584394') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.26564812660217285 save_final save missing photos in datou_result : time spend for datou_step_exec : 175.92606568336487 time spend to save output : 0.2662968635559082 total time spend for step 3 : 176.19236254692078 step4:ventilate_hashtags_in_portfolio Fri Feb 14 00:47:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20528872 get user id for portfolio 20528872 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528872 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','background','environnement','papier','flou','mal_croppe','carton','pet_fonce','pehd','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528872 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','background','environnement','papier','flou','mal_croppe','carton','pet_fonce','pehd','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528872 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','background','environnement','papier','flou','mal_croppe','carton','pet_fonce','pehd','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20530396,20530397,20530398,20530399,20530400,20530401,20530402,20530403,20530404,20530405,20530406?tags=pet_clair,metal,background,environnement,papier,flou,mal_croppe,carton,pet_fonce,pehd,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1337460268, 1337460266, 1337460216, 1337460214, 1337460213, 1337343071, 1337340805, 1337340804, 1337340803, 1337340771, 1337340566, 1337340560] Looping around the photos to save general results len do output : 1 /20528872. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460268', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460266', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460216', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460214', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460213', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337343071', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340805', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340804', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340803', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340771', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340566', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340560', None, None, None, None, None, '2584394') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.017926931381225586 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.358393907546997 time spend to save output : 0.018201589584350586 total time spend for step 4 : 2.3765954971313477 step5:final Fri Feb 14 00:47:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1337460268: ('0.17378304379236262',), 1337460266: ('0.17378304379236262',), 1337460216: ('0.17378304379236262',), 1337460214: ('0.17378304379236262',), 1337460213: ('0.17378304379236262',), 1337343071: ('0.17378304379236262',), 1337340805: ('0.17378304379236262',), 1337340804: ('0.17378304379236262',), 1337340803: ('0.17378304379236262',), 1337340771: ('0.17378304379236262',), 1337340566: ('0.17378304379236262',), 1337340560: ('0.17378304379236262',)} new output for save of step final : {1337460268: ('0.17378304379236262',), 1337460266: ('0.17378304379236262',), 1337460216: ('0.17378304379236262',), 1337460214: ('0.17378304379236262',), 1337460213: ('0.17378304379236262',), 1337343071: ('0.17378304379236262',), 1337340805: ('0.17378304379236262',), 1337340804: ('0.17378304379236262',), 1337340803: ('0.17378304379236262',), 1337340771: ('0.17378304379236262',), 1337340566: ('0.17378304379236262',), 1337340560: ('0.17378304379236262',)} [1337460268, 1337460266, 1337460216, 1337460214, 1337460213, 1337343071, 1337340805, 1337340804, 1337340803, 1337340771, 1337340566, 1337340560] Looping around the photos to save general results len do output : 12 /1337460268.Didn't retrieve data . /1337460266.Didn't retrieve data . /1337460216.Didn't retrieve data . /1337460214.Didn't retrieve data . /1337460213.Didn't retrieve data . /1337343071.Didn't retrieve data . /1337340805.Didn't retrieve data . /1337340804.Didn't retrieve data . /1337340803.Didn't retrieve data . /1337340771.Didn't retrieve data . /1337340566.Didn't retrieve data . /1337340560.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460268', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460266', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460216', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460214', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460213', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337343071', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340805', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340804', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340803', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340771', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340566', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340560', None, None, None, None, None, '2584394') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.025206327438354492 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11218667030334473 time spend to save output : 0.025870323181152344 total time spend for step 5 : 0.13805699348449707 step6:blur_detection Fri Feb 14 00:47:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64.jpg resize: (2160, 3264) 1337460268 -3.1735014365406315 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927.jpg resize: (2160, 3264) 1337460266 0.36529568987499117 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46.jpg resize: (2160, 3264) 1337460216 -2.853759404006552 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a.jpg resize: (2160, 3264) 1337460214 -2.3656126419643364 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4.jpg resize: (2160, 3264) 1337460213 -3.6932642576034467 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422.jpg resize: (2160, 3264) 1337343071 -4.024038323094501 treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49.jpg resize: (2160, 3264) 1337340805 -4.299814711206809 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c.jpg resize: (2160, 3264) 1337340804 -6.806592177271678 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed.jpg resize: (2160, 3264) 1337340803 -4.983009416418642 treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747.jpg resize: (2160, 3264) 1337340771 -1.682105148797193 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767.jpg resize: (2160, 3264) 1337340566 -3.431404784365853 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b.jpg resize: (2160, 3264) 1337340560 -4.013226919466265 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042702_0.png resize: (819, 703) 1337471854 -1.9113300225409142 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042689_0.png resize: (195, 200) 1337471855 -3.341403339104686 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042685_0.png resize: (229, 229) 1337471856 -3.3582607723418674 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042684_0.png resize: (101, 108) 1337471857 -1.9595832836319766 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042682_0.png resize: (164, 207) 1337471859 -2.421798168736161 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042680_0.png resize: (396, 421) 1337471860 -3.6098913297324513 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042693_0.png resize: (91, 91) 1337471861 -1.8249532986406316 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042696_0.png resize: (256, 221) 1337471862 -3.7839361529992956 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042700_0.png resize: (102, 99) 1337471863 -1.0747348809016437 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042698_0.png resize: (153, 303) 1337471864 -3.0522705166122255 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042681_0.png resize: (288, 292) 1337471865 -2.681330675230238 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042699_0.png resize: (290, 187) 1337471866 -2.0313967912536026 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042686_0.png resize: (545, 296) 1337471867 -3.4877851073894504 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042695_0.png resize: (325, 204) 1337471868 -4.038857571785244 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042678_0.png resize: (525, 723) 1337471869 -0.8779921000414322 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042697_0.png resize: (113, 122) 1337471870 -3.210532470835685 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042688_0.png resize: (210, 181) 1337471871 -1.0844357329297705 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042704_0.png resize: (605, 618) 1337471872 -0.4027102417521978 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042715_0.png resize: (294, 156) 1337471873 -0.20288291177490392 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042708_0.png resize: (383, 548) 1337471874 -1.691075205953156 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042718_0.png resize: (355, 361) 1337471875 -2.043152555256655 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042716_0.png resize: (176, 162) 1337471876 -0.10675515067008802 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042711_0.png resize: (263, 248) 1337471877 -0.8876888735682338 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042703_0.png resize: (232, 222) 1337471878 -2.17583123155 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042717_0.png resize: (214, 204) 1337471879 -1.8323058015537783 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042706_0.png resize: (433, 157) 1337471880 1.5308151623097643 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042709_0.png resize: (188, 104) 1337471881 -1.8236456596899895 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042721_0.png resize: (402, 645) 1337471882 -2.1730794168608507 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042727_0.png resize: (155, 241) 1337471883 -2.35643289906636 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042735_0.png resize: (351, 150) 1337471884 -2.6210116224987896 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042724_0.png resize: (813, 1397) 1337471885 -1.941815755077633 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042738_0.png resize: (333, 314) 1337471886 -2.01702796885496 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042739_0.png resize: (315, 286) 1337471887 -2.0580172931675293 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042731_0.png resize: (361, 222) 1337471888 -2.7590396742659093 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042726_0.png resize: (458, 474) 1337471889 -3.629223984288824 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042729_0.png resize: (166, 184) 1337471890 -4.480949174064981 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042736_0.png resize: (202, 264) 1337471891 -0.9205074955005326 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042732_0.png resize: (159, 149) 1337471892 -3.052623499646582 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042733_0.png resize: (160, 171) 1337471893 -2.6470421670724087 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042722_0.png resize: (215, 251) 1337471894 -3.8034174733848385 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042728_0.png resize: (270, 150) 1337471895 -2.734376915085807 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042730_0.png resize: (343, 165) 1337471896 -2.375020346628127 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042755_0.png resize: (214, 284) 1337471897 -2.204820371196541 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042756_0.png resize: (267, 588) 1337471898 -1.3713241494231376 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042750_0.png resize: (68, 129) 1337471899 0.9187459927584117 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042742_0.png resize: (176, 365) 1337471900 -0.8345797668167132 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042758_0.png resize: (254, 187) 1337471901 -0.060358539478368216 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042745_0.png resize: (330, 140) 1337471902 -2.392998275504045 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042754_0.png resize: (210, 242) 1337471903 -1.2464982637598079 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042740_0.png resize: (222, 349) 1337471904 -0.8056308026172512 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042747_0.png resize: (94, 138) 1337471905 -2.004026884879582 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042741_0.png resize: (216, 83) 1337471906 -1.721226447969108 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042768_0.png resize: (168, 302) 1337471907 -2.2147889061871666 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042767_0.png resize: (321, 282) 1337471910 -1.7921844752267848 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042759_0.png resize: (234, 165) 1337471911 -2.149799808132703 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042764_0.png resize: (235, 254) 1337471912 -2.5240774793673304 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042761_0.png resize: (195, 137) 1337471913 -1.4410779729970955 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042776_0.png resize: (149, 340) 1337471914 0.08444290928024085 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042791_0.png resize: (176, 167) 1337471915 -1.7046078713518673 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042782_0.png resize: (163, 147) 1337471916 -1.7432678578175445 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042779_0.png resize: (270, 289) 1337471917 -2.614161192835282 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042773_0.png resize: (133, 340) 1337471918 -1.6880324012353716 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042788_0.png resize: (89, 84) 1337471919 -3.754501045471603 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042774_0.png resize: (242, 230) 1337471920 -2.1793859878416524 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042794_0.png resize: (276, 299) 1337471921 -3.501792852946166 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042781_0.png resize: (151, 168) 1337471922 -2.899354627393019 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042777_0.png resize: (107, 212) 1337471923 -3.8620838286940145 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042790_0.png resize: (380, 330) 1337471924 -2.4375760127371957 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042778_0.png resize: (201, 254) 1337471925 -2.9034859182180064 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042793_0.png resize: (446, 301) 1337471926 -2.287952529104327 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042786_0.png resize: (83, 243) 1337471927 -2.2937292312991926 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042789_0.png resize: (376, 403) 1337471928 -3.3202432107531323 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042775_0.png resize: (320, 199) 1337471929 -3.440179027615002 treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042802_0.png resize: (327, 407) 1337471930 -2.4543417183250194 treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042804_0.png resize: (399, 487) 1337471931 -3.9760740411896074 treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042795_0.png resize: (254, 287) 1337471932 -3.5550330564121544 treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042803_0.png resize: (569, 839) 1337471933 -4.3640982076555375 treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042806_0.png resize: (152, 191) 1337471934 -2.2533851339171025 treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042796_0.png resize: (345, 486) 1337471935 -4.39857369553443 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042807_0.png resize: (99, 115) 1337471936 -3.772187900416704 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042828_0.png resize: (140, 164) 1337471937 -4.723307187712609 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042812_0.png resize: (87, 133) 1337471938 -3.520508479612456 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042820_0.png resize: (225, 338) 1337471939 -5.068068405378749 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042824_0.png resize: (376, 154) 1337471940 -4.155055092492581 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042816_0.png resize: (125, 130) 1337471941 -4.30120231945533 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042819_0.png resize: (201, 51) 1337471942 -3.27475039643622 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042829_0.png resize: (325, 307) 1337471943 -4.126633531345785 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042831_0.png resize: (95, 113) 1337471944 -2.242616486087048 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042844_0.png resize: (196, 301) 1337471945 -4.223058315946443 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042847_0.png resize: (166, 323) 1337471946 0.14440757116312322 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042846_0.png resize: (236, 414) 1337471947 -2.8284457692270197 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042838_0.png resize: (238, 92) 1337471949 -1.4712179036371738 treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042851_0.png resize: (236, 251) 1337471950 -2.3456775902381772 treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042856_0.png resize: (224, 183) 1337471951 -1.5020746943704828 treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042853_0.png resize: (155, 183) 1337471952 -0.8339013943095441 treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042857_0.png resize: (203, 255) 1337471953 -2.1111750541997387 treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042855_0.png resize: (125, 225) 1337471954 -2.273603601506107 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042868_0.png resize: (349, 487) 1337471955 -3.065168591926422 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042871_0.png resize: (255, 261) 1337471956 -2.5980084300494495 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042860_0.png resize: (162, 324) 1337471957 -2.4914403911252783 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042864_0.png resize: (113, 116) 1337471958 -2.463659430407987 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042859_0.png resize: (343, 434) 1337471959 -3.6063777122384364 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042861_0.png resize: (239, 121) 1337471960 -3.1944705600008922 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042863_0.png resize: (619, 395) 1337471961 -4.4352320930948945 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042880_0.png resize: (248, 628) 1337471962 -3.3657752359002866 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042882_0.png resize: (80, 91) 1337471963 -0.7718929951983228 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042885_0.png resize: (265, 142) 1337471964 -2.896469429526701 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042878_0.png resize: (587, 608) 1337471965 -2.80718083617766 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042877_0.png resize: (413, 385) 1337471966 -1.8598724195789709 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042881_0.png resize: (655, 620) 1337471967 -1.6710926952048737 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042879_0.png resize: (121, 158) 1337471968 -3.504741468939173 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042883_0.png resize: (159, 152) 1337471969 0.25731045991925183 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042872_0.png resize: (185, 100) 1337471970 -2.7510031552110816 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042874_0.png resize: (198, 79) 1337471971 2.879960815935608 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042691_0.png resize: (764, 397) 1337471999 -2.0735089216329468 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042701_0.png resize: (138, 175) 1337472000 -3.3914639969464897 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042683_0.png resize: (177, 165) 1337472001 -2.13195541757069 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042690_0.png resize: (128, 159) 1337472002 -1.2002626531747225 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042679_0.png resize: (94, 168) 1337472003 -3.2683160107880993 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042712_0.png resize: (432, 473) 1337472004 -0.8559694089550148 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042713_0.png resize: (343, 457) 1337472005 -1.1435754305831034 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042714_0.png resize: (386, 232) 1337472006 -1.5172107038356601 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042707_0.png resize: (866, 519) 1337472007 -0.1470577237809445 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042705_0.png resize: (439, 449) 1337472008 -0.9521781291324768 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042710_0.png resize: (71, 230) 1337472009 -3.5838491395134575 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042720_0.png resize: (139, 212) 1337472010 -2.0442720004419597 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042752_0.png resize: (171, 331) 1337472011 -2.319333591560327 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042743_0.png resize: (245, 282) 1337472012 -0.4595966735413687 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042753_0.png resize: (74, 196) 1337472013 -2.2309550134003553 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042760_0.png resize: (154, 196) 1337472014 -2.5657171517798454 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042780_0.png resize: (284, 316) 1337472015 -3.076610444323665 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042783_0.png resize: (120, 108) 1337472016 -3.265004415089385 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042785_0.png resize: (428, 592) 1337472017 -3.0416053647883894 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042792_0.png resize: (114, 129) 1337472018 -1.711306183224818 treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042797_0.png resize: (359, 623) 1337472019 -2.252671625065068 treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042799_0.png resize: (118, 322) 1337472020 -2.1845106577540365 treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042805_0.png resize: (135, 367) 1337472021 -2.583741672781123 treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042801_0.png resize: (139, 202) 1337472022 -3.63026261667027 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042810_0.png resize: (652, 778) 1337472023 -3.266057294096716 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042818_0.png resize: (286, 305) 1337472024 -5.500147340231808 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042821_0.png resize: (159, 154) 1337472025 -5.1119633114612455 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042808_0.png resize: (456, 673) 1337472026 -4.69466641936217 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042809_0.png resize: (153, 178) 1337472027 -5.224608973066938 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042815_0.png resize: (1000, 748) 1337472028 -4.693437885600067 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042827_0.png resize: (532, 674) 1337472029 -4.209890279244458 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042834_0.png resize: (530, 838) 1337472030 -1.5755796471772958 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042848_0.png resize: (130, 74) 1337472031 -2.0424437750930773 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042833_0.png resize: (118, 149) 1337472032 -3.941631593577637 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042830_0.png resize: (459, 651) 1337472033 -3.1453787103672055 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042849_0.png resize: (383, 607) 1337472034 -2.7185719719883057 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042841_0.png resize: (136, 206) 1337472035 -3.4478340013360644 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042837_0.png resize: (414, 583) 1337472036 -3.5572475452240777 treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042850_0.png resize: (663, 569) 1337472037 -1.499621200749355 treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042852_0.png resize: (105, 123) 1337472038 -1.1519042554103722 treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042854_0.png resize: (118, 133) 1337472039 -1.1815424679100694 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042862_0.png resize: (151, 256) 1337472040 -0.5828223603477343 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042865_0.png resize: (517, 555) 1337472041 -2.8168810772451702 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042869_0.png resize: (459, 623) 1337472042 -2.3622111609643603 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042867_0.png resize: (206, 238) 1337472043 -1.6327543966304945 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042858_0.png resize: (146, 177) 1337472044 -2.3244165474674863 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042873_0.png resize: (533, 469) 1337472045 -1.7522712188783536 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042875_0.png resize: (177, 364) 1337472046 -2.1256103163847264 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042884_0.png resize: (509, 530) 1337472047 -3.005129266039569 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042723_0.png resize: (209, 152) 1337472049 -3.1914298617601697 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042826_0.png resize: (125, 232) 1337472050 -5.1070179467776855 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042811_0.png resize: (188, 200) 1337472051 -4.0103328195892 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042839_0.png resize: (179, 228) 1337472052 -4.523831326414354 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042840_0.png resize: (199, 118) 1337472053 -4.796822108466827 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042842_0.png resize: (190, 213) 1337472054 -3.1367879844667623 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042677_0.png resize: (291, 402) 1337472063 -3.5948065856235587 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042694_0.png resize: (676, 751) 1337472064 -4.095929697827101 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042725_0.png resize: (332, 278) 1337472065 -3.5392429490278934 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042748_0.png resize: (291, 414) 1337472066 -0.5396450358342295 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042744_0.png resize: (292, 227) 1337472067 -2.2089258892958767 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042751_0.png resize: (146, 518) 1337472068 -2.823129807515846 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042757_0.png resize: (405, 470) 1337472069 -3.3532318800696714 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042749_0.png resize: (235, 355) 1337472071 -2.2544518428027494 treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042746_0.png resize: (301, 245) 1337472072 -1.3434396230109482 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042769_0.png resize: (376, 251) 1337472073 -3.4628914755411038 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042765_0.png resize: (316, 564) 1337472074 -3.4859073650422365 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042766_0.png resize: (375, 534) 1337472075 -3.4071696922514225 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042772_0.png resize: (218, 274) 1337472076 -2.652915074177453 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042784_0.png resize: (270, 263) 1337472077 -2.9398553811794867 treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042787_0.png resize: (257, 427) 1337472078 -2.289787347594572 treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042798_0.png resize: (398, 420) 1337472079 -2.1684220338088864 treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042800_0.png resize: (283, 323) 1337472080 -3.9244136987299063 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042814_0.png resize: (388, 162) 1337472081 -5.091943744039983 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042825_0.png resize: (291, 1044) 1337472082 -1.3398199442407068 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042817_0.png resize: (234, 410) 1337472083 -4.397077001847692 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042843_0.png resize: (275, 167) 1337472084 -3.977952598085089 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042832_0.png resize: (209, 360) 1337472085 -2.967421727860062 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042845_0.png resize: (376, 305) 1337472086 -3.487196266079468 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042866_0.png resize: (399, 444) 1337472087 -3.9530372844353563 treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042876_0.png resize: (435, 677) 1337472088 -4.3220638219917085 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042734_0.png resize: (470, 390) 1337472093 -1.9454943525071187 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042763_0.png resize: (400, 377) 1337472094 -3.0157177431926296 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042762_0.png resize: (435, 476) 1337472095 -3.012053903907526 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042813_0.png resize: (141, 217) 1337472096 -3.633392012057208 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042836_0.png resize: (141, 232) 1337472097 -2.575477623617134 treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042835_0.png resize: (942, 760) 1337472098 -3.1586088080180517 treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042870_0.png resize: (614, 535) 1337472099 -2.8651179881013165 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042692_0.png resize: (228, 93) 1337472101 -2.0326473882692926 treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042687_0.png resize: (271, 166) 1337472102 -3.638115617722452 treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042719_0.png resize: (223, 429) 1337472103 -0.637697123082473 treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042737_0.png resize: (465, 376) 1337472104 -2.1008609200648176 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042770_0.png resize: (145, 162) 1337472105 -2.1665944374594117 treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042771_0.png resize: (134, 168) 1337472106 -2.0287308010593086 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042823_0.png resize: (88, 89) 1337472108 -5.249538513497155 treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042822_0.png resize: (157, 114) 1337472109 -4.377884000481396 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 221 time used for this insertion : 0.02459120750427246 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 221 time used for this insertion : 0.06374287605285645 save missing photos in datou_result : time spend for datou_step_exec : 48.40742301940918 time spend to save output : 0.09467840194702148 total time spend for step 6 : 48.5021014213562 step7:brightness Fri Feb 14 00:48:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64.jpg treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927.jpg treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46.jpg treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a.jpg treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4.jpg treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422.jpg treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49.jpg treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c.jpg treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed.jpg treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747.jpg treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767.jpg treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b.jpg treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042702_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042689_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042685_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042684_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042682_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042680_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042693_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042696_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042700_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042698_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042681_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042699_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042686_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042695_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042678_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042697_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042688_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042704_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042715_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042708_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042718_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042716_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042711_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042703_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042717_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042706_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042709_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042721_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042727_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042735_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042724_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042738_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042739_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042731_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042726_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042729_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042736_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042732_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042733_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042722_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042728_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042730_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042755_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042756_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042750_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042742_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042758_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042745_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042754_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042740_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042747_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042741_0.png treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042768_0.png treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042767_0.png treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042759_0.png treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042764_0.png treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042761_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042776_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042791_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042782_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042779_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042773_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042788_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042774_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042794_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042781_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042777_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042790_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042778_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042793_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042786_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042789_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042775_0.png treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042802_0.png treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042804_0.png treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042795_0.png treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042803_0.png treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042806_0.png treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042796_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042807_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042828_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042812_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042820_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042824_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042816_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042819_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042829_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042831_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042844_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042847_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042846_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042838_0.png treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042851_0.png treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042856_0.png treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042853_0.png treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042857_0.png treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042855_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042868_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042871_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042860_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042864_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042859_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042861_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042863_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042880_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042882_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042885_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042878_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042877_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042881_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042879_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042883_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042872_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042874_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042691_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042701_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042683_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042690_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042679_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042712_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042713_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042714_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042707_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042705_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042710_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042720_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042752_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042743_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042753_0.png treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042760_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042780_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042783_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042785_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042792_0.png treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042797_0.png treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042799_0.png treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042805_0.png treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042801_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042810_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042818_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042821_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042808_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042809_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042815_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042827_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042834_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042848_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042833_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042830_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042849_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042841_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042837_0.png treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042850_0.png treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042852_0.png treat image : temp/1739490028_2383612_1337340771_e103367605441ab7599a169693be7747_rle_crop_3674042854_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042862_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042865_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042869_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042867_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042858_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042873_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042875_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042884_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042723_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042826_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042811_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042839_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042840_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042842_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042677_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042694_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042725_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042748_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042744_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042751_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042757_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042749_0.png treat image : temp/1739490028_2383612_1337460214_c068ebfa85a36300f83c59f994837f1a_rle_crop_3674042746_0.png treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042769_0.png treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042765_0.png treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042766_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042772_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042784_0.png treat image : temp/1739490028_2383612_1337343071_c1358be1ce31cd11666b33c886f78422_rle_crop_3674042787_0.png treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042798_0.png treat image : temp/1739490028_2383612_1337340805_82adbff8e8e36ec0feb48d62bd302d49_rle_crop_3674042800_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042814_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042825_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042817_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042843_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042832_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042845_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042866_0.png treat image : temp/1739490028_2383612_1337340560_9b565bd36eff66989ee4ed62772f6c1b_rle_crop_3674042876_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042734_0.png treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042763_0.png treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042762_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042813_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042836_0.png treat image : temp/1739490028_2383612_1337340803_b71a6da04a330213d14d999899195bed_rle_crop_3674042835_0.png treat image : temp/1739490028_2383612_1337340566_17bffac79b41b5f7bfb687656f571767_rle_crop_3674042870_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042692_0.png treat image : temp/1739490028_2383612_1337460268_05640af0ee9725a0529d1d16163c1f64_rle_crop_3674042687_0.png treat image : temp/1739490028_2383612_1337460266_0013f5b64dfc958953998bcaed189927_rle_crop_3674042719_0.png treat image : temp/1739490028_2383612_1337460216_1d434671041e3d37f26e7b5dedf94b46_rle_crop_3674042737_0.png treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042770_0.png treat image : temp/1739490028_2383612_1337460213_2ab4766664870d229e2cfc81f514dcf4_rle_crop_3674042771_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042823_0.png treat image : temp/1739490028_2383612_1337340804_e16f1337e76010c07e0f2c2ca0645b7c_rle_crop_3674042822_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 221 time used for this insertion : 0.04192996025085449 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 221 time used for this insertion : 0.04309892654418945 save missing photos in datou_result : time spend for datou_step_exec : 12.730684995651245 time spend to save output : 0.09102058410644531 total time spend for step 7 : 12.82170557975769 step8:velours_tree Fri Feb 14 00:48:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.2509417533874512 time spend to save output : 5.030632019042969e-05 total time spend for step 8 : 1.2509920597076416 step9:send_mail_cod Fri Feb 14 00:48:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20528872_14-02-2025_00_48_47.pdf 20530396 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205303961739490527 20530397 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205303971739490529 20530398 imagette205303981739490529 20530400 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205304001739490529 20530401 imagette205304011739490530 20530402 imagette205304021739490530 20530403 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205304031739490530 20530404 change filename to text .change filename to text .imagette205304041739490532 20530405 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205304051739490532 20530406 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205304061739490532 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20528872 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20530396,20530397,20530398,20530399,20530400,20530401,20530402,20530403,20530404,20530405,20530406?tags=pet_clair,metal,background,environnement,papier,flou,mal_croppe,carton,pet_fonce,pehd,autre args[1337460268] : ((1337460268, -3.1735014365406315, 492609224), (1337460268, -0.5075167270208863, 501862349), '0.17378304379236262') apple ((1337460268, -3.1735014365406315, 492609224), (1337460268, -0.5075167270208863, 501862349), '0.17378304379236262') We are sending mail with results at report@fotonower.com args[1337460266] : ((1337460266, 0.36529568987499117, 492688767), (1337460266, -0.30191145317371687, 496442774), '0.17378304379236262') apple ((1337460266, 0.36529568987499117, 492688767), (1337460266, -0.30191145317371687, 496442774), '0.17378304379236262') We are sending mail with results at report@fotonower.com args[1337460216] : ((1337460216, -2.853759404006552, 492609224), (1337460216, -0.3389099481297355, 496442774), '0.17378304379236262') apple ((1337460216, -2.853759404006552, 492609224), (1337460216, -0.3389099481297355, 496442774), '0.17378304379236262') We are sending mail with results at report@fotonower.com args[1337460214] : ((1337460214, -2.3656126419643364, 492609224), (1337460214, -0.3437382063594948, 496442774), '0.17378304379236262') apple ((1337460214, -2.3656126419643364, 492609224), (1337460214, -0.3437382063594948, 496442774), '0.17378304379236262') We are sending mail with results at report@fotonower.com args[1337460213] : ((1337460213, -3.6932642576034467, 492609224), (1337460213, -0.24232034169282404, 496442774), '0.17378304379236262') apple ((1337460213, -3.6932642576034467, 492609224), (1337460213, -0.24232034169282404, 496442774), '0.17378304379236262') We are sending mail with results at report@fotonower.com args[1337343071] : ((1337343071, -4.024038323094501, 492609224), (1337343071, -0.2610290482638013, 496442774), '0.17378304379236262') apple ((1337343071, -4.024038323094501, 492609224), (1337343071, -0.2610290482638013, 496442774), '0.17378304379236262') We are sending mail with results at report@fotonower.com args[1337340805] : ((1337340805, -4.299814711206809, 492609224), (1337340805, -0.3974565524760929, 496442774), '0.17378304379236262') apple ((1337340805, -4.299814711206809, 492609224), (1337340805, -0.3974565524760929, 496442774), '0.17378304379236262') We are sending mail with results at report@fotonower.com args[1337340804] : ((1337340804, -6.806592177271678, 492609224), (1337340804, -0.40467135017551453, 496442774), '0.17378304379236262') apple ((1337340804, -6.806592177271678, 492609224), (1337340804, -0.40467135017551453, 496442774), '0.17378304379236262') We are sending mail with results at report@fotonower.com args[1337340803] : ((1337340803, -4.983009416418642, 492609224), (1337340803, -0.42259273570973516, 496442774), '0.17378304379236262') apple ((1337340803, -4.983009416418642, 492609224), (1337340803, -0.42259273570973516, 496442774), '0.17378304379236262') We are sending mail with results at report@fotonower.com args[1337340771] : ((1337340771, -1.682105148797193, 492688767), (1337340771, -0.4738803876897902, 496442774), '0.17378304379236262') apple ((1337340771, -1.682105148797193, 492688767), (1337340771, -0.4738803876897902, 496442774), '0.17378304379236262') We are sending mail with results at report@fotonower.com args[1337340566] : ((1337340566, -3.431404784365853, 492609224), (1337340566, -0.3940775700433982, 496442774), '0.17378304379236262') apple ((1337340566, -3.431404784365853, 492609224), (1337340566, -0.3940775700433982, 496442774), '0.17378304379236262') We are sending mail with results at report@fotonower.com args[1337340560] : ((1337340560, -4.013226919466265, 492609224), (1337340560, -0.23152176386788495, 496442774), '0.17378304379236262') apple ((1337340560, -4.013226919466265, 492609224), (1337340560, -0.23152176386788495, 496442774), '0.17378304379236262') We are sending mail with results at report@fotonower.com refus_total : 0.17378304379236262 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20528872 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1337340560,1337460216,1337340566,1337340771,1337340803,1337340804,1337340805,1337343071,1337460213,1337460214,1337460266,1337460268) Found this number of photos: 12 begin to download photo : 1337340560 begin to download photo : 1337340771 begin to download photo : 1337340805 begin to download photo : 1337460214 download finish for photo 1337460214 begin to download photo : 1337460266 download finish for photo 1337340560 begin to download photo : 1337460216 download finish for photo 1337340771 begin to download photo : 1337340803 download finish for photo 1337340805 begin to download photo : 1337343071 download finish for photo 1337460266 begin to download photo : 1337460268 download finish for photo 1337460216 begin to download photo : 1337340566 download finish for photo 1337340803 begin to download photo : 1337340804 download finish for photo 1337460268 download finish for photo 1337343071 begin to download photo : 1337460213 download finish for photo 1337340566 download finish for photo 1337340804 download finish for photo 1337460213 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528872_14-02-2025_00_48_47.pdf results_Auto_P20528872_14-02-2025_00_48_47.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528872_14-02-2025_00_48_47.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','20528872','results_Auto_P20528872_14-02-2025_00_48_47.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528872_14-02-2025_00_48_47.pdf','pdf','','1.32','0.17378304379236262') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20528872

https://www.fotonower.com/image?json=false&list_photos_id=1337460268
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337460266
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337460216
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337460214
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337460213
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337343071
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337340805
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337340804
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337340803
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337340771
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337340566
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337340560
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 17.38%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/20530396?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/20530397?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/20530400?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20530403?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/20530404?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/20530405?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/20530406?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528872_14-02-2025_00_48_47.pdf.

Lien vers velours :https://www.fotonower.com/velours/20530396,20530397,20530398,20530399,20530400,20530401,20530402,20530403,20530404,20530405,20530406?tags=pet_clair,metal,background,environnement,papier,flou,mal_croppe,carton,pet_fonce,pehd,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 13 Feb 2025 23:48:57 GMT Content-Length: 0 Connection: close X-Message-Id: k5O3vwUQQXu6ftSM0fSpfQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1337460268, 1337460266, 1337460216, 1337460214, 1337460213, 1337343071, 1337340805, 1337340804, 1337340803, 1337340771, 1337340566, 1337340560] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460268', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460266', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460216', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460214', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460213', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337343071', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340805', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340804', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340803', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340771', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340566', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340560', None, None, None, None, None, '2584394') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 1.8901782035827637 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.553375720977783 time spend to save output : 1.8904359340667725 total time spend for step 9 : 11.443811655044556 step10:split_time_score Fri Feb 14 00:48:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 12),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 13022025 20528872 Nombre de photos uploadées : 12 / 23040 (0%) 13022025 20528872 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 13022025 20528872 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006089210510253906 elapsed_time : insert_dashboard_record_day_entry 0.02793121337890625 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528847 order by id desc limit 1 Qualite : 0.14136086604967552 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20503797_13-02-2025_09_15_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20503797 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20503797 AND mptpi.`type`=3594 To do Qualite : 0.14449458458151784 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20503799_13-02-2025_09_01_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20503799 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20503799 AND mptpi.`type`=3594 To do Qualite : 0.07891361257373916 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528860_14-02-2025_00_47_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528860 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528860 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528862 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528869 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528871 order by id desc limit 1 Qualite : 0.17378304379236262 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528872_14-02-2025_00_48_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528872 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528872 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528940 order by id desc limit 1 Qualite : 0.06743200877946215 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528945_14-02-2025_00_17_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528945 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528945 AND mptpi.`type`=3726 To do Qualite : 0.14551669770917627 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528952_14-02-2025_00_32_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528952 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528952 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528954 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'13022025': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1337460268, 1337460266, 1337460216, 1337460214, 1337460213, 1337343071, 1337340805, 1337340804, 1337340803, 1337340771, 1337340566, 1337340560] Looping around the photos to save general results len do output : 1 /20528872Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460268', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460266', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460216', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460214', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337460213', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337343071', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340805', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340804', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340803', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340771', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340566', None, None, None, None, None, '2584394') ('3318', None, None, None, None, None, None, None, '2584394') ('3318', '20528872', '1337340560', None, None, None, None, None, '2584394') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.017352819442749023 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.388269424438477 time spend to save output : 0.01760411262512207 total time spend for step 10 : 5.405873537063599 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 222.50user 193.90system 8:40.16elapsed 80%CPU (0avgtext+0avgdata 6722164maxresident)k 877008inputs+213424outputs (18042major+21487722minor)pagefaults 0swaps