python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1468192 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2597839'] with mtr_portfolio_ids : ['20656300'] and first list_photo_ids : [] new path : /proc/1468192/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 2.2742490768432617 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Feb 18 22:50:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-18 22:50:34.712979: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-18 22:50:34.739042: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-18 22:50:34.740875: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fa520000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-18 22:50:34.740924: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-18 22:50:34.744022: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-18 22:50:34.871702: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xe765300 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-18 22:50:34.871752: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-18 22:50:34.873197: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-18 22:50:34.873611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-18 22:50:34.876658: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-18 22:50:34.879606: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-18 22:50:34.880101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-18 22:50:34.882759: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-18 22:50:34.884178: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-18 22:50:34.889564: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-18 22:50:34.891554: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-18 22:50:34.891646: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-18 22:50:34.892508: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-18 22:50:34.892523: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-18 22:50:34.892532: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-18 22:50:34.893819: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9879 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-18 22:50:35.175230: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-18 22:50:35.175314: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-18 22:50:35.175335: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-18 22:50:35.175354: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-18 22:50:35.175371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-18 22:50:35.175389: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-18 22:50:35.175406: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-18 22:50:35.175424: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-18 22:50:35.176991: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-18 22:50:35.178245: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-18 22:50:35.178283: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-18 22:50:35.178305: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-18 22:50:35.178325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-18 22:50:35.178344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-18 22:50:35.178363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-18 22:50:35.178382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-18 22:50:35.178401: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-18 22:50:35.179966: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-18 22:50:35.179998: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-18 22:50:35.180008: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-18 22:50:35.180017: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-18 22:50:35.181625: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9879 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-18 22:50:46.044496: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-18 22:50:46.635056: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 49 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 64 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 68 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 72 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 55 Detection mask done ! Trying to reset tf kernel 1468659 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0011894702911376953 nb_pixel_total : 27786 time to create 1 rle with old method : 0.03697657585144043 length of segment : 194 time for calcul the mask position with numpy : 0.007572650909423828 nb_pixel_total : 345262 time to create 1 rle with new method : 0.0207827091217041 length of segment : 820 time for calcul the mask position with numpy : 0.001474142074584961 nb_pixel_total : 86689 time to create 1 rle with old method : 0.09957075119018555 length of segment : 388 time for calcul the mask position with numpy : 0.0002257823944091797 nb_pixel_total : 14808 time to create 1 rle with old method : 0.016336679458618164 length of segment : 136 time for calcul the mask position with numpy : 0.00013113021850585938 nb_pixel_total : 5795 time to create 1 rle with old method : 0.007020235061645508 length of segment : 82 time for calcul the mask position with numpy : 0.0052678585052490234 nb_pixel_total : 345634 time to create 1 rle with new method : 0.01997995376586914 length of segment : 747 time for calcul the mask position with numpy : 0.00032830238342285156 nb_pixel_total : 14046 time to create 1 rle with old method : 0.016229867935180664 length of segment : 152 time for calcul the mask position with numpy : 0.00011467933654785156 nb_pixel_total : 3580 time to create 1 rle with old method : 0.004427194595336914 length of segment : 54 time for calcul the mask position with numpy : 0.001409292221069336 nb_pixel_total : 68825 time to create 1 rle with old method : 0.08072996139526367 length of segment : 209 time for calcul the mask position with numpy : 0.0006232261657714844 nb_pixel_total : 22333 time to create 1 rle with old method : 0.025525569915771484 length of segment : 220 time for calcul the mask position with numpy : 0.00026798248291015625 nb_pixel_total : 13241 time to create 1 rle with old method : 0.015830278396606445 length of segment : 87 time for calcul the mask position with numpy : 0.00029206275939941406 nb_pixel_total : 12532 time to create 1 rle with old method : 0.014945745468139648 length of segment : 208 time for calcul the mask position with numpy : 0.003307342529296875 nb_pixel_total : 221278 time to create 1 rle with new method : 0.009426593780517578 length of segment : 510 time for calcul the mask position with numpy : 0.0014274120330810547 nb_pixel_total : 71231 time to create 1 rle with old method : 0.08097290992736816 length of segment : 459 time for calcul the mask position with numpy : 0.0037839412689208984 nb_pixel_total : 201305 time to create 1 rle with new method : 0.01271820068359375 length of segment : 568 time for calcul the mask position with numpy : 0.0015232563018798828 nb_pixel_total : 95303 time to create 1 rle with old method : 0.10561990737915039 length of segment : 537 time for calcul the mask position with numpy : 0.0009348392486572266 nb_pixel_total : 34799 time to create 1 rle with old method : 0.0401918888092041 length of segment : 254 time for calcul the mask position with numpy : 0.0002346038818359375 nb_pixel_total : 12085 time to create 1 rle with old method : 0.013675451278686523 length of segment : 129 time for calcul the mask position with numpy : 0.00013637542724609375 nb_pixel_total : 3220 time to create 1 rle with old method : 0.0041773319244384766 length of segment : 121 time for calcul the mask position with numpy : 0.0002982616424560547 nb_pixel_total : 14231 time to create 1 rle with old method : 0.016448974609375 length of segment : 95 time for calcul the mask position with numpy : 0.00040650367736816406 nb_pixel_total : 22740 time to create 1 rle with old method : 0.025486469268798828 length of segment : 262 time for calcul the mask position with numpy : 0.0005242824554443359 nb_pixel_total : 28217 time to create 1 rle with old method : 0.035399436950683594 length of segment : 242 time for calcul the mask position with numpy : 0.0013937950134277344 nb_pixel_total : 90122 time to create 1 rle with old method : 0.10093855857849121 length of segment : 423 time for calcul the mask position with numpy : 0.0009407997131347656 nb_pixel_total : 22859 time to create 1 rle with old method : 0.027798891067504883 length of segment : 216 time for calcul the mask position with numpy : 0.0008282661437988281 nb_pixel_total : 16086 time to create 1 rle with old method : 0.018647193908691406 length of segment : 166 time for calcul the mask position with numpy : 0.0007176399230957031 nb_pixel_total : 13354 time to create 1 rle with old method : 0.01561284065246582 length of segment : 138 time for calcul the mask position with numpy : 0.01285696029663086 nb_pixel_total : 222624 time to create 1 rle with new method : 0.01565098762512207 length of segment : 698 time for calcul the mask position with numpy : 0.009990453720092773 nb_pixel_total : 189326 time to create 1 rle with new method : 0.015401601791381836 length of segment : 569 time for calcul the mask position with numpy : 0.002112865447998047 nb_pixel_total : 74997 time to create 1 rle with old method : 0.08645510673522949 length of segment : 416 time for calcul the mask position with numpy : 0.005937337875366211 nb_pixel_total : 182000 time to create 1 rle with new method : 0.01693868637084961 length of segment : 514 time for calcul the mask position with numpy : 0.0005986690521240234 nb_pixel_total : 9378 time to create 1 rle with old method : 0.011533021926879883 length of segment : 131 time for calcul the mask position with numpy : 0.0011088848114013672 nb_pixel_total : 23516 time to create 1 rle with old method : 0.026781558990478516 length of segment : 173 time for calcul the mask position with numpy : 0.004434823989868164 nb_pixel_total : 100626 time to create 1 rle with old method : 0.11670494079589844 length of segment : 282 time for calcul the mask position with numpy : 0.0003287792205810547 nb_pixel_total : 5692 time to create 1 rle with old method : 0.006864309310913086 length of segment : 82 time for calcul the mask position with numpy : 0.0007028579711914062 nb_pixel_total : 15264 time to create 1 rle with old method : 0.017111778259277344 length of segment : 209 time for calcul the mask position with numpy : 0.003335237503051758 nb_pixel_total : 78717 time to create 1 rle with old method : 0.08790707588195801 length of segment : 328 time for calcul the mask position with numpy : 0.002290010452270508 nb_pixel_total : 36372 time to create 1 rle with old method : 0.04060816764831543 length of segment : 342 time for calcul the mask position with numpy : 0.0005328655242919922 nb_pixel_total : 9528 time to create 1 rle with old method : 0.011147260665893555 length of segment : 126 time for calcul the mask position with numpy : 0.006503582000732422 nb_pixel_total : 180573 time to create 1 rle with new method : 0.010161876678466797 length of segment : 584 time for calcul the mask position with numpy : 0.006566286087036133 nb_pixel_total : 157599 time to create 1 rle with new method : 0.008532047271728516 length of segment : 497 time for calcul the mask position with numpy : 0.002754688262939453 nb_pixel_total : 81686 time to create 1 rle with old method : 0.09060454368591309 length of segment : 735 time for calcul the mask position with numpy : 0.002188444137573242 nb_pixel_total : 60697 time to create 1 rle with old method : 0.06690573692321777 length of segment : 294 time for calcul the mask position with numpy : 0.0005245208740234375 nb_pixel_total : 9618 time to create 1 rle with old method : 0.010595083236694336 length of segment : 108 time for calcul the mask position with numpy : 0.0006105899810791016 nb_pixel_total : 13662 time to create 1 rle with old method : 0.018117427825927734 length of segment : 123 time for calcul the mask position with numpy : 0.0002224445343017578 nb_pixel_total : 13196 time to create 1 rle with old method : 0.014753103256225586 length of segment : 137 time for calcul the mask position with numpy : 0.0030448436737060547 nb_pixel_total : 60900 time to create 1 rle with old method : 0.0684363842010498 length of segment : 380 time for calcul the mask position with numpy : 0.0017728805541992188 nb_pixel_total : 45488 time to create 1 rle with old method : 0.052641868591308594 length of segment : 266 time for calcul the mask position with numpy : 0.001318216323852539 nb_pixel_total : 60342 time to create 1 rle with old method : 0.06657266616821289 length of segment : 276 time for calcul the mask position with numpy : 0.0006005764007568359 nb_pixel_total : 22150 time to create 1 rle with old method : 0.02523350715637207 length of segment : 190 time for calcul the mask position with numpy : 0.011528730392456055 nb_pixel_total : 229941 time to create 1 rle with new method : 0.013015031814575195 length of segment : 585 time for calcul the mask position with numpy : 0.0010018348693847656 nb_pixel_total : 21036 time to create 1 rle with old method : 0.023566007614135742 length of segment : 161 time for calcul the mask position with numpy : 0.00262451171875 nb_pixel_total : 42858 time to create 1 rle with old method : 0.04918956756591797 length of segment : 325 time for calcul the mask position with numpy : 0.0006182193756103516 nb_pixel_total : 12249 time to create 1 rle with old method : 0.014401435852050781 length of segment : 101 time for calcul the mask position with numpy : 0.0011534690856933594 nb_pixel_total : 18564 time to create 1 rle with old method : 0.021736860275268555 length of segment : 211 time for calcul the mask position with numpy : 0.0033867359161376953 nb_pixel_total : 36169 time to create 1 rle with old method : 0.04230856895446777 length of segment : 386 time for calcul the mask position with numpy : 0.0009758472442626953 nb_pixel_total : 13906 time to create 1 rle with old method : 0.0161283016204834 length of segment : 153 time for calcul the mask position with numpy : 0.0027081966400146484 nb_pixel_total : 50345 time to create 1 rle with old method : 0.05682992935180664 length of segment : 427 time for calcul the mask position with numpy : 0.0004355907440185547 nb_pixel_total : 7292 time to create 1 rle with old method : 0.008403778076171875 length of segment : 100 time for calcul the mask position with numpy : 0.0012483596801757812 nb_pixel_total : 20870 time to create 1 rle with old method : 0.024611949920654297 length of segment : 146 time for calcul the mask position with numpy : 0.0013756752014160156 nb_pixel_total : 21959 time to create 1 rle with old method : 0.024939537048339844 length of segment : 331 time for calcul the mask position with numpy : 0.0006661415100097656 nb_pixel_total : 10465 time to create 1 rle with old method : 0.012107133865356445 length of segment : 139 time for calcul the mask position with numpy : 0.001644134521484375 nb_pixel_total : 19796 time to create 1 rle with old method : 0.023045063018798828 length of segment : 195 time for calcul the mask position with numpy : 0.002605915069580078 nb_pixel_total : 44041 time to create 1 rle with old method : 0.05011892318725586 length of segment : 362 time for calcul the mask position with numpy : 0.0005948543548583984 nb_pixel_total : 12568 time to create 1 rle with old method : 0.015513420104980469 length of segment : 145 time for calcul the mask position with numpy : 0.0011234283447265625 nb_pixel_total : 16452 time to create 1 rle with old method : 0.018778562545776367 length of segment : 152 time for calcul the mask position with numpy : 0.0008175373077392578 nb_pixel_total : 14751 time to create 1 rle with old method : 0.017058134078979492 length of segment : 138 time for calcul the mask position with numpy : 0.006361961364746094 nb_pixel_total : 78072 time to create 1 rle with old method : 0.08351635932922363 length of segment : 524 time for calcul the mask position with numpy : 0.0009577274322509766 nb_pixel_total : 15328 time to create 1 rle with old method : 0.020099163055419922 length of segment : 138 time for calcul the mask position with numpy : 0.0004734992980957031 nb_pixel_total : 8460 time to create 1 rle with old method : 0.010352373123168945 length of segment : 93 time for calcul the mask position with numpy : 0.002641916275024414 nb_pixel_total : 47465 time to create 1 rle with old method : 0.05486583709716797 length of segment : 462 time for calcul the mask position with numpy : 0.0015954971313476562 nb_pixel_total : 42447 time to create 1 rle with old method : 0.0479891300201416 length of segment : 342 time for calcul the mask position with numpy : 0.0007872581481933594 nb_pixel_total : 11673 time to create 1 rle with old method : 0.013945817947387695 length of segment : 157 time for calcul the mask position with numpy : 0.0006566047668457031 nb_pixel_total : 14125 time to create 1 rle with old method : 0.016852617263793945 length of segment : 136 time for calcul the mask position with numpy : 0.0005893707275390625 nb_pixel_total : 10213 time to create 1 rle with old method : 0.011562824249267578 length of segment : 192 time for calcul the mask position with numpy : 0.002114534378051758 nb_pixel_total : 42185 time to create 1 rle with old method : 0.04591965675354004 length of segment : 328 time for calcul the mask position with numpy : 0.0011246204376220703 nb_pixel_total : 12885 time to create 1 rle with old method : 0.014469385147094727 length of segment : 218 time for calcul the mask position with numpy : 0.0023615360260009766 nb_pixel_total : 35349 time to create 1 rle with old method : 0.039972782135009766 length of segment : 331 time for calcul the mask position with numpy : 0.00040078163146972656 nb_pixel_total : 8698 time to create 1 rle with old method : 0.010431051254272461 length of segment : 86 time for calcul the mask position with numpy : 0.001027822494506836 nb_pixel_total : 31784 time to create 1 rle with old method : 0.035530805587768555 length of segment : 242 time for calcul the mask position with numpy : 0.00036716461181640625 nb_pixel_total : 12552 time to create 1 rle with old method : 0.01481175422668457 length of segment : 153 time for calcul the mask position with numpy : 0.0005669593811035156 nb_pixel_total : 8916 time to create 1 rle with old method : 0.010731935501098633 length of segment : 140 time for calcul the mask position with numpy : 0.002571582794189453 nb_pixel_total : 90747 time to create 1 rle with old method : 0.0974416732788086 length of segment : 515 time for calcul the mask position with numpy : 0.0036149024963378906 nb_pixel_total : 133798 time to create 1 rle with old method : 0.1433401107788086 length of segment : 435 time for calcul the mask position with numpy : 0.0007290840148925781 nb_pixel_total : 18854 time to create 1 rle with old method : 0.02057671546936035 length of segment : 194 time for calcul the mask position with numpy : 0.003788471221923828 nb_pixel_total : 142995 time to create 1 rle with old method : 0.15307235717773438 length of segment : 495 time for calcul the mask position with numpy : 0.0012307167053222656 nb_pixel_total : 15152 time to create 1 rle with old method : 0.017229080200195312 length of segment : 359 time for calcul the mask position with numpy : 0.00024199485778808594 nb_pixel_total : 10476 time to create 1 rle with old method : 0.012128353118896484 length of segment : 116 time for calcul the mask position with numpy : 0.0018911361694335938 nb_pixel_total : 48019 time to create 1 rle with old method : 0.051966190338134766 length of segment : 293 time for calcul the mask position with numpy : 0.002672433853149414 nb_pixel_total : 108894 time to create 1 rle with old method : 0.11568236351013184 length of segment : 431 time for calcul the mask position with numpy : 0.0010368824005126953 nb_pixel_total : 32566 time to create 1 rle with old method : 0.03528332710266113 length of segment : 316 time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 8022 time to create 1 rle with old method : 0.008860588073730469 length of segment : 96 time for calcul the mask position with numpy : 0.0038671493530273438 nb_pixel_total : 140317 time to create 1 rle with old method : 0.14962506294250488 length of segment : 537 time for calcul the mask position with numpy : 0.0004277229309082031 nb_pixel_total : 14997 time to create 1 rle with old method : 0.01657700538635254 length of segment : 227 time for calcul the mask position with numpy : 0.00036787986755371094 nb_pixel_total : 6400 time to create 1 rle with old method : 0.007681369781494141 length of segment : 93 time for calcul the mask position with numpy : 0.008154630661010742 nb_pixel_total : 220133 time to create 1 rle with new method : 0.01489114761352539 length of segment : 617 time for calcul the mask position with numpy : 0.0011250972747802734 nb_pixel_total : 37742 time to create 1 rle with old method : 0.03916645050048828 length of segment : 359 time for calcul the mask position with numpy : 0.0019443035125732422 nb_pixel_total : 82771 time to create 1 rle with old method : 0.08900141716003418 length of segment : 367 time for calcul the mask position with numpy : 0.0002770423889160156 nb_pixel_total : 6785 time to create 1 rle with old method : 0.00806736946105957 length of segment : 97 time for calcul the mask position with numpy : 0.0008382797241210938 nb_pixel_total : 21648 time to create 1 rle with old method : 0.023752927780151367 length of segment : 241 time for calcul the mask position with numpy : 0.001310110092163086 nb_pixel_total : 42813 time to create 1 rle with old method : 0.04716849327087402 length of segment : 219 time for calcul the mask position with numpy : 0.00041961669921875 nb_pixel_total : 10823 time to create 1 rle with old method : 0.01220560073852539 length of segment : 122 time for calcul the mask position with numpy : 0.0005376338958740234 nb_pixel_total : 19202 time to create 1 rle with old method : 0.021880626678466797 length of segment : 202 time for calcul the mask position with numpy : 0.0002155303955078125 nb_pixel_total : 6103 time to create 1 rle with old method : 0.007136106491088867 length of segment : 66 time for calcul the mask position with numpy : 0.0020227432250976562 nb_pixel_total : 76852 time to create 1 rle with old method : 0.08112788200378418 length of segment : 366 time for calcul the mask position with numpy : 0.00028896331787109375 nb_pixel_total : 6434 time to create 1 rle with old method : 0.007242679595947266 length of segment : 122 time for calcul the mask position with numpy : 0.003510713577270508 nb_pixel_total : 168373 time to create 1 rle with new method : 0.006294727325439453 length of segment : 462 time for calcul the mask position with numpy : 0.0010356903076171875 nb_pixel_total : 45132 time to create 1 rle with old method : 0.04711556434631348 length of segment : 273 time for calcul the mask position with numpy : 0.0006222724914550781 nb_pixel_total : 22108 time to create 1 rle with old method : 0.02468705177307129 length of segment : 159 time for calcul the mask position with numpy : 0.0015745162963867188 nb_pixel_total : 29685 time to create 1 rle with old method : 0.03306007385253906 length of segment : 229 time for calcul the mask position with numpy : 0.002026081085205078 nb_pixel_total : 50375 time to create 1 rle with old method : 0.05564093589782715 length of segment : 237 time for calcul the mask position with numpy : 0.0007059574127197266 nb_pixel_total : 10506 time to create 1 rle with old method : 0.01286768913269043 length of segment : 142 time for calcul the mask position with numpy : 0.0006456375122070312 nb_pixel_total : 15465 time to create 1 rle with old method : 0.018156766891479492 length of segment : 159 time for calcul the mask position with numpy : 0.0015616416931152344 nb_pixel_total : 34028 time to create 1 rle with old method : 0.038643598556518555 length of segment : 212 time for calcul the mask position with numpy : 0.0016341209411621094 nb_pixel_total : 40914 time to create 1 rle with old method : 0.04542708396911621 length of segment : 273 time for calcul the mask position with numpy : 0.0025289058685302734 nb_pixel_total : 52349 time to create 1 rle with old method : 0.05852365493774414 length of segment : 507 time for calcul the mask position with numpy : 0.0014810562133789062 nb_pixel_total : 29439 time to create 1 rle with old method : 0.03357338905334473 length of segment : 297 time for calcul the mask position with numpy : 0.0017566680908203125 nb_pixel_total : 52340 time to create 1 rle with old method : 0.05818891525268555 length of segment : 446 time for calcul the mask position with numpy : 0.00046944618225097656 nb_pixel_total : 8956 time to create 1 rle with old method : 0.010770320892333984 length of segment : 197 time for calcul the mask position with numpy : 0.0019221305847167969 nb_pixel_total : 44743 time to create 1 rle with old method : 0.051514625549316406 length of segment : 293 time for calcul the mask position with numpy : 0.0053255558013916016 nb_pixel_total : 192367 time to create 1 rle with new method : 0.0063076019287109375 length of segment : 441 time for calcul the mask position with numpy : 0.0002422332763671875 nb_pixel_total : 3434 time to create 1 rle with old method : 0.004373073577880859 length of segment : 67 time for calcul the mask position with numpy : 0.0011472702026367188 nb_pixel_total : 33191 time to create 1 rle with old method : 0.03666234016418457 length of segment : 192 time for calcul the mask position with numpy : 0.0017325878143310547 nb_pixel_total : 35635 time to create 1 rle with old method : 0.03827095031738281 length of segment : 204 time for calcul the mask position with numpy : 0.000978708267211914 nb_pixel_total : 17933 time to create 1 rle with old method : 0.01987743377685547 length of segment : 147 time for calcul the mask position with numpy : 0.0014989376068115234 nb_pixel_total : 30049 time to create 1 rle with old method : 0.033821821212768555 length of segment : 254 time for calcul the mask position with numpy : 0.0019736289978027344 nb_pixel_total : 30543 time to create 1 rle with old method : 0.033069610595703125 length of segment : 239 time for calcul the mask position with numpy : 0.002808809280395508 nb_pixel_total : 56994 time to create 1 rle with old method : 0.06276059150695801 length of segment : 341 time for calcul the mask position with numpy : 0.0005450248718261719 nb_pixel_total : 9014 time to create 1 rle with old method : 0.010495901107788086 length of segment : 126 time for calcul the mask position with numpy : 0.0026662349700927734 nb_pixel_total : 44642 time to create 1 rle with old method : 0.04828524589538574 length of segment : 431 time for calcul the mask position with numpy : 0.0002129077911376953 nb_pixel_total : 1726 time to create 1 rle with old method : 0.0020291805267333984 length of segment : 59 time for calcul the mask position with numpy : 0.0017695426940917969 nb_pixel_total : 26745 time to create 1 rle with old method : 0.030353546142578125 length of segment : 229 time for calcul the mask position with numpy : 0.0003781318664550781 nb_pixel_total : 6520 time to create 1 rle with old method : 0.007726192474365234 length of segment : 139 time for calcul the mask position with numpy : 0.002071857452392578 nb_pixel_total : 32696 time to create 1 rle with old method : 0.03540658950805664 length of segment : 244 time for calcul the mask position with numpy : 0.0006008148193359375 nb_pixel_total : 10884 time to create 1 rle with old method : 0.01188039779663086 length of segment : 90 time for calcul the mask position with numpy : 0.0007617473602294922 nb_pixel_total : 13813 time to create 1 rle with old method : 0.016320228576660156 length of segment : 109 time for calcul the mask position with numpy : 0.0008997917175292969 nb_pixel_total : 17249 time to create 1 rle with old method : 0.019403934478759766 length of segment : 116 time for calcul the mask position with numpy : 0.001607656478881836 nb_pixel_total : 28183 time to create 1 rle with old method : 0.03214240074157715 length of segment : 278 time for calcul the mask position with numpy : 0.0011379718780517578 nb_pixel_total : 17702 time to create 1 rle with old method : 0.019696474075317383 length of segment : 209 time for calcul the mask position with numpy : 0.0010221004486083984 nb_pixel_total : 17667 time to create 1 rle with old method : 0.020163297653198242 length of segment : 141 time for calcul the mask position with numpy : 0.0008552074432373047 nb_pixel_total : 9190 time to create 1 rle with old method : 0.010279178619384766 length of segment : 188 time for calcul the mask position with numpy : 0.006104469299316406 nb_pixel_total : 113599 time to create 1 rle with old method : 0.12049150466918945 length of segment : 483 time for calcul the mask position with numpy : 0.002375364303588867 nb_pixel_total : 58443 time to create 1 rle with old method : 0.06256866455078125 length of segment : 261 time for calcul the mask position with numpy : 0.00806427001953125 nb_pixel_total : 121686 time to create 1 rle with old method : 0.12881135940551758 length of segment : 460 time for calcul the mask position with numpy : 0.00015878677368164062 nb_pixel_total : 3055 time to create 1 rle with old method : 0.003509521484375 length of segment : 64 time for calcul the mask position with numpy : 0.0005235671997070312 nb_pixel_total : 10644 time to create 1 rle with old method : 0.012360811233520508 length of segment : 117 time for calcul the mask position with numpy : 0.0009582042694091797 nb_pixel_total : 17244 time to create 1 rle with old method : 0.020127296447753906 length of segment : 150 time for calcul the mask position with numpy : 0.0004100799560546875 nb_pixel_total : 9587 time to create 1 rle with old method : 0.010903120040893555 length of segment : 143 time for calcul the mask position with numpy : 0.0010950565338134766 nb_pixel_total : 16797 time to create 1 rle with old method : 0.01864027976989746 length of segment : 157 time for calcul the mask position with numpy : 0.0006093978881835938 nb_pixel_total : 11188 time to create 1 rle with old method : 0.012590885162353516 length of segment : 101 time for calcul the mask position with numpy : 0.001821756362915039 nb_pixel_total : 32614 time to create 1 rle with old method : 0.03621792793273926 length of segment : 321 time for calcul the mask position with numpy : 0.0007803440093994141 nb_pixel_total : 15611 time to create 1 rle with old method : 0.018353700637817383 length of segment : 187 time for calcul the mask position with numpy : 0.0003523826599121094 nb_pixel_total : 7101 time to create 1 rle with old method : 0.008467435836791992 length of segment : 89 time for calcul the mask position with numpy : 0.001329660415649414 nb_pixel_total : 15691 time to create 1 rle with old method : 0.018137216567993164 length of segment : 243 time for calcul the mask position with numpy : 0.0006120204925537109 nb_pixel_total : 16986 time to create 1 rle with old method : 0.019571304321289062 length of segment : 124 time for calcul the mask position with numpy : 0.00025343894958496094 nb_pixel_total : 3305 time to create 1 rle with old method : 0.0039441585540771484 length of segment : 63 time for calcul the mask position with numpy : 0.0008180141448974609 nb_pixel_total : 22557 time to create 1 rle with old method : 0.026010751724243164 length of segment : 224 time for calcul the mask position with numpy : 0.0010416507720947266 nb_pixel_total : 15393 time to create 1 rle with old method : 0.017418384552001953 length of segment : 162 time for calcul the mask position with numpy : 0.0014722347259521484 nb_pixel_total : 23680 time to create 1 rle with old method : 0.02689957618713379 length of segment : 167 time for calcul the mask position with numpy : 0.0012042522430419922 nb_pixel_total : 16059 time to create 1 rle with old method : 0.018121957778930664 length of segment : 203 time for calcul the mask position with numpy : 0.0018842220306396484 nb_pixel_total : 30807 time to create 1 rle with old method : 0.03475069999694824 length of segment : 186 time for calcul the mask position with numpy : 0.001064300537109375 nb_pixel_total : 20864 time to create 1 rle with old method : 0.023169755935668945 length of segment : 134 time for calcul the mask position with numpy : 0.0009665489196777344 nb_pixel_total : 17131 time to create 1 rle with old method : 0.019272804260253906 length of segment : 134 time for calcul the mask position with numpy : 0.0014972686767578125 nb_pixel_total : 19888 time to create 1 rle with old method : 0.022663354873657227 length of segment : 181 time for calcul the mask position with numpy : 0.0022597312927246094 nb_pixel_total : 34425 time to create 1 rle with old method : 0.0368199348449707 length of segment : 333 time for calcul the mask position with numpy : 0.000621795654296875 nb_pixel_total : 9942 time to create 1 rle with old method : 0.010996341705322266 length of segment : 115 time for calcul the mask position with numpy : 0.0017619132995605469 nb_pixel_total : 26654 time to create 1 rle with old method : 0.029332876205444336 length of segment : 203 time for calcul the mask position with numpy : 0.0011653900146484375 nb_pixel_total : 19175 time to create 1 rle with old method : 0.020926475524902344 length of segment : 292 time for calcul the mask position with numpy : 0.0018267631530761719 nb_pixel_total : 25842 time to create 1 rle with old method : 0.027647018432617188 length of segment : 193 time for calcul the mask position with numpy : 0.0026345252990722656 nb_pixel_total : 42046 time to create 1 rle with old method : 0.04683041572570801 length of segment : 240 time for calcul the mask position with numpy : 0.001116037368774414 nb_pixel_total : 20654 time to create 1 rle with old method : 0.024658679962158203 length of segment : 191 time for calcul the mask position with numpy : 0.0014507770538330078 nb_pixel_total : 22838 time to create 1 rle with old method : 0.026314258575439453 length of segment : 295 time for calcul the mask position with numpy : 0.0007510185241699219 nb_pixel_total : 6420 time to create 1 rle with old method : 0.007895469665527344 length of segment : 172 time for calcul the mask position with numpy : 0.0010237693786621094 nb_pixel_total : 12398 time to create 1 rle with old method : 0.014772653579711914 length of segment : 160 time for calcul the mask position with numpy : 0.001005411148071289 nb_pixel_total : 11582 time to create 1 rle with old method : 0.01377248764038086 length of segment : 212 time for calcul the mask position with numpy : 0.0006310939788818359 nb_pixel_total : 9965 time to create 1 rle with old method : 0.01215052604675293 length of segment : 117 time for calcul the mask position with numpy : 0.0014390945434570312 nb_pixel_total : 14154 time to create 1 rle with old method : 0.01698017120361328 length of segment : 181 time for calcul the mask position with numpy : 0.0010166168212890625 nb_pixel_total : 16761 time to create 1 rle with old method : 0.019767045974731445 length of segment : 148 time for calcul the mask position with numpy : 0.0016260147094726562 nb_pixel_total : 20529 time to create 1 rle with old method : 0.023773193359375 length of segment : 212 time for calcul the mask position with numpy : 0.000194549560546875 nb_pixel_total : 8409 time to create 1 rle with old method : 0.009768962860107422 length of segment : 85 time for calcul the mask position with numpy : 0.0013947486877441406 nb_pixel_total : 19988 time to create 1 rle with old method : 0.02298116683959961 length of segment : 234 time for calcul the mask position with numpy : 0.00024628639221191406 nb_pixel_total : 5242 time to create 1 rle with old method : 0.006224155426025391 length of segment : 129 time for calcul the mask position with numpy : 0.0012755393981933594 nb_pixel_total : 15840 time to create 1 rle with old method : 0.018296003341674805 length of segment : 200 time for calcul the mask position with numpy : 0.0003802776336669922 nb_pixel_total : 6236 time to create 1 rle with old method : 0.0078122615814208984 length of segment : 67 time for calcul the mask position with numpy : 0.0007605552673339844 nb_pixel_total : 15135 time to create 1 rle with old method : 0.017750263214111328 length of segment : 134 time for calcul the mask position with numpy : 0.0008552074432373047 nb_pixel_total : 17765 time to create 1 rle with old method : 0.020888805389404297 length of segment : 119 time for calcul the mask position with numpy : 0.0006585121154785156 nb_pixel_total : 9727 time to create 1 rle with old method : 0.011770248413085938 length of segment : 130 time for calcul the mask position with numpy : 0.0017123222351074219 nb_pixel_total : 30717 time to create 1 rle with old method : 0.03553414344787598 length of segment : 160 time for calcul the mask position with numpy : 0.0004241466522216797 nb_pixel_total : 6983 time to create 1 rle with old method : 0.008536577224731445 length of segment : 90 time for calcul the mask position with numpy : 0.0007884502410888672 nb_pixel_total : 12603 time to create 1 rle with old method : 0.014670372009277344 length of segment : 139 time for calcul the mask position with numpy : 0.001291513442993164 nb_pixel_total : 21979 time to create 1 rle with old method : 0.02405524253845215 length of segment : 232 time for calcul the mask position with numpy : 0.0007026195526123047 nb_pixel_total : 20423 time to create 1 rle with old method : 0.022436141967773438 length of segment : 155 time for calcul the mask position with numpy : 0.0024390220642089844 nb_pixel_total : 48843 time to create 1 rle with old method : 0.05584120750427246 length of segment : 255 time for calcul the mask position with numpy : 0.0005891323089599609 nb_pixel_total : 11295 time to create 1 rle with old method : 0.018570661544799805 length of segment : 138 time for calcul the mask position with numpy : 0.0016794204711914062 nb_pixel_total : 21684 time to create 1 rle with old method : 0.03532218933105469 length of segment : 161 time for calcul the mask position with numpy : 0.0008757114410400391 nb_pixel_total : 16206 time to create 1 rle with old method : 0.018672704696655273 length of segment : 118 time for calcul the mask position with numpy : 0.0014274120330810547 nb_pixel_total : 23034 time to create 1 rle with old method : 0.027235746383666992 length of segment : 175 time for calcul the mask position with numpy : 0.001180887222290039 nb_pixel_total : 19964 time to create 1 rle with old method : 0.02325272560119629 length of segment : 204 time for calcul the mask position with numpy : 0.0009567737579345703 nb_pixel_total : 11835 time to create 1 rle with old method : 0.014129877090454102 length of segment : 145 time for calcul the mask position with numpy : 0.00032401084899902344 nb_pixel_total : 4908 time to create 1 rle with old method : 0.005963802337646484 length of segment : 72 time for calcul the mask position with numpy : 0.0014541149139404297 nb_pixel_total : 34421 time to create 1 rle with old method : 0.03812766075134277 length of segment : 226 time for calcul the mask position with numpy : 0.0005340576171875 nb_pixel_total : 6543 time to create 1 rle with old method : 0.008017539978027344 length of segment : 61 time for calcul the mask position with numpy : 0.0010881423950195312 nb_pixel_total : 22246 time to create 1 rle with old method : 0.025501489639282227 length of segment : 234 time for calcul the mask position with numpy : 0.0019495487213134766 nb_pixel_total : 32664 time to create 1 rle with old method : 0.03744077682495117 length of segment : 181 time for calcul the mask position with numpy : 0.0004298686981201172 nb_pixel_total : 3843 time to create 1 rle with old method : 0.00457453727722168 length of segment : 73 time for calcul the mask position with numpy : 0.0009605884552001953 nb_pixel_total : 16352 time to create 1 rle with old method : 0.018672466278076172 length of segment : 211 time for calcul the mask position with numpy : 0.00047779083251953125 nb_pixel_total : 9897 time to create 1 rle with old method : 0.011108160018920898 length of segment : 111 time for calcul the mask position with numpy : 0.0017595291137695312 nb_pixel_total : 35339 time to create 1 rle with old method : 0.039180755615234375 length of segment : 281 time for calcul the mask position with numpy : 0.0017921924591064453 nb_pixel_total : 33353 time to create 1 rle with old method : 0.03601884841918945 length of segment : 323 time for calcul the mask position with numpy : 0.0011916160583496094 nb_pixel_total : 18938 time to create 1 rle with old method : 0.021033048629760742 length of segment : 230 time for calcul the mask position with numpy : 0.028038740158081055 nb_pixel_total : 410346 time to create 1 rle with new method : 0.04010176658630371 length of segment : 1110 time for calcul the mask position with numpy : 0.003565073013305664 nb_pixel_total : 109842 time to create 1 rle with old method : 0.12558412551879883 length of segment : 766 time for calcul the mask position with numpy : 0.0004341602325439453 nb_pixel_total : 10506 time to create 1 rle with old method : 0.011794090270996094 length of segment : 108 time for calcul the mask position with numpy : 0.003445863723754883 nb_pixel_total : 77209 time to create 1 rle with old method : 0.08659577369689941 length of segment : 232 time for calcul the mask position with numpy : 0.0007565021514892578 nb_pixel_total : 7553 time to create 1 rle with old method : 0.008863210678100586 length of segment : 213 time for calcul the mask position with numpy : 0.0009431838989257812 nb_pixel_total : 20478 time to create 1 rle with old method : 0.024425983428955078 length of segment : 127 time for calcul the mask position with numpy : 0.002103090286254883 nb_pixel_total : 46069 time to create 1 rle with old method : 0.05188441276550293 length of segment : 211 time for calcul the mask position with numpy : 0.0014829635620117188 nb_pixel_total : 24524 time to create 1 rle with old method : 0.02793264389038086 length of segment : 417 time for calcul the mask position with numpy : 0.0006539821624755859 nb_pixel_total : 11688 time to create 1 rle with old method : 0.013469219207763672 length of segment : 127 time for calcul the mask position with numpy : 0.0002617835998535156 nb_pixel_total : 4226 time to create 1 rle with old method : 0.0052073001861572266 length of segment : 62 time for calcul the mask position with numpy : 0.0008432865142822266 nb_pixel_total : 27073 time to create 1 rle with old method : 0.030327558517456055 length of segment : 303 time spent for convertir_results : 15.41088604927063 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 220 chid ids of type : 3594 Number RLEs to save : 53658 save missing photos in datou_result : time spend for datou_step_exec : 103.76806592941284 time spend to save output : 2.953693389892578 total time spend for step 1 : 106.72175931930542 step2:crop_condition Tue Feb 18 22:52:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 220 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 159 About to insert : list_path_to_insert length 159 new photo from crops ! About to upload 159 photos upload in portfolio : 3736932 init cache_photo without model_param we have 159 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739915568_1468192 we have uploaded 159 photos in the portfolio 3736932 time of upload the photos Elapsed time : 38.72053289413452 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 50 About to insert : list_path_to_insert length 50 new photo from crops ! About to upload 50 photos upload in portfolio : 3736932 init cache_photo without model_param we have 50 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739915618_1468192 we have uploaded 50 photos in the portfolio 3736932 time of upload the photos Elapsed time : 18.590587854385376 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739915638_1468192 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8244149684906006 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739915642_1468192 we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9087905883789062 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739915646_1468192 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9943599700927734 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1338368088, 1338368084, 1338368081, 1338361619, 1338361616, 1338361454, 1338361450, 1338361240, 1338361101, 1338361007] Looping around the photos to save general results len do output : 220 /1338400681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338400908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368088', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368084', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368081', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361619', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361616', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361454', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361450', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361240', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361101', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361007', None, None, None, None, None, '2597839') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 670 time used for this insertion : 0.039140939712524414 save_final save missing photos in datou_result : time spend for datou_step_exec : 108.22064638137817 time spend to save output : 0.04477071762084961 total time spend for step 2 : 108.26541709899902 step3:rle_unique_nms_with_priority Tue Feb 18 22:54:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 220 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 3.0186522006988525 time for calcul the mask position with numpy : 0.7597188949584961 nb_pixel_total : 6545390 time to create 1 rle with new method : 0.6776762008666992 time for calcul the mask position with numpy : 0.020736217498779297 nb_pixel_total : 14046 time to create 1 rle with old method : 0.015157699584960938 time for calcul the mask position with numpy : 0.020024538040161133 nb_pixel_total : 10464 time to create 1 rle with old method : 0.012701749801635742 time for calcul the mask position with numpy : 0.026561498641967773 nb_pixel_total : 5795 time to create 1 rle with old method : 0.0068585872650146484 time for calcul the mask position with numpy : 0.021687030792236328 nb_pixel_total : 14808 time to create 1 rle with old method : 0.016630887985229492 time for calcul the mask position with numpy : 0.02171611785888672 nb_pixel_total : 86689 time to create 1 rle with old method : 0.0943148136138916 time for calcul the mask position with numpy : 0.02384495735168457 nb_pixel_total : 345262 time to create 1 rle with new method : 0.5788784027099609 time for calcul the mask position with numpy : 0.021125316619873047 nb_pixel_total : 27786 time to create 1 rle with old method : 0.03116893768310547 create new chi : 2.402918577194214 time to delete rle : 0.01766681671142578 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 6395 TO DO : save crop sub photo not yet done ! save time : 0.39636993408203125 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 5.140880107879639 time for calcul the mask position with numpy : 0.503483772277832 nb_pixel_total : 6137748 time to create 1 rle with new method : 0.7740926742553711 time for calcul the mask position with numpy : 0.030965089797973633 nb_pixel_total : 90122 time to create 1 rle with old method : 0.1023111343383789 time for calcul the mask position with numpy : 0.03354072570800781 nb_pixel_total : 28217 time to create 1 rle with old method : 0.035019874572753906 time for calcul the mask position with numpy : 0.033370018005371094 nb_pixel_total : 22740 time to create 1 rle with old method : 0.025867462158203125 time for calcul the mask position with numpy : 0.03379225730895996 nb_pixel_total : 14231 time to create 1 rle with old method : 0.01624894142150879 time for calcul the mask position with numpy : 0.03344392776489258 nb_pixel_total : 794 time to create 1 rle with old method : 0.0010006427764892578 time for calcul the mask position with numpy : 0.03180646896362305 nb_pixel_total : 12085 time to create 1 rle with old method : 0.013469934463500977 time for calcul the mask position with numpy : 0.031821489334106445 nb_pixel_total : 34799 time to create 1 rle with old method : 0.03740048408508301 time for calcul the mask position with numpy : 0.03370237350463867 nb_pixel_total : 95303 time to create 1 rle with old method : 0.10381340980529785 time for calcul the mask position with numpy : 0.033174991607666016 nb_pixel_total : 201305 time to create 1 rle with new method : 0.5773193836212158 time for calcul the mask position with numpy : 0.03430795669555664 nb_pixel_total : 71231 time to create 1 rle with old method : 0.07778000831604004 time for calcul the mask position with numpy : 0.033625125885009766 nb_pixel_total : 221154 time to create 1 rle with new method : 0.8272557258605957 time for calcul the mask position with numpy : 0.02829146385192871 nb_pixel_total : 12532 time to create 1 rle with old method : 0.014245271682739258 time for calcul the mask position with numpy : 0.021683454513549805 nb_pixel_total : 13241 time to create 1 rle with old method : 0.0151214599609375 time for calcul the mask position with numpy : 0.02062368392944336 nb_pixel_total : 22333 time to create 1 rle with old method : 0.02490973472595215 time for calcul the mask position with numpy : 0.02260613441467285 nb_pixel_total : 68825 time to create 1 rle with old method : 0.07479071617126465 time for calcul the mask position with numpy : 0.02103281021118164 nb_pixel_total : 3580 time to create 1 rle with old method : 0.004048824310302734 create new chi : 3.789863348007202 time to delete rle : 0.002490520477294922 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 10739 TO DO : save crop sub photo not yet done ! save time : 0.8228092193603516 nb_obj : 26 nb_hashtags : 3 time to prepare the origin masks : 4.145179748535156 time for calcul the mask position with numpy : 0.5739834308624268 nb_pixel_total : 5416432 time to create 1 rle with new method : 0.6692557334899902 time for calcul the mask position with numpy : 0.029076337814331055 nb_pixel_total : 180573 time to create 1 rle with new method : 0.4984705448150635 time for calcul the mask position with numpy : 0.026586055755615234 nb_pixel_total : 5692 time to create 1 rle with old method : 0.0062940120697021484 time for calcul the mask position with numpy : 0.026049137115478516 nb_pixel_total : 9378 time to create 1 rle with old method : 0.009745597839355469 time for calcul the mask position with numpy : 0.027149677276611328 nb_pixel_total : 81276 time to create 1 rle with old method : 0.08535337448120117 time for calcul the mask position with numpy : 0.027562379837036133 nb_pixel_total : 22859 time to create 1 rle with old method : 0.0233762264251709 time for calcul the mask position with numpy : 0.02647852897644043 nb_pixel_total : 16086 time to create 1 rle with old method : 0.016456127166748047 time for calcul the mask position with numpy : 0.028130292892456055 nb_pixel_total : 222624 time to create 1 rle with new method : 0.4045579433441162 time for calcul the mask position with numpy : 0.02792072296142578 nb_pixel_total : 74991 time to create 1 rle with old method : 0.0790245532989502 time for calcul the mask position with numpy : 0.02862095832824707 nb_pixel_total : 157599 time to create 1 rle with new method : 0.39295434951782227 time for calcul the mask position with numpy : 0.027643203735351562 nb_pixel_total : 189326 time to create 1 rle with new method : 0.42519330978393555 time for calcul the mask position with numpy : 0.028519392013549805 nb_pixel_total : 181787 time to create 1 rle with new method : 0.2776815891265869 time for calcul the mask position with numpy : 0.02844858169555664 nb_pixel_total : 15264 time to create 1 rle with old method : 0.017240524291992188 time for calcul the mask position with numpy : 0.02763962745666504 nb_pixel_total : 13354 time to create 1 rle with old method : 0.015145063400268555 time for calcul the mask position with numpy : 0.028132915496826172 nb_pixel_total : 60900 time to create 1 rle with old method : 0.06628084182739258 time for calcul the mask position with numpy : 0.027406692504882812 nb_pixel_total : 9618 time to create 1 rle with old method : 0.010855436325073242 time for calcul the mask position with numpy : 0.027887821197509766 nb_pixel_total : 9528 time to create 1 rle with old method : 0.010853052139282227 time for calcul the mask position with numpy : 0.028082847595214844 nb_pixel_total : 78717 time to create 1 rle with old method : 0.08450579643249512 time for calcul the mask position with numpy : 0.026573657989501953 nb_pixel_total : 45488 time to create 1 rle with old method : 0.04741621017456055 time for calcul the mask position with numpy : 0.027957677841186523 nb_pixel_total : 36372 time to create 1 rle with old method : 0.03864860534667969 time for calcul the mask position with numpy : 0.02915477752685547 nb_pixel_total : 100626 time to create 1 rle with old method : 0.11099529266357422 time for calcul the mask position with numpy : 0.028352022171020508 nb_pixel_total : 13662 time to create 1 rle with old method : 0.015287160873413086 time for calcul the mask position with numpy : 0.027388334274291992 nb_pixel_total : 22150 time to create 1 rle with old method : 0.024563312530517578 time for calcul the mask position with numpy : 0.028534412384033203 nb_pixel_total : 60697 time to create 1 rle with old method : 0.06979918479919434 time for calcul the mask position with numpy : 0.0284273624420166 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002529621124267578 time for calcul the mask position with numpy : 0.028644323348999023 nb_pixel_total : 1562 time to create 1 rle with old method : 0.002108335494995117 time for calcul the mask position with numpy : 0.027920007705688477 nb_pixel_total : 23516 time to create 1 rle with old method : 0.02573537826538086 create new chi : 4.85592794418335 time to delete rle : 0.0023605823516845703 batch 1 Loaded 53 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++Number RLEs to save : 17534 TO DO : save crop sub photo not yet done ! save time : 1.4461534023284912 nb_obj : 32 nb_hashtags : 3 time to prepare the origin masks : 3.55123233795166 time for calcul the mask position with numpy : 0.32354307174682617 nb_pixel_total : 6092329 time to create 1 rle with new method : 0.6434965133666992 time for calcul the mask position with numpy : 0.027843713760375977 nb_pixel_total : 8698 time to create 1 rle with old method : 0.00952458381652832 time for calcul the mask position with numpy : 0.027640819549560547 nb_pixel_total : 18564 time to create 1 rle with old method : 0.020740747451782227 time for calcul the mask position with numpy : 0.02765631675720215 nb_pixel_total : 50345 time to create 1 rle with old method : 0.05355954170227051 time for calcul the mask position with numpy : 0.0260922908782959 nb_pixel_total : 14751 time to create 1 rle with old method : 0.015174388885498047 time for calcul the mask position with numpy : 0.026808500289916992 nb_pixel_total : 10213 time to create 1 rle with old method : 0.011100292205810547 time for calcul the mask position with numpy : 0.02735280990600586 nb_pixel_total : 10465 time to create 1 rle with old method : 0.011240005493164062 time for calcul the mask position with numpy : 0.026598691940307617 nb_pixel_total : 8460 time to create 1 rle with old method : 0.009142398834228516 time for calcul the mask position with numpy : 0.027241230010986328 nb_pixel_total : 8916 time to create 1 rle with old method : 0.00970315933227539 time for calcul the mask position with numpy : 0.026721715927124023 nb_pixel_total : 42185 time to create 1 rle with old method : 0.04373884201049805 time for calcul the mask position with numpy : 0.026845693588256836 nb_pixel_total : 11673 time to create 1 rle with old method : 0.01280355453491211 time for calcul the mask position with numpy : 0.026763916015625 nb_pixel_total : 35349 time to create 1 rle with old method : 0.03764939308166504 time for calcul the mask position with numpy : 0.026332616806030273 nb_pixel_total : 12885 time to create 1 rle with old method : 0.013797283172607422 time for calcul the mask position with numpy : 0.026381969451904297 nb_pixel_total : 16452 time to create 1 rle with old method : 0.01727461814880371 time for calcul the mask position with numpy : 0.02611374855041504 nb_pixel_total : 15328 time to create 1 rle with old method : 0.015835285186767578 time for calcul the mask position with numpy : 0.026794910430908203 nb_pixel_total : 31784 time to create 1 rle with old method : 0.03375387191772461 time for calcul the mask position with numpy : 0.027546167373657227 nb_pixel_total : 13906 time to create 1 rle with old method : 0.015105485916137695 time for calcul the mask position with numpy : 0.027510881423950195 nb_pixel_total : 44041 time to create 1 rle with old method : 0.04757976531982422 time for calcul the mask position with numpy : 0.028336763381958008 nb_pixel_total : 19796 time to create 1 rle with old method : 0.021940231323242188 time for calcul the mask position with numpy : 0.03165721893310547 nb_pixel_total : 42858 time to create 1 rle with old method : 0.0458376407623291 time for calcul the mask position with numpy : 0.02841639518737793 nb_pixel_total : 229941 time to create 1 rle with new method : 0.519120454788208 time for calcul the mask position with numpy : 0.02817559242248535 nb_pixel_total : 42447 time to create 1 rle with old method : 0.04752373695373535 time for calcul the mask position with numpy : 0.03255462646484375 nb_pixel_total : 12568 time to create 1 rle with old method : 0.014466047286987305 time for calcul the mask position with numpy : 0.028719663619995117 nb_pixel_total : 12249 time to create 1 rle with old method : 0.015918970108032227 time for calcul the mask position with numpy : 0.028461217880249023 nb_pixel_total : 68879 time to create 1 rle with old method : 0.07408928871154785 time for calcul the mask position with numpy : 0.028406620025634766 nb_pixel_total : 47465 time to create 1 rle with old method : 0.053551435470581055 time for calcul the mask position with numpy : 0.028897762298583984 nb_pixel_total : 36169 time to create 1 rle with old method : 0.0403287410736084 time for calcul the mask position with numpy : 0.029390811920166016 nb_pixel_total : 14125 time to create 1 rle with old method : 0.015837669372558594 time for calcul the mask position with numpy : 0.027271747589111328 nb_pixel_total : 20870 time to create 1 rle with old method : 0.022954225540161133 time for calcul the mask position with numpy : 0.02810525894165039 nb_pixel_total : 21959 time to create 1 rle with old method : 0.024233102798461914 time for calcul the mask position with numpy : 0.02734208106994629 nb_pixel_total : 7292 time to create 1 rle with old method : 0.00821995735168457 time for calcul the mask position with numpy : 0.026555299758911133 nb_pixel_total : 6242 time to create 1 rle with old method : 0.007076740264892578 time for calcul the mask position with numpy : 0.02738189697265625 nb_pixel_total : 21036 time to create 1 rle with old method : 0.023038625717163086 create new chi : 3.2178046703338623 time to delete rle : 0.0025026798248291016 batch 1 Loaded 65 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 16940 TO DO : save crop sub photo not yet done ! save time : 0.9436032772064209 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 4.766292095184326 time for calcul the mask position with numpy : 0.4044332504272461 nb_pixel_total : 5938643 time to create 1 rle with new method : 0.7081723213195801 time for calcul the mask position with numpy : 0.02154064178466797 nb_pixel_total : 82771 time to create 1 rle with old method : 0.0916445255279541 time for calcul the mask position with numpy : 0.021877050399780273 nb_pixel_total : 37742 time to create 1 rle with old method : 0.04344606399536133 time for calcul the mask position with numpy : 0.022611379623413086 nb_pixel_total : 220133 time to create 1 rle with new method : 0.5693347454071045 time for calcul the mask position with numpy : 0.02270340919494629 nb_pixel_total : 6400 time to create 1 rle with old method : 0.007254362106323242 time for calcul the mask position with numpy : 0.02094125747680664 nb_pixel_total : 14997 time to create 1 rle with old method : 0.016410112380981445 time for calcul the mask position with numpy : 0.021412372589111328 nb_pixel_total : 140031 time to create 1 rle with old method : 0.18319463729858398 time for calcul the mask position with numpy : 0.02164459228515625 nb_pixel_total : 8022 time to create 1 rle with old method : 0.008747339248657227 time for calcul the mask position with numpy : 0.0205690860748291 nb_pixel_total : 32566 time to create 1 rle with old method : 0.034562110900878906 time for calcul the mask position with numpy : 0.021089553833007812 nb_pixel_total : 108894 time to create 1 rle with old method : 0.1186680793762207 time for calcul the mask position with numpy : 0.021482229232788086 nb_pixel_total : 48019 time to create 1 rle with old method : 0.05681657791137695 time for calcul the mask position with numpy : 0.02131175994873047 nb_pixel_total : 10476 time to create 1 rle with old method : 0.011688470840454102 time for calcul the mask position with numpy : 0.02086329460144043 nb_pixel_total : 15152 time to create 1 rle with old method : 0.017070770263671875 time for calcul the mask position with numpy : 0.022052526473999023 nb_pixel_total : 142995 time to create 1 rle with old method : 0.15436482429504395 time for calcul the mask position with numpy : 0.022149085998535156 nb_pixel_total : 18854 time to create 1 rle with old method : 0.02033829689025879 time for calcul the mask position with numpy : 0.02220606803894043 nb_pixel_total : 133798 time to create 1 rle with old method : 0.14281630516052246 time for calcul the mask position with numpy : 0.021225929260253906 nb_pixel_total : 90747 time to create 1 rle with old method : 0.09523463249206543 create new chi : 3.086566925048828 time to delete rle : 0.0018525123596191406 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 13043 TO DO : save crop sub photo not yet done ! save time : 0.7565910816192627 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 3.456256151199341 time for calcul the mask position with numpy : 0.49854540824890137 nb_pixel_total : 6625659 time to create 1 rle with new method : 0.744004487991333 time for calcul the mask position with numpy : 0.019655227661132812 nb_pixel_total : 22108 time to create 1 rle with old method : 0.022736549377441406 time for calcul the mask position with numpy : 0.01929020881652832 nb_pixel_total : 43440 time to create 1 rle with old method : 0.04432845115661621 time for calcul the mask position with numpy : 0.02088141441345215 nb_pixel_total : 168373 time to create 1 rle with new method : 0.5162632465362549 time for calcul the mask position with numpy : 0.02013373374938965 nb_pixel_total : 6434 time to create 1 rle with old method : 0.00712275505065918 time for calcul the mask position with numpy : 0.020409584045410156 nb_pixel_total : 76852 time to create 1 rle with old method : 0.07842040061950684 time for calcul the mask position with numpy : 0.019747495651245117 nb_pixel_total : 6103 time to create 1 rle with old method : 0.006448030471801758 time for calcul the mask position with numpy : 0.019762039184570312 nb_pixel_total : 19202 time to create 1 rle with old method : 0.019486427307128906 time for calcul the mask position with numpy : 0.01949596405029297 nb_pixel_total : 10823 time to create 1 rle with old method : 0.011175394058227539 time for calcul the mask position with numpy : 0.019489288330078125 nb_pixel_total : 42813 time to create 1 rle with old method : 0.04415011405944824 time for calcul the mask position with numpy : 0.019459247589111328 nb_pixel_total : 21648 time to create 1 rle with old method : 0.021849393844604492 time for calcul the mask position with numpy : 0.02024054527282715 nb_pixel_total : 6785 time to create 1 rle with old method : 0.007317066192626953 create new chi : 2.2939090728759766 time to delete rle : 0.0009469985961914062 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++Number RLEs to save : 6710 TO DO : save crop sub photo not yet done ! save time : 5.821698188781738 nb_obj : 14 nb_hashtags : 1 time to prepare the origin masks : 4.259427785873413 time for calcul the mask position with numpy : 0.490354061126709 nb_pixel_total : 6452448 time to create 1 rle with new method : 1.295492172241211 time for calcul the mask position with numpy : 0.01910233497619629 nb_pixel_total : 33191 time to create 1 rle with old method : 0.03442215919494629 time for calcul the mask position with numpy : 0.019657373428344727 nb_pixel_total : 3434 time to create 1 rle with old method : 0.003766775131225586 time for calcul the mask position with numpy : 0.0212857723236084 nb_pixel_total : 192367 time to create 1 rle with new method : 0.5178909301757812 time for calcul the mask position with numpy : 0.020067453384399414 nb_pixel_total : 44743 time to create 1 rle with old method : 0.045484066009521484 time for calcul the mask position with numpy : 0.019897937774658203 nb_pixel_total : 8956 time to create 1 rle with old method : 0.010034561157226562 time for calcul the mask position with numpy : 0.019945621490478516 nb_pixel_total : 52340 time to create 1 rle with old method : 0.05377840995788574 time for calcul the mask position with numpy : 0.01962900161743164 nb_pixel_total : 29439 time to create 1 rle with old method : 0.030445098876953125 time for calcul the mask position with numpy : 0.01987624168395996 nb_pixel_total : 52349 time to create 1 rle with old method : 0.05314445495605469 time for calcul the mask position with numpy : 0.020030736923217773 nb_pixel_total : 40914 time to create 1 rle with old method : 0.04343986511230469 time for calcul the mask position with numpy : 0.01981496810913086 nb_pixel_total : 34028 time to create 1 rle with old method : 0.034859418869018555 time for calcul the mask position with numpy : 0.01924753189086914 nb_pixel_total : 15465 time to create 1 rle with old method : 0.016358137130737305 time for calcul the mask position with numpy : 0.019899845123291016 nb_pixel_total : 10506 time to create 1 rle with old method : 0.011553525924682617 time for calcul the mask position with numpy : 0.02045154571533203 nb_pixel_total : 50375 time to create 1 rle with old method : 0.05212259292602539 time for calcul the mask position with numpy : 0.019718408584594727 nb_pixel_total : 29685 time to create 1 rle with old method : 0.03158283233642578 create new chi : 3.0579354763031006 time to delete rle : 0.0014662742614746094 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 9544 TO DO : save crop sub photo not yet done ! save time : 0.5774166584014893 nb_obj : 34 nb_hashtags : 3 time to prepare the origin masks : 3.406956911087036 time for calcul the mask position with numpy : 0.45516490936279297 nb_pixel_total : 6192200 time to create 1 rle with new method : 0.6703572273254395 time for calcul the mask position with numpy : 0.026857614517211914 nb_pixel_total : 6520 time to create 1 rle with old method : 0.007252216339111328 time for calcul the mask position with numpy : 0.027316808700561523 nb_pixel_total : 32614 time to create 1 rle with old method : 0.03468489646911621 time for calcul the mask position with numpy : 0.027853012084960938 nb_pixel_total : 17244 time to create 1 rle with old method : 0.018193960189819336 time for calcul the mask position with numpy : 0.026175260543823242 nb_pixel_total : 1726 time to create 1 rle with old method : 0.0018718242645263672 time for calcul the mask position with numpy : 0.02669835090637207 nb_pixel_total : 10884 time to create 1 rle with old method : 0.01135563850402832 time for calcul the mask position with numpy : 0.027561664581298828 nb_pixel_total : 3055 time to create 1 rle with old method : 0.0035486221313476562 time for calcul the mask position with numpy : 0.02734971046447754 nb_pixel_total : 1477 time to create 1 rle with old method : 0.0018391609191894531 time for calcul the mask position with numpy : 0.028424978256225586 nb_pixel_total : 28183 time to create 1 rle with old method : 0.03108048439025879 time for calcul the mask position with numpy : 0.028835535049438477 nb_pixel_total : 9190 time to create 1 rle with old method : 0.010828018188476562 time for calcul the mask position with numpy : 0.030033349990844727 nb_pixel_total : 16267 time to create 1 rle with old method : 0.020529747009277344 time for calcul the mask position with numpy : 0.029446125030517578 nb_pixel_total : 11188 time to create 1 rle with old method : 0.01328897476196289 time for calcul the mask position with numpy : 0.02934885025024414 nb_pixel_total : 13813 time to create 1 rle with old method : 0.015479803085327148 time for calcul the mask position with numpy : 0.027870893478393555 nb_pixel_total : 9014 time to create 1 rle with old method : 0.01015329360961914 time for calcul the mask position with numpy : 0.0291748046875 nb_pixel_total : 15691 time to create 1 rle with old method : 0.017843246459960938 time for calcul the mask position with numpy : 0.028366565704345703 nb_pixel_total : 56994 time to create 1 rle with old method : 0.06517839431762695 time for calcul the mask position with numpy : 0.02779865264892578 nb_pixel_total : 35635 time to create 1 rle with old method : 0.038939476013183594 time for calcul the mask position with numpy : 0.028005123138427734 nb_pixel_total : 12807 time to create 1 rle with old method : 0.014453411102294922 time for calcul the mask position with numpy : 0.02847599983215332 nb_pixel_total : 10644 time to create 1 rle with old method : 0.012191534042358398 time for calcul the mask position with numpy : 0.028180599212646484 nb_pixel_total : 58443 time to create 1 rle with old method : 0.06460738182067871 time for calcul the mask position with numpy : 0.02719283103942871 nb_pixel_total : 30543 time to create 1 rle with old method : 0.03292560577392578 time for calcul the mask position with numpy : 0.028045654296875 nb_pixel_total : 30049 time to create 1 rle with old method : 0.032013893127441406 time for calcul the mask position with numpy : 0.0280301570892334 nb_pixel_total : 17702 time to create 1 rle with old method : 0.01912975311279297 time for calcul the mask position with numpy : 0.02850627899169922 nb_pixel_total : 32696 time to create 1 rle with old method : 0.03591132164001465 time for calcul the mask position with numpy : 0.02864217758178711 nb_pixel_total : 121686 time to create 1 rle with old method : 0.1292877197265625 time for calcul the mask position with numpy : 0.02669072151184082 nb_pixel_total : 9587 time to create 1 rle with old method : 0.0099029541015625 time for calcul the mask position with numpy : 0.02677750587463379 nb_pixel_total : 16249 time to create 1 rle with old method : 0.017038822174072266 time for calcul the mask position with numpy : 0.026292085647583008 nb_pixel_total : 17667 time to create 1 rle with old method : 0.018163204193115234 time for calcul the mask position with numpy : 0.02706766128540039 nb_pixel_total : 113599 time to create 1 rle with old method : 0.11862635612487793 time for calcul the mask position with numpy : 0.02770066261291504 nb_pixel_total : 44642 time to create 1 rle with old method : 0.0473484992980957 time for calcul the mask position with numpy : 0.028145313262939453 nb_pixel_total : 17249 time to create 1 rle with old method : 0.0197756290435791 time for calcul the mask position with numpy : 0.027332782745361328 nb_pixel_total : 6999 time to create 1 rle with old method : 0.007844686508178711 time for calcul the mask position with numpy : 0.02652430534362793 nb_pixel_total : 17933 time to create 1 rle with old method : 0.01973867416381836 time for calcul the mask position with numpy : 0.028232574462890625 nb_pixel_total : 26745 time to create 1 rle with old method : 0.028789281845092773 time for calcul the mask position with numpy : 0.026972293853759766 nb_pixel_total : 3305 time to create 1 rle with old method : 0.003595113754272461 create new chi : 3.0343942642211914 time to delete rle : 0.002335071563720703 batch 1 Loaded 69 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 15071 TO DO : save crop sub photo not yet done ! save time : 0.8574140071868896 nb_obj : 45 nb_hashtags : 2 time to prepare the origin masks : 3.4414165019989014 time for calcul the mask position with numpy : 0.2570466995239258 nb_pixel_total : 6224995 time to create 1 rle with new method : 0.7690179347991943 time for calcul the mask position with numpy : 0.02673029899597168 nb_pixel_total : 26654 time to create 1 rle with old method : 0.02766251564025879 time for calcul the mask position with numpy : 0.026317596435546875 nb_pixel_total : 20864 time to create 1 rle with old method : 0.02239203453063965 time for calcul the mask position with numpy : 0.025772571563720703 nb_pixel_total : 9727 time to create 1 rle with old method : 0.010280132293701172 time for calcul the mask position with numpy : 0.025551795959472656 nb_pixel_total : 19988 time to create 1 rle with old method : 0.021098613739013672 time for calcul the mask position with numpy : 0.026272296905517578 nb_pixel_total : 17131 time to create 1 rle with old method : 0.01834249496459961 time for calcul the mask position with numpy : 0.026186466217041016 nb_pixel_total : 22838 time to create 1 rle with old method : 0.02361130714416504 time for calcul the mask position with numpy : 0.026129722595214844 nb_pixel_total : 8409 time to create 1 rle with old method : 0.008794784545898438 time for calcul the mask position with numpy : 0.026165485382080078 nb_pixel_total : 30807 time to create 1 rle with old method : 0.03316497802734375 time for calcul the mask position with numpy : 0.026848554611206055 nb_pixel_total : 20423 time to create 1 rle with old method : 0.02121114730834961 time for calcul the mask position with numpy : 0.02589583396911621 nb_pixel_total : 19175 time to create 1 rle with old method : 0.02022695541381836 time for calcul the mask position with numpy : 0.026531219482421875 nb_pixel_total : 16059 time to create 1 rle with old method : 0.01669764518737793 time for calcul the mask position with numpy : 0.026484251022338867 nb_pixel_total : 23034 time to create 1 rle with old method : 0.02454853057861328 time for calcul the mask position with numpy : 0.02584385871887207 nb_pixel_total : 3607 time to create 1 rle with old method : 0.003824472427368164 time for calcul the mask position with numpy : 0.02580714225769043 nb_pixel_total : 15840 time to create 1 rle with old method : 0.0158846378326416 time for calcul the mask position with numpy : 0.025792598724365234 nb_pixel_total : 11295 time to create 1 rle with old method : 0.011382102966308594 time for calcul the mask position with numpy : 0.025688648223876953 nb_pixel_total : 6236 time to create 1 rle with old method : 0.006768941879272461 time for calcul the mask position with numpy : 0.025589466094970703 nb_pixel_total : 21684 time to create 1 rle with old method : 0.022008895874023438 time for calcul the mask position with numpy : 0.02608966827392578 nb_pixel_total : 30717 time to create 1 rle with old method : 0.03217649459838867 time for calcul the mask position with numpy : 0.025875568389892578 nb_pixel_total : 20529 time to create 1 rle with old method : 0.020836591720581055 time for calcul the mask position with numpy : 0.026273250579833984 nb_pixel_total : 48843 time to create 1 rle with old method : 0.04958343505859375 time for calcul the mask position with numpy : 0.026240110397338867 nb_pixel_total : 14154 time to create 1 rle with old method : 0.015122413635253906 time for calcul the mask position with numpy : 0.026560068130493164 nb_pixel_total : 16206 time to create 1 rle with old method : 0.017292499542236328 time for calcul the mask position with numpy : 0.02609705924987793 nb_pixel_total : 19888 time to create 1 rle with old method : 0.020949602127075195 time for calcul the mask position with numpy : 0.026886940002441406 nb_pixel_total : 11835 time to create 1 rle with old method : 0.013042449951171875 time for calcul the mask position with numpy : 0.025918960571289062 nb_pixel_total : 25842 time to create 1 rle with old method : 0.0269777774810791 time for calcul the mask position with numpy : 0.025655269622802734 nb_pixel_total : 15393 time to create 1 rle with old method : 0.015882492065429688 time for calcul the mask position with numpy : 0.025748252868652344 nb_pixel_total : 19964 time to create 1 rle with old method : 0.020638704299926758 time for calcul the mask position with numpy : 0.02652430534362793 nb_pixel_total : 21979 time to create 1 rle with old method : 0.022670984268188477 time for calcul the mask position with numpy : 0.027124881744384766 nb_pixel_total : 4908 time to create 1 rle with old method : 0.005468845367431641 time for calcul the mask position with numpy : 0.026755571365356445 nb_pixel_total : 34425 time to create 1 rle with old method : 0.037200212478637695 time for calcul the mask position with numpy : 0.027055025100708008 nb_pixel_total : 16761 time to create 1 rle with old method : 0.0181121826171875 time for calcul the mask position with numpy : 0.029753684997558594 nb_pixel_total : 6313 time to create 1 rle with old method : 0.007486820220947266 time for calcul the mask position with numpy : 0.02893376350402832 nb_pixel_total : 20654 time to create 1 rle with old method : 0.0228424072265625 time for calcul the mask position with numpy : 0.02856135368347168 nb_pixel_total : 42046 time to create 1 rle with old method : 0.04628348350524902 time for calcul the mask position with numpy : 0.027554988861083984 nb_pixel_total : 23680 time to create 1 rle with old method : 0.025835752487182617 time for calcul the mask position with numpy : 0.02724289894104004 nb_pixel_total : 34421 time to create 1 rle with old method : 0.03712582588195801 time for calcul the mask position with numpy : 0.028906822204589844 nb_pixel_total : 15135 time to create 1 rle with old method : 0.016711711883544922 time for calcul the mask position with numpy : 0.029196977615356445 nb_pixel_total : 12398 time to create 1 rle with old method : 0.013536214828491211 time for calcul the mask position with numpy : 0.02845454216003418 nb_pixel_total : 6983 time to create 1 rle with old method : 0.007374763488769531 time for calcul the mask position with numpy : 0.02743983268737793 nb_pixel_total : 11582 time to create 1 rle with old method : 0.012306690216064453 time for calcul the mask position with numpy : 0.027077198028564453 nb_pixel_total : 9965 time to create 1 rle with old method : 0.010471343994140625 time for calcul the mask position with numpy : 0.02682352066040039 nb_pixel_total : 6543 time to create 1 rle with old method : 0.007391214370727539 time for calcul the mask position with numpy : 0.028371095657348633 nb_pixel_total : 9942 time to create 1 rle with old method : 0.01108241081237793 time for calcul the mask position with numpy : 0.027669191360473633 nb_pixel_total : 12603 time to create 1 rle with old method : 0.013511180877685547 time for calcul the mask position with numpy : 0.027920246124267578 nb_pixel_total : 17765 time to create 1 rle with old method : 0.02003955841064453 create new chi : 3.1410608291625977 time to delete rle : 0.002552032470703125 batch 1 Loaded 91 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17325 TO DO : save crop sub photo not yet done ! save time : 0.9556083679199219 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 6.8316569328308105 time for calcul the mask position with numpy : 0.5011820793151855 nb_pixel_total : 6156793 time to create 1 rle with new method : 0.7514345645904541 time for calcul the mask position with numpy : 0.03355693817138672 nb_pixel_total : 17762 time to create 1 rle with old method : 0.019965648651123047 time for calcul the mask position with numpy : 0.033937931060791016 nb_pixel_total : 4226 time to create 1 rle with old method : 0.004793643951416016 time for calcul the mask position with numpy : 0.03377723693847656 nb_pixel_total : 11688 time to create 1 rle with old method : 0.012845993041992188 time for calcul the mask position with numpy : 0.0335996150970459 nb_pixel_total : 24524 time to create 1 rle with old method : 0.026390790939331055 time for calcul the mask position with numpy : 0.03330183029174805 nb_pixel_total : 46069 time to create 1 rle with old method : 0.050165414810180664 time for calcul the mask position with numpy : 0.0335843563079834 nb_pixel_total : 20478 time to create 1 rle with old method : 0.02266860008239746 time for calcul the mask position with numpy : 0.033209800720214844 nb_pixel_total : 7553 time to create 1 rle with old method : 0.008241415023803711 time for calcul the mask position with numpy : 0.032087087631225586 nb_pixel_total : 77209 time to create 1 rle with old method : 0.08115553855895996 time for calcul the mask position with numpy : 0.035500288009643555 nb_pixel_total : 10506 time to create 1 rle with old method : 0.012768745422363281 time for calcul the mask position with numpy : 0.03424572944641113 nb_pixel_total : 109831 time to create 1 rle with old method : 0.11895322799682617 time for calcul the mask position with numpy : 0.02419447898864746 nb_pixel_total : 390969 time to create 1 rle with new method : 0.32727837562561035 time for calcul the mask position with numpy : 0.021236896514892578 nb_pixel_total : 18938 time to create 1 rle with old method : 0.021202802658081055 time for calcul the mask position with numpy : 0.021341323852539062 nb_pixel_total : 33353 time to create 1 rle with old method : 0.0367579460144043 time for calcul the mask position with numpy : 0.02146601676940918 nb_pixel_total : 35339 time to create 1 rle with old method : 0.04149198532104492 time for calcul the mask position with numpy : 0.02260589599609375 nb_pixel_total : 9897 time to create 1 rle with old method : 0.015810728073120117 time for calcul the mask position with numpy : 0.023700237274169922 nb_pixel_total : 16352 time to create 1 rle with old method : 0.02497124671936035 time for calcul the mask position with numpy : 0.021255016326904297 nb_pixel_total : 3843 time to create 1 rle with old method : 0.004573822021484375 time for calcul the mask position with numpy : 0.02420353889465332 nb_pixel_total : 32664 time to create 1 rle with old method : 0.03579258918762207 time for calcul the mask position with numpy : 0.036882877349853516 nb_pixel_total : 22246 time to create 1 rle with old method : 0.024500608444213867 create new chi : 2.750152349472046 time to delete rle : 0.0021011829376220703 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++Number RLEs to save : 12192 TO DO : save crop sub photo not yet done ! save time : 1.1413421630859375 map_output_result : {1338368088: (0.0, 'Should be the crop_list due to order', 0.0), 1338368084: (0.0, 'Should be the crop_list due to order', 0.0), 1338368081: (0.0, 'Should be the crop_list due to order', 0.0), 1338361619: (0.0, 'Should be the crop_list due to order', 0.0), 1338361616: (0.0, 'Should be the crop_list due to order', 0.0), 1338361454: (0.0, 'Should be the crop_list due to order', 0.0), 1338361450: (0.0, 'Should be the crop_list due to order', 0.0), 1338361240: (0.0, 'Should be the crop_list due to order', 0.0), 1338361101: (0.0, 'Should be the crop_list due to order', 0.0), 1338361007: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1338368088, 1338368084, 1338368081, 1338361619, 1338361616, 1338361454, 1338361450, 1338361240, 1338361101, 1338361007] Looping around the photos to save general results len do output : 10 /1338368088.Didn't retrieve data . /1338368084.Didn't retrieve data . /1338368081.Didn't retrieve data . /1338361619.Didn't retrieve data . /1338361616.Didn't retrieve data . /1338361454.Didn't retrieve data . /1338361450.Didn't retrieve data . /1338361240.Didn't retrieve data . /1338361101.Didn't retrieve data . /1338361007.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368088', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368084', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368081', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361619', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361616', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361454', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361450', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361240', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361101', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361007', None, None, None, None, None, '2597839') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.014733314514160156 save_final save missing photos in datou_result : time spend for datou_step_exec : 88.43323230743408 time spend to save output : 0.015173196792602539 total time spend for step 3 : 88.44840550422668 step4:ventilate_hashtags_in_portfolio Tue Feb 18 22:55:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20656300 get user id for portfolio 20656300 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656300 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','flou','background','metal','pehd','environnement','mal_croppe','carton','autre','papier','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656300 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','flou','background','metal','pehd','environnement','mal_croppe','carton','autre','papier','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656300 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','flou','background','metal','pehd','environnement','mal_croppe','carton','autre','papier','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20657319,20657320,20657321,20657322,20657323,20657324,20657325,20657326,20657327,20657328,20657329?tags=pet_clair,flou,background,metal,pehd,environnement,mal_croppe,carton,autre,papier,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1338368088, 1338368084, 1338368081, 1338361619, 1338361616, 1338361454, 1338361450, 1338361240, 1338361101, 1338361007] Looping around the photos to save general results len do output : 1 /20656300. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368088', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368084', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368081', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361619', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361616', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361454', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361450', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361240', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361101', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361007', None, None, None, None, None, '2597839') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.15165257453918457 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.830937623977661 time spend to save output : 0.15191149711608887 total time spend for step 4 : 2.98284912109375 step5:final Tue Feb 18 22:55:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1338368088: ('0.1236803711646696',), 1338368084: ('0.1236803711646696',), 1338368081: ('0.1236803711646696',), 1338361619: ('0.1236803711646696',), 1338361616: ('0.1236803711646696',), 1338361454: ('0.1236803711646696',), 1338361450: ('0.1236803711646696',), 1338361240: ('0.1236803711646696',), 1338361101: ('0.1236803711646696',), 1338361007: ('0.1236803711646696',)} new output for save of step final : {1338368088: ('0.1236803711646696',), 1338368084: ('0.1236803711646696',), 1338368081: ('0.1236803711646696',), 1338361619: ('0.1236803711646696',), 1338361616: ('0.1236803711646696',), 1338361454: ('0.1236803711646696',), 1338361450: ('0.1236803711646696',), 1338361240: ('0.1236803711646696',), 1338361101: ('0.1236803711646696',), 1338361007: ('0.1236803711646696',)} [1338368088, 1338368084, 1338368081, 1338361619, 1338361616, 1338361454, 1338361450, 1338361240, 1338361101, 1338361007] Looping around the photos to save general results len do output : 10 /1338368088.Didn't retrieve data . /1338368084.Didn't retrieve data . /1338368081.Didn't retrieve data . /1338361619.Didn't retrieve data . /1338361616.Didn't retrieve data . /1338361454.Didn't retrieve data . /1338361450.Didn't retrieve data . /1338361240.Didn't retrieve data . /1338361101.Didn't retrieve data . /1338361007.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368088', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368084', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368081', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361619', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361616', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361454', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361450', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361240', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361101', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361007', None, None, None, None, None, '2597839') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.013794898986816406 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10007452964782715 time spend to save output : 0.014348745346069336 total time spend for step 5 : 0.11442327499389648 step6:blur_detection Tue Feb 18 22:55:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f.jpg resize: (2160, 3264) 1338368088 -2.3138799954078118 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149.jpg resize: (2160, 3264) 1338368084 -2.795376128731218 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d.jpg resize: (2160, 3264) 1338368081 -2.4471216395609896 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780.jpg resize: (2160, 3264) 1338361619 -4.4201962903549115 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa.jpg resize: (2160, 3264) 1338361616 -0.8443457950661116 treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef.jpg resize: (2160, 3264) 1338361454 -3.669190422188833 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94.jpg resize: (2160, 3264) 1338361450 -4.577444684616987 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3.jpg resize: (2160, 3264) 1338361240 -4.8649745479754225 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d.jpg resize: (2160, 3264) 1338361101 -5.486577225539306 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4.jpg resize: (2160, 3264) 1338361007 -3.9418042054252567 treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386858_0.png resize: (152, 172) 1338400681 -1.4540862186720427 treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386853_0.png resize: (782, 785) 1338400682 -1.1086617227662043 treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386855_0.png resize: (136, 152) 1338400683 -2.4678335317757027 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386868_0.png resize: (247, 357) 1338400684 -2.2829502629807354 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386874_0.png resize: (383, 307) 1338400685 -1.0948428217757726 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386865_0.png resize: (440, 249) 1338400686 -1.5203129949897112 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386864_0.png resize: (443, 644) 1338400687 -2.265473794988006 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386866_0.png resize: (547, 577) 1338400688 -3.331563626832901 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386869_0.png resize: (129, 132) 1338400689 -1.5913049098462588 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386872_0.png resize: (260, 126) 1338400690 -1.1265206921175457 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386867_0.png resize: (506, 240) 1338400691 -3.115547438299108 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386861_0.png resize: (237, 212) 1338400692 -1.767170256258876 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386892_0.png resize: (473, 339) 1338400693 -2.286651897723083 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386882_0.png resize: (131, 106) 1338400694 -0.8831123927503949 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386890_0.png resize: (581, 428) 1338400695 -1.0596965141283166 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386898_0.png resize: (257, 282) 1338400696 -1.7790257086366519 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386893_0.png resize: (276, 276) 1338400697 -1.8173137021773549 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386878_0.png resize: (601, 694) 1338400698 -0.856399000566506 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386876_0.png resize: (166, 171) 1338400699 -1.4109297026429026 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386875_0.png resize: (206, 153) 1338400700 -1.6936093958246445 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386887_0.png resize: (324, 328) 1338400701 -3.237998576954884 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386896_0.png resize: (123, 145) 1338400702 -2.0221486223595506 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386880_0.png resize: (353, 376) 1338400703 -2.7817855097469297 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386927_0.png resize: (190, 163) 1338400704 -3.7898918717603367 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386922_0.png resize: (273, 251) 1338400705 -2.5068805046858036 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386905_0.png resize: (211, 137) 1338400706 -3.0779201344572242 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386918_0.png resize: (418, 329) 1338400707 -3.6534502428860884 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386903_0.png resize: (283, 266) 1338400708 -3.0122452895556764 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386923_0.png resize: (155, 108) 1338400709 -2.4257769497863713 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386911_0.png resize: (331, 151) 1338400710 -2.3337773519771345 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386919_0.png resize: (138, 197) 1338400711 -1.6116316083099795 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386908_0.png resize: (426, 178) 1338400712 -3.797444998839728 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386915_0.png resize: (124, 141) 1338400713 -2.9317370238897684 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386906_0.png resize: (308, 256) 1338400714 -2.947887107325856 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386902_0.png resize: (160, 150) 1338400715 0.4239967080663436 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386931_0.png resize: (134, 166) 1338400716 -2.4680675353196277 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386925_0.png resize: (176, 105) 1338400717 -4.195830364046382 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386924_0.png resize: (136, 173) 1338400718 -3.3280761206657563 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386930_0.png resize: (237, 221) 1338400719 -3.445359650962044 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386917_0.png resize: (138, 152) 1338400720 -3.5757897534725824 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386916_0.png resize: (134, 189) 1338400721 -3.6783981122629332 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386910_0.png resize: (146, 207) 1338400722 -3.4229293354707027 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386914_0.png resize: (322, 250) 1338400723 -2.867303584533411 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386926_0.png resize: (326, 205) 1338400724 -4.077572128246681 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386921_0.png resize: (247, 396) 1338400725 -4.1923813802352745 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386904_0.png resize: (99, 157) 1338400726 -2.9755014412219185 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386901_0.png resize: (453, 671) 1338400727 -3.675260524572546 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386928_0.png resize: (331, 230) 1338400728 -0.6106584735740467 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386936_0.png resize: (465, 417) 1338400729 -1.899575971216118 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386944_0.png resize: (214, 178) 1338400730 -1.487267275309274 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386933_0.png resize: (355, 410) 1338400731 -1.7508577608199298 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386938_0.png resize: (115, 119) 1338400732 0.6053872573769804 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386937_0.png resize: (334, 149) 1338400733 -2.4104522441961693 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386939_0.png resize: (293, 275) 1338400734 -1.3929667836581512 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386947_0.png resize: (357, 132) 1338400736 0.39970039887016545 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386941_0.png resize: (203, 268) 1338400737 -1.8147520920687172 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386945_0.png resize: (93, 122) 1338400738 -1.534158543211106 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386942_0.png resize: (96, 139) 1338400739 -3.3850199537139942 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386935_0.png resize: (194, 132) 1338400740 -1.9251449163285594 treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386950_0.png resize: (231, 148) 1338400741 -2.1973120701917166 treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386949_0.png resize: (96, 94) 1338400742 -3.217236420518274 treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386956_0.png resize: (122, 71) 1338400743 -3.867395959894779 treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386959_0.png resize: (143, 283) 1338400744 -2.0918793322087468 treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386954_0.png resize: (66, 106) 1338400745 2.3829874365929036 treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386952_0.png resize: (122, 129) 1338400746 -0.9832758614734844 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386963_0.png resize: (143, 155) 1338400747 -2.5255160519574527 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386972_0.png resize: (67, 83) 1338400748 -3.8652331279154106 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386965_0.png resize: (245, 267) 1338400749 -1.6285172507353047 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386962_0.png resize: (142, 177) 1338400750 -2.762420437277463 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386961_0.png resize: (224, 354) 1338400751 -1.8526519674893487 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386968_0.png resize: (333, 233) 1338400752 -3.884724493315646 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386970_0.png resize: (293, 317) 1338400753 -3.6639811572658525 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386960_0.png resize: (239, 221) 1338400754 -3.475738909751983 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386973_0.png resize: (188, 259) 1338400755 -3.474089811389315 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386964_0.png resize: (211, 273) 1338400756 -3.281082485659849 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386967_0.png resize: (224, 227) 1338400757 -3.69755702882071 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386966_0.png resize: (316, 272) 1338400758 -2.7872925598272373 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386971_0.png resize: (428, 576) 1338400759 -4.531802844331409 treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386969_0.png resize: (164, 95) 1338400760 -1.726220456783082 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386995_0.png resize: (64, 60) 1338400761 -1.6072094290275334 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386981_0.png resize: (58, 40) 1338400762 -0.3306735507074433 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386983_0.png resize: (109, 95) 1338400763 -3.4602761239920503 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386986_0.png resize: (108, 155) 1338400764 -2.998541472402063 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386984_0.png resize: (244, 232) 1338400765 -3.8633811007973633 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386990_0.png resize: (134, 217) 1338400766 -4.650352085332495 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386985_0.png resize: (89, 157) 1338400767 -2.8007525998298646 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387004_0.png resize: (221, 146) 1338400768 -2.452191549669833 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386991_0.png resize: (180, 90) 1338400769 -3.9594416058420867 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386996_0.png resize: (117, 115) 1338400770 -0.2905926043399363 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387001_0.png resize: (186, 298) 1338400771 -3.8819407194377997 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386975_0.png resize: (147, 186) 1338400772 -3.0913480711911085 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386994_0.png resize: (405, 547) 1338400773 -3.8445860953863886 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386980_0.png resize: (307, 250) 1338400774 -2.964612862685685 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386978_0.png resize: (308, 296) 1338400775 -1.3968310320144812 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387006_0.png resize: (59, 74) 1338400776 -3.028775168984788 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387003_0.png resize: (85, 114) 1338400777 -2.7809933555854403 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386982_0.png resize: (180, 283) 1338400778 -4.199936805344282 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386974_0.png resize: (204, 244) 1338400779 -1.3051203652055812 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386999_0.png resize: (197, 182) 1338400780 -2.053259613943793 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386987_0.png resize: (116, 219) 1338400781 -2.9768044362507395 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386976_0.png resize: (253, 146) 1338400782 -1.7471654182213228 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386998_0.png resize: (141, 85) 1338400783 -2.639922498349258 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387005_0.png resize: (121, 177) 1338400784 -2.7420811640575566 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386992_0.png resize: (483, 389) 1338400785 -3.6675841702930416 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386979_0.png resize: (126, 113) 1338400786 -1.1814246745098373 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386977_0.png resize: (233, 226) 1338400787 -3.1362475369864837 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387007_0.png resize: (168, 173) 1338400788 -1.7689058085623943 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387031_0.png resize: (234, 166) 1338400789 -1.9242708451371453 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387013_0.png resize: (127, 210) 1338400790 -1.9504094158265566 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387042_0.png resize: (149, 193) 1338400791 -2.6642396440900007 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387034_0.png resize: (66, 123) 1338400792 -2.5355623970263235 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387027_0.png resize: (181, 176) 1338400793 -1.4793806062002632 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387033_0.png resize: (170, 142) 1338400794 -3.460379076882694 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387035_0.png resize: (130, 152) 1338400795 -2.5223754755723715 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387043_0.png resize: (233, 331) 1338400796 -3.4344375373362106 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387021_0.png resize: (191, 138) 1338400797 -2.6680961154116227 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387052_0.png resize: (60, 167) 1338400798 -2.488888780166136 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387010_0.png resize: (190, 165) 1338400799 -2.7213296525743127 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387014_0.png resize: (159, 213) 1338400800 -3.950762082588917 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387036_0.png resize: (116, 192) 1338400801 -2.1538855831805965 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387044_0.png resize: (138, 141) 1338400802 -2.6310695455952673 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387011_0.png resize: (185, 276) 1338400803 -4.303489551107545 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387030_0.png resize: (85, 122) 1338400804 0.1647412468769944 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387046_0.png resize: (106, 196) 1338400805 -3.8793990094244606 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387039_0.png resize: (85, 118) 1338400806 -2.4509557031511786 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387050_0.png resize: (72, 104) 1338400807 -2.802695262186504 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387026_0.png resize: (113, 121) 1338400808 -3.103134959263593 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387020_0.png resize: (239, 346) 1338400809 -2.901096633055023 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387040_0.png resize: (139, 200) 1338400810 -2.2418712869320636 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387008_0.png resize: (162, 148) 1338400811 -0.7674904080159878 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387048_0.png resize: (196, 169) 1338400812 -4.744619409139596 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387024_0.png resize: (150, 159) 1338400813 -3.1781110783938216 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387017_0.png resize: (202, 313) 1338400814 -1.5562883622593793 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387009_0.png resize: (167, 214) 1338400815 -4.037395453967565 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387022_0.png resize: (250, 289) 1338400816 -2.3362744832335967 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387049_0.png resize: (144, 124) 1338400817 -4.1228192780992865 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387051_0.png resize: (181, 271) 1338400818 -2.0920654811869475 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387038_0.png resize: (155, 291) 1338400819 -2.8735951031144578 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387041_0.png resize: (232, 153) 1338400820 -3.0095494536068106 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387018_0.png resize: (246, 118) 1338400821 -2.9760959324431195 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387016_0.png resize: (115, 135) 1338400822 -1.991175139119351 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387032_0.png resize: (127, 59) 1338400823 -2.8792861741786107 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387029_0.png resize: (211, 180) 1338400824 -1.9499468562786157 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387047_0.png resize: (161, 244) 1338400825 -2.357346876186455 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387025_0.png resize: (148, 148) 1338400826 -4.377263963027183 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387045_0.png resize: (157, 218) 1338400827 -2.922364342227949 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387060_0.png resize: (160, 263) 1338400828 -2.5463011458862845 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387056_0.png resize: (139, 166) 1338400829 -3.6513472460732883 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387057_0.png resize: (111, 116) 1338400830 -0.3886408503715187 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387055_0.png resize: (73, 72) 1338400831 -2.733024768422953 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387063_0.png resize: (104, 134) 1338400832 -3.849940089062438 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387070_0.png resize: (59, 89) 1338400833 -1.5085630283472349 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387065_0.png resize: (212, 92) 1338400834 -2.990986988571209 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387061_0.png resize: (878, 1104) 1338400835 -0.6516082245295625 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387068_0.png resize: (257, 187) 1338400836 -1.9117197745107606 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387059_0.png resize: (278, 220) 1338400837 -2.608012270958729 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387062_0.png resize: (460, 471) 1338400838 -3.7086528790455606 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387067_0.png resize: (206, 286) 1338400839 -0.004528037182765579 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387053_0.png resize: (232, 141) 1338400840 -2.5409458440219304 treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386857_0.png resize: (746, 834) 1338400845 -0.9930510980230965 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386873_0.png resize: (211, 204) 1338400847 -2.8001108925530223 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386863_0.png resize: (208, 77) 1338400848 -1.083451545669707 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386870_0.png resize: (67, 105) 1338400849 -3.945581949745637 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386859_0.png resize: (54, 102) 1338400850 -1.7017896165845687 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386860_0.png resize: (206, 654) 1338400851 -1.2485336288857085 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386862_0.png resize: (87, 175) 1338400852 -0.6521223962356668 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386891_0.png resize: (488, 480) 1338400853 -1.3312436551005329 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386886_0.png resize: (208, 130) 1338400854 -2.3389961885703348 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386889_0.png resize: (104, 124) 1338400855 -2.2285155129056284 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386877_0.png resize: (138, 133) 1338400856 -1.4736803788709358 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386888_0.png resize: (328, 184) 1338400857 -2.3102075280676675 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386900_0.png resize: (182, 193) 1338400858 -1.6707545993050614 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386899_0.png resize: (266, 282) 1338400859 -2.027402413373005 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386894_0.png resize: (108, 133) 1338400860 -1.5160747462166904 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386883_0.png resize: (172, 204) 1338400861 -2.8688284676062734 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386885_0.png resize: (69, 154) 1338400862 -1.8084173334383817 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386881_0.png resize: (472, 617) 1338400863 -1.0186816777007015 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386897_0.png resize: (325, 311) 1338400864 -1.8338517996745591 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386895_0.png resize: (123, 141) 1338400865 -1.2364291196585142 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386879_0.png resize: (529, 568) 1338400866 -1.4823511337492332 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386912_0.png resize: (139, 105) 1338400867 -1.5943784486345545 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386929_0.png resize: (75, 156) 1338400868 -1.9573867268381182 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386932_0.png resize: (140, 109) 1338400869 -3.3572086520666673 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386920_0.png resize: (89, 119) 1338400870 -2.5009017188246325 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386913_0.png resize: (195, 201) 1338400871 -1.3084564143209987 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386907_0.png resize: (147, 150) 1338400872 -4.137225684801969 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386940_0.png resize: (426, 385) 1338400873 -0.9390852318460196 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386934_0.png resize: (434, 394) 1338400874 -1.4130648810214774 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386948_0.png resize: (324, 386) 1338400875 -1.3312879551274146 treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386953_0.png resize: (146, 182) 1338400876 -3.362927188700839 treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386958_0.png resize: (220, 315) 1338400877 -4.7017089278110555 treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386951_0.png resize: (219, 292) 1338400878 -3.9537054705672956 treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386955_0.png resize: (344, 347) 1338400879 -3.204527289238264 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386989_0.png resize: (207, 172) 1338400880 -2.355405760116128 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387000_0.png resize: (101, 148) 1338400881 -3.516830001209997 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387002_0.png resize: (152, 206) 1338400882 -2.3010588269180086 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386988_0.png resize: (276, 202) 1338400883 -3.3002773449760268 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386997_0.png resize: (142, 174) 1338400884 -2.9235007275184186 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387037_0.png resize: (130, 99) 1338400885 -1.7073989286086624 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387019_0.png resize: (193, 238) 1338400886 -2.733902350588189 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387028_0.png resize: (148, 186) 1338400887 -3.481197651531403 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387012_0.png resize: (132, 204) 1338400889 -2.946436862796446 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387015_0.png resize: (249, 238) 1338400890 -4.20915362003231 treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387023_0.png resize: (157, 171) 1338400891 -2.4964600316896344 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387071_0.png resize: (185, 249) 1338400892 -3.0222136087608384 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387066_0.png resize: (115, 216) 1338400893 -2.05432754885498 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387054_0.png resize: (176, 259) 1338400894 -1.026038919970418 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387064_0.png resize: (205, 601) 1338400895 -2.5053259043043337 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387058_0.png resize: (230, 250) 1338400896 -2.0575699195542736 treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386856_0.png resize: (82, 95) 1338400897 -1.7144078877112496 treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387069_0.png resize: (127, 133) 1338400898 -2.368125803551923 treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386852_0.png resize: (194, 184) 1338400900 -3.8413703848676852 treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386854_0.png resize: (387, 349) 1338400901 -3.062643348014365 treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386871_0.png resize: (95, 206) 1338400902 -4.2193600019102515 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386946_0.png resize: (617, 726) 1338400903 -1.4787941897175545 treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386943_0.png resize: (537, 322) 1338400904 -2.33946591365789 treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386957_0.png resize: (400, 609) 1338400905 -4.432653266604576 treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386993_0.png resize: (247, 314) 1338400906 -3.1901240489522618 treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386884_0.png resize: (280, 506) 1338400907 -2.7212934644975992 treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386909_0.png resize: (96, 100) 1338400908 -0.20773083365847475 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 230 time used for this insertion : 0.02325916290283203 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 230 time used for this insertion : 0.0447845458984375 save missing photos in datou_result : time spend for datou_step_exec : 38.21086835861206 time spend to save output : 0.07406306266784668 total time spend for step 6 : 38.28493142127991 step7:brightness Tue Feb 18 22:56:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f.jpg treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149.jpg treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d.jpg treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780.jpg treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa.jpg treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef.jpg treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94.jpg treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3.jpg treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d.jpg treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4.jpg treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386858_0.png treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386853_0.png treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386855_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386868_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386874_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386865_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386864_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386866_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386869_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386872_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386867_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386861_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386892_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386882_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386890_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386898_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386893_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386878_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386876_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386875_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386887_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386896_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386880_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386927_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386922_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386905_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386918_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386903_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386923_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386911_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386919_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386908_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386915_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386906_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386902_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386931_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386925_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386924_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386930_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386917_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386916_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386910_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386914_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386926_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386921_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386904_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386901_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386928_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386936_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386944_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386933_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386938_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386937_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386939_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386947_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386941_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386945_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386942_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386935_0.png treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386950_0.png treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386949_0.png treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386956_0.png treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386959_0.png treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386954_0.png treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386952_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386963_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386972_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386965_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386962_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386961_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386968_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386970_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386960_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386973_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386964_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386967_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386966_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386971_0.png treat image : temp/1739915429_1468192_1338361450_fdc03f89d625172e0e9e076c68e80c94_rle_crop_3679386969_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386995_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386981_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386983_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386986_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386984_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386990_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386985_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387004_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386991_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386996_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387001_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386975_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386994_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386980_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386978_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387006_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387003_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386982_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386974_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386999_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386987_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386976_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386998_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387005_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386992_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386979_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386977_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387007_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387031_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387013_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387042_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387034_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387027_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387033_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387035_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387043_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387021_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387052_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387010_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387014_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387036_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387044_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387011_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387030_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387046_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387039_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387050_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387026_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387020_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387040_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387008_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387048_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387024_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387017_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387009_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387022_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387049_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387051_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387038_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387041_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387018_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387016_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387032_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387029_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387047_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387025_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387045_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387060_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387056_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387057_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387055_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387063_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387070_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387065_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387061_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387068_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387059_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387062_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387067_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387053_0.png treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386857_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386873_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386863_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386870_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386859_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386860_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386862_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386891_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386886_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386889_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386877_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386888_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386900_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386899_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386894_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386883_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386885_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386881_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386897_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386895_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386879_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386912_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386929_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386932_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386920_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386913_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386907_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386940_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386934_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386948_0.png treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386953_0.png treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386958_0.png treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386951_0.png treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386955_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386989_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387000_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679387002_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386988_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386997_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387037_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387019_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387028_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387012_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387015_0.png treat image : temp/1739915429_1468192_1338361101_0fe67ff3a2fce92c085b7c7e88c2a15d_rle_crop_3679387023_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387071_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387066_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387054_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387064_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387058_0.png treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386856_0.png treat image : temp/1739915429_1468192_1338361007_850cf10f82dcdbf2c6f06e5b2e2b92a4_rle_crop_3679387069_0.png treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386852_0.png treat image : temp/1739915429_1468192_1338368088_b4ffd7c272dfc3645fbfa383d090fc2f_rle_crop_3679386854_0.png treat image : temp/1739915429_1468192_1338368084_64024336aea48a7625aaa5860cdeb149_rle_crop_3679386871_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386946_0.png treat image : temp/1739915429_1468192_1338361616_0fdd02ab70fff6423ff5fa9e40cbfbfa_rle_crop_3679386943_0.png treat image : temp/1739915429_1468192_1338361454_b683441bf6a6b20a7392779a5faa61ef_rle_crop_3679386957_0.png treat image : temp/1739915429_1468192_1338361240_645d2ae837139e10540d82e0452a50b3_rle_crop_3679386993_0.png treat image : temp/1739915429_1468192_1338368081_52f78518dc3e9fe518cd2689f958bb7d_rle_crop_3679386884_0.png treat image : temp/1739915429_1468192_1338361619_f08d6d4e04fe2a6db66cdd081f71d780_rle_crop_3679386909_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 230 time used for this insertion : 0.030431747436523438 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 230 time used for this insertion : 0.04482412338256836 save missing photos in datou_result : time spend for datou_step_exec : 9.799230337142944 time spend to save output : 0.09304976463317871 total time spend for step 7 : 9.892280101776123 step8:velours_tree Tue Feb 18 22:56:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.5474286079406738 time spend to save output : 3.9577484130859375e-05 total time spend for step 8 : 0.5474681854248047 step9:send_mail_cod Tue Feb 18 22:56:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20656300_18-02-2025_22_56_27.pdf 20657319 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206573191739915787 20657320 imagette206573201739915787 20657321 imagette206573211739915787 20657322 change filename to text .change filename to text .imagette206573221739915787 20657323 change filename to text .change filename to text .imagette206573231739915788 20657325 imagette206573251739915788 20657326 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206573261739915788 20657327 imagette206573271739915789 20657328 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206573281739915789 20657329 imagette206573291739915790 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20656300 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20657319,20657320,20657321,20657322,20657323,20657324,20657325,20657326,20657327,20657328,20657329?tags=pet_clair,flou,background,metal,pehd,environnement,mal_croppe,carton,autre,papier,pet_fonce args[1338368088] : ((1338368088, -2.3138799954078118, 492609224), (1338368088, -0.31790385704782687, 496442774), '0.1236803711646696') We are sending mail with results at report@fotonower.com args[1338368084] : ((1338368084, -2.795376128731218, 492609224), (1338368084, -0.2551052549672561, 496442774), '0.1236803711646696') We are sending mail with results at report@fotonower.com args[1338368081] : ((1338368081, -2.4471216395609896, 492609224), (1338368081, -0.3190887524010063, 496442774), '0.1236803711646696') We are sending mail with results at report@fotonower.com args[1338361619] : ((1338361619, -4.4201962903549115, 492609224), (1338361619, -0.39611983318010885, 496442774), '0.1236803711646696') We are sending mail with results at report@fotonower.com args[1338361616] : ((1338361616, -0.8443457950661116, 492688767), (1338361616, -0.42956981935311994, 496442774), '0.1236803711646696') We are sending mail with results at report@fotonower.com args[1338361454] : ((1338361454, -3.669190422188833, 492609224), (1338361454, -0.03687438450994293, 2107752395), '0.1236803711646696') We are sending mail with results at report@fotonower.com args[1338361450] : ((1338361450, -4.577444684616987, 492609224), (1338361450, -0.2410840176547498, 496442774), '0.1236803711646696') We are sending mail with results at report@fotonower.com args[1338361240] : ((1338361240, -4.8649745479754225, 492609224), (1338361240, -0.31206455835595315, 496442774), '0.1236803711646696') We are sending mail with results at report@fotonower.com args[1338361101] : ((1338361101, -5.486577225539306, 492609224), (1338361101, -0.2864945487881381, 496442774), '0.1236803711646696') We are sending mail with results at report@fotonower.com args[1338361007] : ((1338361007, -3.9418042054252567, 492609224), (1338361007, -0.41410756984555713, 496442774), '0.1236803711646696') We are sending mail with results at report@fotonower.com refus_total : 0.1236803711646696 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20656300 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 error for generate pdf : 'flou' message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20656300

https://www.fotonower.com/image?json=false&list_photos_id=1338368088
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338368084
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338368081
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338361619
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338361616
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338361454
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338361450
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338361240
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338361101
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338361007
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.37%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/20657319?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/20657322?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/20657323?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20657326?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/20657328?limit=200
Lien vers velours :https://www.fotonower.com/velours/20657319,20657320,20657321,20657322,20657323,20657324,20657325,20657326,20657327,20657328,20657329?tags=pet_clair,flou,background,metal,pehd,environnement,mal_croppe,carton,autre,papier,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 18 Feb 2025 21:56:31 GMT Content-Length: 0 Connection: close X-Message-Id: RCP8kcILRWasXGQXm70Xtw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1338368088, 1338368084, 1338368081, 1338361619, 1338361616, 1338361454, 1338361450, 1338361240, 1338361101, 1338361007] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368088', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368084', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368081', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361619', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361616', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361454', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361450', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361240', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361101', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361007', None, None, None, None, None, '2597839') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01416921615600586 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.400145053863525 time spend to save output : 0.014373064041137695 total time spend for step 9 : 4.414518117904663 step10:split_time_score Tue Feb 18 22:56:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 18022025 20656300 Nombre de photos uploadées : 10 / 23040 (0%) 18022025 20656300 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 18022025 20656300 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 9.5367431640625e-07 elapsed_time : order_list_meta_photo_and_scores 4.291534423828125e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005283355712890625 elapsed_time : insert_dashboard_record_day_entry 0.022523880004882812 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656270 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656272 order by id desc limit 1 Qualite : 0.05161465064052396 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656275 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656275 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656276 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656278 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656285 order by id desc limit 1 Qualite : 0.056029600838106944 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656288 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656288 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656296 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656297 order by id desc limit 1 Qualite : 0.1236803711646696 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656300 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656300 AND mptpi.`type`=3594 To do Qualite : 0.05733613433293486 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656307 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656307 AND mptpi.`type`=3726 To do Qualite : 0.1353382296205519 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656308 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656308 AND mptpi.`type`=3594 To do Qualite : 0.14370025178687454 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656310 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656310 AND mptpi.`type`=3594 To do Qualite : 0.12531199605386817 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20656312 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20656312 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'18022025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1338368088, 1338368084, 1338368081, 1338361619, 1338361616, 1338361454, 1338361450, 1338361240, 1338361101, 1338361007] Looping around the photos to save general results len do output : 1 /20656300Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368088', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368084', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338368081', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361619', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361616', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361454', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361450', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361240', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361101', None, None, None, None, None, '2597839') ('3318', None, None, None, None, None, None, None, '2597839') ('3318', '20656300', '1338361007', None, None, None, None, None, '2597839') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.013798952102661133 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.000253438949585 time spend to save output : 0.013996124267578125 total time spend for step 10 : 11.014249563217163 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 169.06user 116.42system 6:16.93elapsed 75%CPU (0avgtext+0avgdata 6649704maxresident)k 755416inputs+111176outputs (6766major+16047754minor)pagefaults 0swaps