python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3319467 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2745607'] with mtr_portfolio_ids : ['22278784'] and first list_photo_ids : [] new path : /proc/3319467/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 1.9202351570129395 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Apr 21 20:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-21 20:20:32.220714: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-21 20:20:32.251350: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-21 20:20:32.253048: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fdbbc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-21 20:20:32.253092: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-21 20:20:32.256147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-21 20:20:32.503545: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x18777c90 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-21 20:20:32.503595: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-21 20:20:32.504739: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-21 20:20:32.505200: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-21 20:20:32.508032: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-21 20:20:32.510728: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-21 20:20:32.511246: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-21 20:20:32.514043: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-21 20:20:32.515230: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-21 20:20:32.520210: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-21 20:20:32.521818: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-21 20:20:32.521916: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-21 20:20:32.522736: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-21 20:20:32.522758: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-21 20:20:32.522771: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-21 20:20:32.524248: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-21 20:20:32.836502: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-21 20:20:32.836622: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-21 20:20:32.836647: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-21 20:20:32.836669: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-21 20:20:32.836690: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-21 20:20:32.836711: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-21 20:20:32.836731: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-21 20:20:32.836751: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-21 20:20:32.838437: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-21 20:20:32.840066: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-21 20:20:32.840186: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-21 20:20:32.840210: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-21 20:20:32.840230: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-21 20:20:32.840251: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-21 20:20:32.840271: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-21 20:20:32.840290: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-21 20:20:32.840311: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-21 20:20:32.842050: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-21 20:20:32.842103: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-21 20:20:32.842115: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-21 20:20:32.842125: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-21 20:20:32.843964: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-21 20:20:44.221356: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-21 20:20:44.397749: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 43 Detection mask done ! Trying to reset tf kernel 3320107 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1748 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.003854036331176758 nb_pixel_total : 168672 time to create 1 rle with new method : 0.008437871932983398 length of segment : 533 time for calcul the mask position with numpy : 0.0007607936859130859 nb_pixel_total : 47767 time to create 1 rle with old method : 0.054541826248168945 length of segment : 372 time for calcul the mask position with numpy : 0.0005397796630859375 nb_pixel_total : 24682 time to create 1 rle with old method : 0.02849888801574707 length of segment : 324 time for calcul the mask position with numpy : 0.0019466876983642578 nb_pixel_total : 131760 time to create 1 rle with old method : 0.1594982147216797 length of segment : 318 time for calcul the mask position with numpy : 0.0013077259063720703 nb_pixel_total : 92430 time to create 1 rle with old method : 0.12889957427978516 length of segment : 338 time for calcul the mask position with numpy : 0.0016140937805175781 nb_pixel_total : 125173 time to create 1 rle with old method : 0.13837504386901855 length of segment : 350 time for calcul the mask position with numpy : 0.001402139663696289 nb_pixel_total : 50994 time to create 1 rle with old method : 0.07117533683776855 length of segment : 300 time for calcul the mask position with numpy : 0.0013110637664794922 nb_pixel_total : 85827 time to create 1 rle with old method : 0.12391901016235352 length of segment : 337 time for calcul the mask position with numpy : 0.0001983642578125 nb_pixel_total : 6831 time to create 1 rle with old method : 0.010263204574584961 length of segment : 86 time for calcul the mask position with numpy : 0.0005524158477783203 nb_pixel_total : 24294 time to create 1 rle with old method : 0.034860849380493164 length of segment : 199 time for calcul the mask position with numpy : 0.0006134510040283203 nb_pixel_total : 31089 time to create 1 rle with old method : 0.04999518394470215 length of segment : 228 time for calcul the mask position with numpy : 0.0003745555877685547 nb_pixel_total : 16860 time to create 1 rle with old method : 0.024380922317504883 length of segment : 127 time for calcul the mask position with numpy : 0.0008482933044433594 nb_pixel_total : 36735 time to create 1 rle with old method : 0.06070828437805176 length of segment : 286 time for calcul the mask position with numpy : 0.00020074844360351562 nb_pixel_total : 7580 time to create 1 rle with old method : 0.012842178344726562 length of segment : 98 time for calcul the mask position with numpy : 0.001819610595703125 nb_pixel_total : 54966 time to create 1 rle with old method : 0.0868220329284668 length of segment : 256 time for calcul the mask position with numpy : 0.0011065006256103516 nb_pixel_total : 36274 time to create 1 rle with old method : 0.0702505111694336 length of segment : 204 time for calcul the mask position with numpy : 0.0002675056457519531 nb_pixel_total : 6172 time to create 1 rle with old method : 0.012476682662963867 length of segment : 75 time for calcul the mask position with numpy : 0.2591891288757324 nb_pixel_total : 384541 time to create 1 rle with new method : 0.02358388900756836 length of segment : 914 time for calcul the mask position with numpy : 0.0005183219909667969 nb_pixel_total : 27760 time to create 1 rle with old method : 0.03124380111694336 length of segment : 310 time for calcul the mask position with numpy : 0.0006997585296630859 nb_pixel_total : 40557 time to create 1 rle with old method : 0.04618716239929199 length of segment : 187 time for calcul the mask position with numpy : 0.0005123615264892578 nb_pixel_total : 21939 time to create 1 rle with old method : 0.02932453155517578 length of segment : 143 time for calcul the mask position with numpy : 0.0005583763122558594 nb_pixel_total : 26460 time to create 1 rle with old method : 0.03509163856506348 length of segment : 237 time for calcul the mask position with numpy : 0.0005178451538085938 nb_pixel_total : 34907 time to create 1 rle with old method : 0.04001593589782715 length of segment : 222 time for calcul the mask position with numpy : 0.00033211708068847656 nb_pixel_total : 13361 time to create 1 rle with old method : 0.015365839004516602 length of segment : 117 time for calcul the mask position with numpy : 0.0001957416534423828 nb_pixel_total : 7240 time to create 1 rle with old method : 0.008800506591796875 length of segment : 100 time for calcul the mask position with numpy : 0.0003249645233154297 nb_pixel_total : 15754 time to create 1 rle with old method : 0.01817607879638672 length of segment : 190 time for calcul the mask position with numpy : 0.00011730194091796875 nb_pixel_total : 3652 time to create 1 rle with old method : 0.004343748092651367 length of segment : 69 time for calcul the mask position with numpy : 0.0001652240753173828 nb_pixel_total : 8412 time to create 1 rle with old method : 0.009717941284179688 length of segment : 110 time for calcul the mask position with numpy : 0.0006551742553710938 nb_pixel_total : 28246 time to create 1 rle with old method : 0.03143811225891113 length of segment : 326 time for calcul the mask position with numpy : 0.00013303756713867188 nb_pixel_total : 4220 time to create 1 rle with old method : 0.004914760589599609 length of segment : 79 time for calcul the mask position with numpy : 0.00029468536376953125 nb_pixel_total : 11885 time to create 1 rle with old method : 0.01324319839477539 length of segment : 159 time for calcul the mask position with numpy : 0.00020503997802734375 nb_pixel_total : 9658 time to create 1 rle with old method : 0.0108489990234375 length of segment : 106 time for calcul the mask position with numpy : 0.001608133316040039 nb_pixel_total : 52987 time to create 1 rle with old method : 0.05874800682067871 length of segment : 527 time for calcul the mask position with numpy : 0.00018262863159179688 nb_pixel_total : 7457 time to create 1 rle with old method : 0.00908803939819336 length of segment : 66 time for calcul the mask position with numpy : 0.0009353160858154297 nb_pixel_total : 42809 time to create 1 rle with old method : 0.06909418106079102 length of segment : 242 time for calcul the mask position with numpy : 0.00037407875061035156 nb_pixel_total : 15203 time to create 1 rle with old method : 0.017041921615600586 length of segment : 195 time for calcul the mask position with numpy : 0.0011262893676757812 nb_pixel_total : 61508 time to create 1 rle with old method : 0.06777715682983398 length of segment : 392 time for calcul the mask position with numpy : 0.00026679039001464844 nb_pixel_total : 12456 time to create 1 rle with old method : 0.014421224594116211 length of segment : 172 time for calcul the mask position with numpy : 0.0002474784851074219 nb_pixel_total : 12267 time to create 1 rle with old method : 0.014529228210449219 length of segment : 146 time for calcul the mask position with numpy : 0.00026297569274902344 nb_pixel_total : 12225 time to create 1 rle with old method : 0.015261173248291016 length of segment : 118 time for calcul the mask position with numpy : 0.0002903938293457031 nb_pixel_total : 13046 time to create 1 rle with old method : 0.014944791793823242 length of segment : 146 time for calcul the mask position with numpy : 0.0004291534423828125 nb_pixel_total : 22664 time to create 1 rle with old method : 0.026866674423217773 length of segment : 223 time for calcul the mask position with numpy : 0.0003998279571533203 nb_pixel_total : 15433 time to create 1 rle with old method : 0.01922440528869629 length of segment : 128 time for calcul the mask position with numpy : 0.004530429840087891 nb_pixel_total : 216370 time to create 1 rle with new method : 0.017781496047973633 length of segment : 525 time for calcul the mask position with numpy : 0.0024797916412353516 nb_pixel_total : 123926 time to create 1 rle with old method : 0.14741015434265137 length of segment : 482 time for calcul the mask position with numpy : 0.0006191730499267578 nb_pixel_total : 27976 time to create 1 rle with old method : 0.0340123176574707 length of segment : 270 time for calcul the mask position with numpy : 0.000667572021484375 nb_pixel_total : 21650 time to create 1 rle with old method : 0.029239416122436523 length of segment : 450 time for calcul the mask position with numpy : 0.00033402442932128906 nb_pixel_total : 13655 time to create 1 rle with old method : 0.015022993087768555 length of segment : 129 time for calcul the mask position with numpy : 0.0006372928619384766 nb_pixel_total : 15013 time to create 1 rle with old method : 0.016474008560180664 length of segment : 165 time for calcul the mask position with numpy : 0.0024368762969970703 nb_pixel_total : 151538 time to create 1 rle with new method : 0.007433176040649414 length of segment : 404 time for calcul the mask position with numpy : 0.009877204895019531 nb_pixel_total : 378774 time to create 1 rle with new method : 0.05437350273132324 length of segment : 1061 time for calcul the mask position with numpy : 0.0006585121154785156 nb_pixel_total : 25815 time to create 1 rle with old method : 0.036119937896728516 length of segment : 211 time for calcul the mask position with numpy : 0.0024759769439697266 nb_pixel_total : 111806 time to create 1 rle with old method : 0.12295746803283691 length of segment : 328 time for calcul the mask position with numpy : 0.0004725456237792969 nb_pixel_total : 13198 time to create 1 rle with old method : 0.01557302474975586 length of segment : 188 time for calcul the mask position with numpy : 0.00719761848449707 nb_pixel_total : 251550 time to create 1 rle with new method : 0.042252540588378906 length of segment : 893 time for calcul the mask position with numpy : 0.0048656463623046875 nb_pixel_total : 121450 time to create 1 rle with old method : 0.13088011741638184 length of segment : 588 time for calcul the mask position with numpy : 0.0030345916748046875 nb_pixel_total : 75524 time to create 1 rle with old method : 0.08667254447937012 length of segment : 339 time for calcul the mask position with numpy : 0.0022461414337158203 nb_pixel_total : 33592 time to create 1 rle with old method : 0.03737950325012207 length of segment : 280 time for calcul the mask position with numpy : 0.0023479461669921875 nb_pixel_total : 34128 time to create 1 rle with old method : 0.03658318519592285 length of segment : 274 time for calcul the mask position with numpy : 0.0007596015930175781 nb_pixel_total : 14300 time to create 1 rle with old method : 0.02612447738647461 length of segment : 112 time for calcul the mask position with numpy : 0.0016057491302490234 nb_pixel_total : 17220 time to create 1 rle with old method : 0.025743484497070312 length of segment : 257 time for calcul the mask position with numpy : 0.0003838539123535156 nb_pixel_total : 17042 time to create 1 rle with old method : 0.01886749267578125 length of segment : 119 time for calcul the mask position with numpy : 0.00024390220642089844 nb_pixel_total : 8773 time to create 1 rle with old method : 0.009706258773803711 length of segment : 104 time for calcul the mask position with numpy : 0.0002865791320800781 nb_pixel_total : 10940 time to create 1 rle with old method : 0.011980533599853516 length of segment : 148 time for calcul the mask position with numpy : 0.00018978118896484375 nb_pixel_total : 7881 time to create 1 rle with old method : 0.008594751358032227 length of segment : 140 time for calcul the mask position with numpy : 0.000225067138671875 nb_pixel_total : 8208 time to create 1 rle with old method : 0.008858680725097656 length of segment : 137 time for calcul the mask position with numpy : 0.0002586841583251953 nb_pixel_total : 10303 time to create 1 rle with old method : 0.011306524276733398 length of segment : 128 time for calcul the mask position with numpy : 0.0006661415100097656 nb_pixel_total : 29435 time to create 1 rle with old method : 0.03149724006652832 length of segment : 242 time for calcul the mask position with numpy : 0.0010101795196533203 nb_pixel_total : 37767 time to create 1 rle with old method : 0.04144883155822754 length of segment : 164 time for calcul the mask position with numpy : 0.0008490085601806641 nb_pixel_total : 20259 time to create 1 rle with old method : 0.022004127502441406 length of segment : 158 time for calcul the mask position with numpy : 0.0008118152618408203 nb_pixel_total : 15760 time to create 1 rle with old method : 0.017371177673339844 length of segment : 131 time for calcul the mask position with numpy : 0.0005419254302978516 nb_pixel_total : 10715 time to create 1 rle with old method : 0.011604547500610352 length of segment : 131 time for calcul the mask position with numpy : 0.0011110305786132812 nb_pixel_total : 32133 time to create 1 rle with old method : 0.03580307960510254 length of segment : 136 time for calcul the mask position with numpy : 0.0008928775787353516 nb_pixel_total : 18898 time to create 1 rle with old method : 0.020177125930786133 length of segment : 161 time for calcul the mask position with numpy : 0.002030611038208008 nb_pixel_total : 41876 time to create 1 rle with old method : 0.050839900970458984 length of segment : 216 time for calcul the mask position with numpy : 0.002681732177734375 nb_pixel_total : 59240 time to create 1 rle with old method : 0.06339383125305176 length of segment : 291 time for calcul the mask position with numpy : 0.0022606849670410156 nb_pixel_total : 51778 time to create 1 rle with old method : 0.05899620056152344 length of segment : 299 time for calcul the mask position with numpy : 0.0007982254028320312 nb_pixel_total : 19438 time to create 1 rle with old method : 0.021711111068725586 length of segment : 217 time for calcul the mask position with numpy : 0.002538442611694336 nb_pixel_total : 61387 time to create 1 rle with old method : 0.06828689575195312 length of segment : 328 time for calcul the mask position with numpy : 0.0014240741729736328 nb_pixel_total : 33898 time to create 1 rle with old method : 0.03951907157897949 length of segment : 213 time for calcul the mask position with numpy : 0.005716800689697266 nb_pixel_total : 129246 time to create 1 rle with old method : 0.1428985595703125 length of segment : 486 time for calcul the mask position with numpy : 0.007386207580566406 nb_pixel_total : 215881 time to create 1 rle with new method : 0.013919353485107422 length of segment : 740 time for calcul the mask position with numpy : 0.0004949569702148438 nb_pixel_total : 18852 time to create 1 rle with old method : 0.021068334579467773 length of segment : 189 time for calcul the mask position with numpy : 0.0017490386962890625 nb_pixel_total : 34483 time to create 1 rle with old method : 0.03937792778015137 length of segment : 277 time for calcul the mask position with numpy : 0.001901388168334961 nb_pixel_total : 52050 time to create 1 rle with old method : 0.057541608810424805 length of segment : 396 time for calcul the mask position with numpy : 0.002621889114379883 nb_pixel_total : 48949 time to create 1 rle with old method : 0.05310368537902832 length of segment : 308 time for calcul the mask position with numpy : 0.00032639503479003906 nb_pixel_total : 6160 time to create 1 rle with old method : 0.007245063781738281 length of segment : 77 time for calcul the mask position with numpy : 0.0006501674652099609 nb_pixel_total : 16177 time to create 1 rle with old method : 0.01812434196472168 length of segment : 123 time for calcul the mask position with numpy : 0.0054471492767333984 nb_pixel_total : 210714 time to create 1 rle with new method : 0.010431766510009766 length of segment : 333 time for calcul the mask position with numpy : 0.0016295909881591797 nb_pixel_total : 40718 time to create 1 rle with old method : 0.0448307991027832 length of segment : 264 time for calcul the mask position with numpy : 0.0021445751190185547 nb_pixel_total : 66569 time to create 1 rle with old method : 0.07146334648132324 length of segment : 308 time for calcul the mask position with numpy : 0.0013437271118164062 nb_pixel_total : 34825 time to create 1 rle with old method : 0.03873944282531738 length of segment : 246 time for calcul the mask position with numpy : 0.0009388923645019531 nb_pixel_total : 23656 time to create 1 rle with old method : 0.026458024978637695 length of segment : 169 time for calcul the mask position with numpy : 0.0010378360748291016 nb_pixel_total : 25632 time to create 1 rle with old method : 0.027412891387939453 length of segment : 242 time for calcul the mask position with numpy : 0.0005254745483398438 nb_pixel_total : 7943 time to create 1 rle with old method : 0.008465051651000977 length of segment : 158 time for calcul the mask position with numpy : 0.0014612674713134766 nb_pixel_total : 36191 time to create 1 rle with old method : 0.059842586517333984 length of segment : 275 time for calcul the mask position with numpy : 0.0010008811950683594 nb_pixel_total : 29997 time to create 1 rle with old method : 0.03238272666931152 length of segment : 234 time for calcul the mask position with numpy : 0.009290695190429688 nb_pixel_total : 354982 time to create 1 rle with new method : 0.024852275848388672 length of segment : 654 time for calcul the mask position with numpy : 0.0008590221405029297 nb_pixel_total : 13871 time to create 1 rle with old method : 0.015633106231689453 length of segment : 212 time for calcul the mask position with numpy : 0.0005381107330322266 nb_pixel_total : 13508 time to create 1 rle with old method : 0.015594244003295898 length of segment : 131 time for calcul the mask position with numpy : 0.0012176036834716797 nb_pixel_total : 37776 time to create 1 rle with old method : 0.04215693473815918 length of segment : 327 time for calcul the mask position with numpy : 0.0011115074157714844 nb_pixel_total : 23173 time to create 1 rle with old method : 0.025597572326660156 length of segment : 263 time for calcul the mask position with numpy : 0.0007786750793457031 nb_pixel_total : 16359 time to create 1 rle with old method : 0.01812577247619629 length of segment : 202 time for calcul the mask position with numpy : 0.0002942085266113281 nb_pixel_total : 8628 time to create 1 rle with old method : 0.009512662887573242 length of segment : 91 time for calcul the mask position with numpy : 0.0006351470947265625 nb_pixel_total : 11353 time to create 1 rle with old method : 0.012472391128540039 length of segment : 221 time for calcul the mask position with numpy : 0.0014188289642333984 nb_pixel_total : 49735 time to create 1 rle with old method : 0.054021596908569336 length of segment : 204 time for calcul the mask position with numpy : 0.0005869865417480469 nb_pixel_total : 18563 time to create 1 rle with old method : 0.020345687866210938 length of segment : 147 time for calcul the mask position with numpy : 0.0006909370422363281 nb_pixel_total : 21599 time to create 1 rle with old method : 0.023548364639282227 length of segment : 179 time for calcul the mask position with numpy : 0.0022170543670654297 nb_pixel_total : 58112 time to create 1 rle with old method : 0.06451416015625 length of segment : 394 time for calcul the mask position with numpy : 0.0010590553283691406 nb_pixel_total : 20551 time to create 1 rle with old method : 0.023031234741210938 length of segment : 257 time for calcul the mask position with numpy : 0.0004680156707763672 nb_pixel_total : 9037 time to create 1 rle with old method : 0.00984501838684082 length of segment : 94 time for calcul the mask position with numpy : 0.0010364055633544922 nb_pixel_total : 21002 time to create 1 rle with old method : 0.021759510040283203 length of segment : 196 time for calcul the mask position with numpy : 0.0012044906616210938 nb_pixel_total : 26482 time to create 1 rle with old method : 0.028271913528442383 length of segment : 204 time for calcul the mask position with numpy : 0.0015788078308105469 nb_pixel_total : 28291 time to create 1 rle with old method : 0.045623779296875 length of segment : 195 time for calcul the mask position with numpy : 0.0004923343658447266 nb_pixel_total : 9323 time to create 1 rle with old method : 0.010374069213867188 length of segment : 89 time for calcul the mask position with numpy : 0.0014295578002929688 nb_pixel_total : 30509 time to create 1 rle with old method : 0.0338592529296875 length of segment : 235 time for calcul the mask position with numpy : 0.001341104507446289 nb_pixel_total : 24748 time to create 1 rle with old method : 0.026819705963134766 length of segment : 233 time for calcul the mask position with numpy : 0.0023288726806640625 nb_pixel_total : 50110 time to create 1 rle with old method : 0.05408215522766113 length of segment : 385 time for calcul the mask position with numpy : 0.006367206573486328 nb_pixel_total : 144177 time to create 1 rle with old method : 0.15834569931030273 length of segment : 523 time for calcul the mask position with numpy : 0.003558635711669922 nb_pixel_total : 85414 time to create 1 rle with old method : 0.09441256523132324 length of segment : 628 time for calcul the mask position with numpy : 0.003658771514892578 nb_pixel_total : 102410 time to create 1 rle with old method : 0.10989069938659668 length of segment : 467 time for calcul the mask position with numpy : 0.0005738735198974609 nb_pixel_total : 13758 time to create 1 rle with old method : 0.01605057716369629 length of segment : 87 time for calcul the mask position with numpy : 0.0042438507080078125 nb_pixel_total : 114288 time to create 1 rle with old method : 0.12193012237548828 length of segment : 301 time for calcul the mask position with numpy : 0.008221864700317383 nb_pixel_total : 219534 time to create 1 rle with new method : 0.012741565704345703 length of segment : 691 time for calcul the mask position with numpy : 0.0006103515625 nb_pixel_total : 10442 time to create 1 rle with old method : 0.012181282043457031 length of segment : 122 time for calcul the mask position with numpy : 0.0004918575286865234 nb_pixel_total : 9591 time to create 1 rle with old method : 0.01153254508972168 length of segment : 211 time for calcul the mask position with numpy : 0.0012552738189697266 nb_pixel_total : 24271 time to create 1 rle with old method : 0.027385473251342773 length of segment : 240 time for calcul the mask position with numpy : 0.0007233619689941406 nb_pixel_total : 18517 time to create 1 rle with old method : 0.021610021591186523 length of segment : 121 time for calcul the mask position with numpy : 0.00081634521484375 nb_pixel_total : 15426 time to create 1 rle with old method : 0.018096208572387695 length of segment : 301 time for calcul the mask position with numpy : 0.006409406661987305 nb_pixel_total : 176642 time to create 1 rle with new method : 0.008173465728759766 length of segment : 795 time for calcul the mask position with numpy : 0.0038018226623535156 nb_pixel_total : 92895 time to create 1 rle with old method : 0.1056513786315918 length of segment : 251 time for calcul the mask position with numpy : 0.0037009716033935547 nb_pixel_total : 121926 time to create 1 rle with old method : 0.1360015869140625 length of segment : 615 time for calcul the mask position with numpy : 0.0016465187072753906 nb_pixel_total : 36947 time to create 1 rle with old method : 0.04232358932495117 length of segment : 217 time for calcul the mask position with numpy : 0.0005781650543212891 nb_pixel_total : 18804 time to create 1 rle with old method : 0.029839754104614258 length of segment : 221 time for calcul the mask position with numpy : 0.0051991939544677734 nb_pixel_total : 142060 time to create 1 rle with old method : 0.15701699256896973 length of segment : 550 time for calcul the mask position with numpy : 0.020287513732910156 nb_pixel_total : 587712 time to create 1 rle with new method : 0.05044221878051758 length of segment : 1219 time for calcul the mask position with numpy : 0.002393960952758789 nb_pixel_total : 55675 time to create 1 rle with old method : 0.06231951713562012 length of segment : 288 time for calcul the mask position with numpy : 0.006039619445800781 nb_pixel_total : 165558 time to create 1 rle with new method : 0.007539987564086914 length of segment : 505 time for calcul the mask position with numpy : 0.0007445812225341797 nb_pixel_total : 15620 time to create 1 rle with old method : 0.017775297164916992 length of segment : 169 time for calcul the mask position with numpy : 0.0025517940521240234 nb_pixel_total : 78516 time to create 1 rle with old method : 0.10488390922546387 length of segment : 661 time for calcul the mask position with numpy : 0.011933326721191406 nb_pixel_total : 409915 time to create 1 rle with new method : 0.017881155014038086 length of segment : 628 time for calcul the mask position with numpy : 0.0022306442260742188 nb_pixel_total : 37050 time to create 1 rle with old method : 0.04183673858642578 length of segment : 327 time for calcul the mask position with numpy : 0.002803802490234375 nb_pixel_total : 45254 time to create 1 rle with old method : 0.050445556640625 length of segment : 263 time for calcul the mask position with numpy : 0.001386404037475586 nb_pixel_total : 36447 time to create 1 rle with old method : 0.040686845779418945 length of segment : 263 time for calcul the mask position with numpy : 0.0017709732055664062 nb_pixel_total : 38033 time to create 1 rle with old method : 0.042899370193481445 length of segment : 328 time for calcul the mask position with numpy : 0.0044934749603271484 nb_pixel_total : 111648 time to create 1 rle with old method : 0.1480257511138916 length of segment : 717 time for calcul the mask position with numpy : 0.0010867118835449219 nb_pixel_total : 41804 time to create 1 rle with old method : 0.049144744873046875 length of segment : 296 time for calcul the mask position with numpy : 0.002020597457885742 nb_pixel_total : 54204 time to create 1 rle with old method : 0.05961465835571289 length of segment : 283 time for calcul the mask position with numpy : 0.004217624664306641 nb_pixel_total : 128894 time to create 1 rle with old method : 0.13831806182861328 length of segment : 446 time for calcul the mask position with numpy : 0.0034427642822265625 nb_pixel_total : 69419 time to create 1 rle with old method : 0.0770101547241211 length of segment : 348 time for calcul the mask position with numpy : 0.0015785694122314453 nb_pixel_total : 36381 time to create 1 rle with old method : 0.0400853157043457 length of segment : 328 time for calcul the mask position with numpy : 0.004337787628173828 nb_pixel_total : 150574 time to create 1 rle with new method : 0.009395599365234375 length of segment : 853 time for calcul the mask position with numpy : 0.004833698272705078 nb_pixel_total : 207182 time to create 1 rle with new method : 0.011466026306152344 length of segment : 590 time for calcul the mask position with numpy : 0.002548694610595703 nb_pixel_total : 150985 time to create 1 rle with new method : 0.008939027786254883 length of segment : 896 time for calcul the mask position with numpy : 0.0011444091796875 nb_pixel_total : 35219 time to create 1 rle with old method : 0.0365900993347168 length of segment : 317 time for calcul the mask position with numpy : 0.0025756359100341797 nb_pixel_total : 49817 time to create 1 rle with old method : 0.07288932800292969 length of segment : 524 time for calcul the mask position with numpy : 0.004332304000854492 nb_pixel_total : 198719 time to create 1 rle with new method : 0.006838560104370117 length of segment : 349 time for calcul the mask position with numpy : 0.006110668182373047 nb_pixel_total : 346715 time to create 1 rle with new method : 0.013388633728027344 length of segment : 868 time for calcul the mask position with numpy : 0.010340213775634766 nb_pixel_total : 243156 time to create 1 rle with new method : 0.025999784469604492 length of segment : 769 time for calcul the mask position with numpy : 0.0020492076873779297 nb_pixel_total : 75272 time to create 1 rle with old method : 0.0865790843963623 length of segment : 463 time for calcul the mask position with numpy : 0.0012886524200439453 nb_pixel_total : 68786 time to create 1 rle with old method : 0.08235359191894531 length of segment : 442 time for calcul the mask position with numpy : 0.0005166530609130859 nb_pixel_total : 20419 time to create 1 rle with old method : 0.024631261825561523 length of segment : 139 time for calcul the mask position with numpy : 0.008042097091674805 nb_pixel_total : 374219 time to create 1 rle with new method : 0.023221492767333984 length of segment : 765 time for calcul the mask position with numpy : 0.0007236003875732422 nb_pixel_total : 14047 time to create 1 rle with old method : 0.016566038131713867 length of segment : 222 time for calcul the mask position with numpy : 0.003164052963256836 nb_pixel_total : 56643 time to create 1 rle with old method : 0.06668949127197266 length of segment : 418 time for calcul the mask position with numpy : 0.0061762332916259766 nb_pixel_total : 315393 time to create 1 rle with new method : 0.023334264755249023 length of segment : 962 time for calcul the mask position with numpy : 0.022354841232299805 nb_pixel_total : 547129 time to create 1 rle with new method : 0.03789639472961426 length of segment : 1093 time for calcul the mask position with numpy : 0.0071811676025390625 nb_pixel_total : 314799 time to create 1 rle with new method : 0.025474071502685547 length of segment : 727 time for calcul the mask position with numpy : 0.0038170814514160156 nb_pixel_total : 83718 time to create 1 rle with old method : 0.09179496765136719 length of segment : 664 time for calcul the mask position with numpy : 0.00106048583984375 nb_pixel_total : 19551 time to create 1 rle with old method : 0.022377729415893555 length of segment : 210 time for calcul the mask position with numpy : 0.0016596317291259766 nb_pixel_total : 33060 time to create 1 rle with old method : 0.037795305252075195 length of segment : 322 time for calcul the mask position with numpy : 0.001007080078125 nb_pixel_total : 27031 time to create 1 rle with old method : 0.030498266220092773 length of segment : 184 time for calcul the mask position with numpy : 0.0012836456298828125 nb_pixel_total : 29918 time to create 1 rle with old method : 0.033608198165893555 length of segment : 174 time for calcul the mask position with numpy : 0.011838912963867188 nb_pixel_total : 214876 time to create 1 rle with new method : 0.02931976318359375 length of segment : 951 time for calcul the mask position with numpy : 0.00109100341796875 nb_pixel_total : 34648 time to create 1 rle with old method : 0.039797067642211914 length of segment : 216 time for calcul the mask position with numpy : 0.0009849071502685547 nb_pixel_total : 43325 time to create 1 rle with old method : 0.04953646659851074 length of segment : 348 time for calcul the mask position with numpy : 0.0011181831359863281 nb_pixel_total : 37798 time to create 1 rle with old method : 0.04211235046386719 length of segment : 185 time for calcul the mask position with numpy : 0.0009417533874511719 nb_pixel_total : 19513 time to create 1 rle with old method : 0.021211862564086914 length of segment : 180 time for calcul the mask position with numpy : 0.006407022476196289 nb_pixel_total : 209001 time to create 1 rle with new method : 0.010744571685791016 length of segment : 722 time for calcul the mask position with numpy : 0.02547478675842285 nb_pixel_total : 785644 time to create 1 rle with new method : 0.05653953552246094 length of segment : 1079 time for calcul the mask position with numpy : 0.0007059574127197266 nb_pixel_total : 16676 time to create 1 rle with old method : 0.01917266845703125 length of segment : 406 time for calcul the mask position with numpy : 0.0051670074462890625 nb_pixel_total : 160723 time to create 1 rle with new method : 0.006913185119628906 length of segment : 690 time for calcul the mask position with numpy : 0.004972934722900391 nb_pixel_total : 152983 time to create 1 rle with new method : 0.006667375564575195 length of segment : 504 time for calcul the mask position with numpy : 0.00038909912109375 nb_pixel_total : 14688 time to create 1 rle with old method : 0.016657590866088867 length of segment : 176 time spent for convertir_results : 16.751352071762085 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 184 chid ids of type : 3594 Number RLEs to save : 61030 save missing photos in datou_result : time spend for datou_step_exec : 80.77361917495728 time spend to save output : 3.681481122970581 total time spend for step 1 : 84.45510029792786 step2:crop_condition Mon Apr 21 20:21:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 184 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 128 About to insert : list_path_to_insert length 128 new photo from crops ! About to upload 128 photos upload in portfolio : 3736932 init cache_photo without model_param we have 128 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745259754_3319467 we have uploaded 128 photos in the portfolio 3736932 time of upload the photos Elapsed time : 48.11742877960205 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745259811_3319467 we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.084758043289185 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745259832_3319467 we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.346475601196289 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745259842_3319467 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2728030681610107 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745259845_3319467 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6392762660980225 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1352450237, 1352450111, 1352449514, 1352449511, 1352449507, 1352449479, 1352449185, 1352449159, 1352449157, 1352449154, 1352449153] Looping around the photos to save general results len do output : 184 /1352453050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1352453516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352450237', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352450111', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449514', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449511', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449507', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449479', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449185', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449159', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449157', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449154', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449153', None, None, None, None, None, '2745607') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 563 time used for this insertion : 0.03312516212463379 save_final save missing photos in datou_result : time spend for datou_step_exec : 131.84251761436462 time spend to save output : 0.03817868232727051 total time spend for step 2 : 131.8806962966919 step3:rle_unique_nms_with_priority Mon Apr 21 20:24:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 184 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 2.8152170181274414 time for calcul the mask position with numpy : 0.5573391914367676 nb_pixel_total : 6316104 time to create 1 rle with new method : 0.6516304016113281 time for calcul the mask position with numpy : 0.02309441566467285 nb_pixel_total : 6831 time to create 1 rle with old method : 0.007729053497314453 time for calcul the mask position with numpy : 0.028629302978515625 nb_pixel_total : 85827 time to create 1 rle with old method : 0.09788894653320312 time for calcul the mask position with numpy : 0.02166581153869629 nb_pixel_total : 50994 time to create 1 rle with old method : 0.057210445404052734 time for calcul the mask position with numpy : 0.022164583206176758 nb_pixel_total : 125173 time to create 1 rle with old method : 0.13761663436889648 time for calcul the mask position with numpy : 0.022027254104614258 nb_pixel_total : 92430 time to create 1 rle with old method : 0.09963011741638184 time for calcul the mask position with numpy : 0.02160358428955078 nb_pixel_total : 131760 time to create 1 rle with old method : 0.1376819610595703 time for calcul the mask position with numpy : 0.020276308059692383 nb_pixel_total : 24682 time to create 1 rle with old method : 0.026092052459716797 time for calcul the mask position with numpy : 0.021122455596923828 nb_pixel_total : 47767 time to create 1 rle with old method : 0.05194425582885742 time for calcul the mask position with numpy : 0.02259230613708496 nb_pixel_total : 168672 time to create 1 rle with new method : 0.5599603652954102 create new chi : 2.6408002376556396 time to delete rle : 0.021750688552856445 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 8076 TO DO : save crop sub photo not yet done ! save time : 0.5340828895568848 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 3.458609104156494 time for calcul the mask position with numpy : 0.48748087882995605 nb_pixel_total : 6472577 time to create 1 rle with new method : 0.5900871753692627 time for calcul the mask position with numpy : 0.019791126251220703 nb_pixel_total : 27760 time to create 1 rle with old method : 0.02885913848876953 time for calcul the mask position with numpy : 0.02321648597717285 nb_pixel_total : 335933 time to create 1 rle with new method : 1.0068116188049316 time for calcul the mask position with numpy : 0.021630287170410156 nb_pixel_total : 6172 time to create 1 rle with old method : 0.006551027297973633 time for calcul the mask position with numpy : 0.021554946899414062 nb_pixel_total : 36274 time to create 1 rle with old method : 0.038726091384887695 time for calcul the mask position with numpy : 0.02072763442993164 nb_pixel_total : 54966 time to create 1 rle with old method : 0.05820107460021973 time for calcul the mask position with numpy : 0.020769596099853516 nb_pixel_total : 7580 time to create 1 rle with old method : 0.008043050765991211 time for calcul the mask position with numpy : 0.02132129669189453 nb_pixel_total : 36735 time to create 1 rle with old method : 0.03896355628967285 time for calcul the mask position with numpy : 0.021895170211791992 nb_pixel_total : 16860 time to create 1 rle with old method : 0.019421100616455078 time for calcul the mask position with numpy : 0.02439260482788086 nb_pixel_total : 31089 time to create 1 rle with old method : 0.04439067840576172 time for calcul the mask position with numpy : 0.022655725479125977 nb_pixel_total : 24294 time to create 1 rle with old method : 0.02709197998046875 create new chi : 2.628605365753174 time to delete rle : 0.0010159015655517578 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++Number RLEs to save : 7292 TO DO : save crop sub photo not yet done ! save time : 0.48889923095703125 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 7.59647274017334 time for calcul the mask position with numpy : 0.5317115783691406 nb_pixel_total : 6571530 time to create 1 rle with new method : 0.5382084846496582 time for calcul the mask position with numpy : 0.029102325439453125 nb_pixel_total : 22664 time to create 1 rle with old method : 0.023736000061035156 time for calcul the mask position with numpy : 0.034078121185302734 nb_pixel_total : 12849 time to create 1 rle with old method : 0.014604568481445312 time for calcul the mask position with numpy : 0.03441572189331055 nb_pixel_total : 12225 time to create 1 rle with old method : 0.013312578201293945 time for calcul the mask position with numpy : 0.033345699310302734 nb_pixel_total : 12267 time to create 1 rle with old method : 0.013543128967285156 time for calcul the mask position with numpy : 0.03447556495666504 nb_pixel_total : 12456 time to create 1 rle with old method : 0.014016866683959961 time for calcul the mask position with numpy : 0.03414130210876465 nb_pixel_total : 61508 time to create 1 rle with old method : 0.06789493560791016 time for calcul the mask position with numpy : 0.03571915626525879 nb_pixel_total : 15203 time to create 1 rle with old method : 0.01897883415222168 time for calcul the mask position with numpy : 0.03518319129943848 nb_pixel_total : 42809 time to create 1 rle with old method : 0.04766964912414551 time for calcul the mask position with numpy : 0.03629803657531738 nb_pixel_total : 7451 time to create 1 rle with old method : 0.008350133895874023 time for calcul the mask position with numpy : 0.03593707084655762 nb_pixel_total : 52987 time to create 1 rle with old method : 0.05941367149353027 time for calcul the mask position with numpy : 0.034714698791503906 nb_pixel_total : 9658 time to create 1 rle with old method : 0.010781526565551758 time for calcul the mask position with numpy : 0.03975081443786621 nb_pixel_total : 11885 time to create 1 rle with old method : 0.019298315048217773 time for calcul the mask position with numpy : 0.04025101661682129 nb_pixel_total : 4220 time to create 1 rle with old method : 0.006814718246459961 time for calcul the mask position with numpy : 0.03673601150512695 nb_pixel_total : 28246 time to create 1 rle with old method : 0.031522274017333984 time for calcul the mask position with numpy : 0.03638815879821777 nb_pixel_total : 8412 time to create 1 rle with old method : 0.00945425033569336 time for calcul the mask position with numpy : 0.034748077392578125 nb_pixel_total : 3652 time to create 1 rle with old method : 0.0041425228118896484 time for calcul the mask position with numpy : 0.03499031066894531 nb_pixel_total : 15754 time to create 1 rle with old method : 0.019831180572509766 time for calcul the mask position with numpy : 0.03547787666320801 nb_pixel_total : 7240 time to create 1 rle with old method : 0.008199453353881836 time for calcul the mask position with numpy : 0.034317731857299805 nb_pixel_total : 13361 time to create 1 rle with old method : 0.01503610610961914 time for calcul the mask position with numpy : 0.03436088562011719 nb_pixel_total : 34907 time to create 1 rle with old method : 0.03828787803649902 time for calcul the mask position with numpy : 0.03371119499206543 nb_pixel_total : 26460 time to create 1 rle with old method : 0.029716968536376953 time for calcul the mask position with numpy : 0.033377885818481445 nb_pixel_total : 21939 time to create 1 rle with old method : 0.0246121883392334 time for calcul the mask position with numpy : 0.040959835052490234 nb_pixel_total : 40557 time to create 1 rle with old method : 0.04840421676635742 create new chi : 2.4691355228424072 time to delete rle : 0.005120277404785156 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 10658 TO DO : save crop sub photo not yet done ! save time : 0.6620776653289795 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 6.334036111831665 time for calcul the mask position with numpy : 0.5235927104949951 nb_pixel_total : 5409434 time to create 1 rle with new method : 0.5419838428497314 time for calcul the mask position with numpy : 0.0378570556640625 nb_pixel_total : 17220 time to create 1 rle with old method : 0.019126415252685547 time for calcul the mask position with numpy : 0.03516244888305664 nb_pixel_total : 14300 time to create 1 rle with old method : 0.016006946563720703 time for calcul the mask position with numpy : 0.03722977638244629 nb_pixel_total : 33807 time to create 1 rle with old method : 0.039682626724243164 time for calcul the mask position with numpy : 0.03630638122558594 nb_pixel_total : 33549 time to create 1 rle with old method : 0.03665947914123535 time for calcul the mask position with numpy : 0.03234434127807617 nb_pixel_total : 75524 time to create 1 rle with old method : 0.08274292945861816 time for calcul the mask position with numpy : 0.0330815315246582 nb_pixel_total : 121450 time to create 1 rle with old method : 0.13007545471191406 time for calcul the mask position with numpy : 0.03411149978637695 nb_pixel_total : 230521 time to create 1 rle with new method : 0.36498236656188965 time for calcul the mask position with numpy : 0.03422236442565918 nb_pixel_total : 13198 time to create 1 rle with old method : 0.0212862491607666 time for calcul the mask position with numpy : 0.0372467041015625 nb_pixel_total : 111087 time to create 1 rle with old method : 0.1189870834350586 time for calcul the mask position with numpy : 0.02128744125366211 nb_pixel_total : 25815 time to create 1 rle with old method : 0.02796316146850586 time for calcul the mask position with numpy : 0.02388787269592285 nb_pixel_total : 378774 time to create 1 rle with new method : 0.858893632888794 time for calcul the mask position with numpy : 0.022439956665039062 nb_pixel_total : 151538 time to create 1 rle with new method : 0.6584701538085938 time for calcul the mask position with numpy : 0.0218355655670166 nb_pixel_total : 15013 time to create 1 rle with old method : 0.016138553619384766 time for calcul the mask position with numpy : 0.020526885986328125 nb_pixel_total : 13655 time to create 1 rle with old method : 0.014306068420410156 time for calcul the mask position with numpy : 0.021499156951904297 nb_pixel_total : 21650 time to create 1 rle with old method : 0.023738622665405273 time for calcul the mask position with numpy : 0.020484447479248047 nb_pixel_total : 27976 time to create 1 rle with old method : 0.030358076095581055 time for calcul the mask position with numpy : 0.022358179092407227 nb_pixel_total : 123926 time to create 1 rle with old method : 0.13325142860412598 time for calcul the mask position with numpy : 0.022580862045288086 nb_pixel_total : 216370 time to create 1 rle with new method : 0.6953723430633545 time for calcul the mask position with numpy : 0.021950721740722656 nb_pixel_total : 15433 time to create 1 rle with old method : 0.017104625701904297 create new chi : 5.035709381103516 time to delete rle : 0.002569913864135742 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 16214 TO DO : save crop sub photo not yet done ! save time : 0.9915969371795654 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 4.814967155456543 time for calcul the mask position with numpy : 0.5724341869354248 nb_pixel_total : 6721010 time to create 1 rle with new method : 0.5934648513793945 time for calcul the mask position with numpy : 0.019990921020507812 nb_pixel_total : 59240 time to create 1 rle with old method : 0.0632009506225586 time for calcul the mask position with numpy : 0.019158363342285156 nb_pixel_total : 41876 time to create 1 rle with old method : 0.04752969741821289 time for calcul the mask position with numpy : 0.03344440460205078 nb_pixel_total : 18898 time to create 1 rle with old method : 0.020526885986328125 time for calcul the mask position with numpy : 0.031004905700683594 nb_pixel_total : 32133 time to create 1 rle with old method : 0.03381061553955078 time for calcul the mask position with numpy : 0.030731678009033203 nb_pixel_total : 10715 time to create 1 rle with old method : 0.011464595794677734 time for calcul the mask position with numpy : 0.026789426803588867 nb_pixel_total : 15760 time to create 1 rle with old method : 0.01661229133605957 time for calcul the mask position with numpy : 0.020209789276123047 nb_pixel_total : 20259 time to create 1 rle with old method : 0.020834922790527344 time for calcul the mask position with numpy : 0.02138042449951172 nb_pixel_total : 37767 time to create 1 rle with old method : 0.04111814498901367 time for calcul the mask position with numpy : 0.02202010154724121 nb_pixel_total : 29435 time to create 1 rle with old method : 0.031908273696899414 time for calcul the mask position with numpy : 0.021162748336791992 nb_pixel_total : 10303 time to create 1 rle with old method : 0.011271476745605469 time for calcul the mask position with numpy : 0.020290613174438477 nb_pixel_total : 8208 time to create 1 rle with old method : 0.00917959213256836 time for calcul the mask position with numpy : 0.021864891052246094 nb_pixel_total : 7881 time to create 1 rle with old method : 0.008640050888061523 time for calcul the mask position with numpy : 0.02092456817626953 nb_pixel_total : 10940 time to create 1 rle with old method : 0.015186548233032227 time for calcul the mask position with numpy : 0.020698070526123047 nb_pixel_total : 8773 time to create 1 rle with old method : 0.00959467887878418 time for calcul the mask position with numpy : 0.020435571670532227 nb_pixel_total : 17042 time to create 1 rle with old method : 0.0179440975189209 create new chi : 1.9107401371002197 time to delete rle : 0.0009415149688720703 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 6972 TO DO : save crop sub photo not yet done ! save time : 0.46149349212646484 nb_obj : 20 nb_hashtags : 2 time to prepare the origin masks : 6.269777059555054 time for calcul the mask position with numpy : 0.5245933532714844 nb_pixel_total : 5932315 time to create 1 rle with new method : 0.7989425659179688 time for calcul the mask position with numpy : 0.02623438835144043 nb_pixel_total : 35898 time to create 1 rle with old method : 0.037897348403930664 time for calcul the mask position with numpy : 0.020078182220458984 nb_pixel_total : 7943 time to create 1 rle with old method : 0.008532047271728516 time for calcul the mask position with numpy : 0.02064824104309082 nb_pixel_total : 25632 time to create 1 rle with old method : 0.026819944381713867 time for calcul the mask position with numpy : 0.028331279754638672 nb_pixel_total : 23656 time to create 1 rle with old method : 0.02405071258544922 time for calcul the mask position with numpy : 0.03122091293334961 nb_pixel_total : 34825 time to create 1 rle with old method : 0.0356442928314209 time for calcul the mask position with numpy : 0.032308101654052734 nb_pixel_total : 66569 time to create 1 rle with old method : 0.06991910934448242 time for calcul the mask position with numpy : 0.032917022705078125 nb_pixel_total : 40718 time to create 1 rle with old method : 0.04411149024963379 time for calcul the mask position with numpy : 0.036511898040771484 nb_pixel_total : 210714 time to create 1 rle with new method : 0.5550544261932373 time for calcul the mask position with numpy : 0.03214311599731445 nb_pixel_total : 16177 time to create 1 rle with old method : 0.01689624786376953 time for calcul the mask position with numpy : 0.03195357322692871 nb_pixel_total : 6160 time to create 1 rle with old method : 0.006531953811645508 time for calcul the mask position with numpy : 0.034705162048339844 nb_pixel_total : 48949 time to create 1 rle with old method : 0.05022692680358887 time for calcul the mask position with numpy : 0.03137040138244629 nb_pixel_total : 52050 time to create 1 rle with old method : 0.05307149887084961 time for calcul the mask position with numpy : 0.031723737716674805 nb_pixel_total : 34483 time to create 1 rle with old method : 0.03547024726867676 time for calcul the mask position with numpy : 0.02158665657043457 nb_pixel_total : 3234 time to create 1 rle with old method : 0.0035028457641601562 time for calcul the mask position with numpy : 0.020725727081298828 nb_pixel_total : 215170 time to create 1 rle with new method : 0.6696090698242188 time for calcul the mask position with numpy : 0.02100682258605957 nb_pixel_total : 129246 time to create 1 rle with old method : 0.1366274356842041 time for calcul the mask position with numpy : 0.0209043025970459 nb_pixel_total : 33898 time to create 1 rle with old method : 0.03505754470825195 time for calcul the mask position with numpy : 0.020774126052856445 nb_pixel_total : 61387 time to create 1 rle with old method : 0.06386852264404297 time for calcul the mask position with numpy : 0.021073579788208008 nb_pixel_total : 19438 time to create 1 rle with old method : 0.020232200622558594 time for calcul the mask position with numpy : 0.020915508270263672 nb_pixel_total : 51778 time to create 1 rle with old method : 0.05285501480102539 create new chi : 3.8837480545043945 time to delete rle : 0.0029850006103515625 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 13110 TO DO : save crop sub photo not yet done ! save time : 0.8068957328796387 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 4.036846160888672 time for calcul the mask position with numpy : 1.285912275314331 nb_pixel_total : 6395578 time to create 1 rle with new method : 0.7218081951141357 time for calcul the mask position with numpy : 0.03342700004577637 nb_pixel_total : 55118 time to create 1 rle with old method : 0.058443307876586914 time for calcul the mask position with numpy : 0.02057933807373047 nb_pixel_total : 21599 time to create 1 rle with old method : 0.02340555191040039 time for calcul the mask position with numpy : 0.0201570987701416 nb_pixel_total : 18563 time to create 1 rle with old method : 0.021422863006591797 time for calcul the mask position with numpy : 0.03055262565612793 nb_pixel_total : 49735 time to create 1 rle with old method : 0.054647207260131836 time for calcul the mask position with numpy : 0.020574331283569336 nb_pixel_total : 11353 time to create 1 rle with old method : 0.012405872344970703 time for calcul the mask position with numpy : 0.021445274353027344 nb_pixel_total : 8628 time to create 1 rle with old method : 0.009389638900756836 time for calcul the mask position with numpy : 0.02155160903930664 nb_pixel_total : 16359 time to create 1 rle with old method : 0.01790618896484375 time for calcul the mask position with numpy : 0.0208590030670166 nb_pixel_total : 23173 time to create 1 rle with old method : 0.02555704116821289 time for calcul the mask position with numpy : 0.02260613441467285 nb_pixel_total : 37776 time to create 1 rle with old method : 0.04192399978637695 time for calcul the mask position with numpy : 0.023048877716064453 nb_pixel_total : 13508 time to create 1 rle with old method : 0.015278816223144531 time for calcul the mask position with numpy : 0.021263599395751953 nb_pixel_total : 13871 time to create 1 rle with old method : 0.014837503433227539 time for calcul the mask position with numpy : 0.023653507232666016 nb_pixel_total : 354982 time to create 1 rle with new method : 0.7055292129516602 time for calcul the mask position with numpy : 0.02053546905517578 nb_pixel_total : 29997 time to create 1 rle with old method : 0.03203582763671875 create new chi : 3.397794008255005 time to delete rle : 0.0011699199676513672 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 8448 TO DO : save crop sub photo not yet done ! save time : 0.5201270580291748 nb_obj : 25 nb_hashtags : 3 time to prepare the origin masks : 7.43416428565979 time for calcul the mask position with numpy : 0.43518829345703125 nb_pixel_total : 5634809 time to create 1 rle with new method : 0.6849732398986816 time for calcul the mask position with numpy : 0.020062685012817383 nb_pixel_total : 15115 time to create 1 rle with old method : 0.016061782836914062 time for calcul the mask position with numpy : 0.02014613151550293 nb_pixel_total : 36947 time to create 1 rle with old method : 0.03952670097351074 time for calcul the mask position with numpy : 0.022582530975341797 nb_pixel_total : 121926 time to create 1 rle with old method : 0.1280672550201416 time for calcul the mask position with numpy : 0.021494388580322266 nb_pixel_total : 92895 time to create 1 rle with old method : 0.11869287490844727 time for calcul the mask position with numpy : 0.025165081024169922 nb_pixel_total : 170667 time to create 1 rle with new method : 0.4018900394439697 time for calcul the mask position with numpy : 0.021158933639526367 nb_pixel_total : 15426 time to create 1 rle with old method : 0.016593217849731445 time for calcul the mask position with numpy : 0.021408796310424805 nb_pixel_total : 18517 time to create 1 rle with old method : 0.023740768432617188 time for calcul the mask position with numpy : 0.02346062660217285 nb_pixel_total : 24271 time to create 1 rle with old method : 0.03879189491271973 time for calcul the mask position with numpy : 0.02415776252746582 nb_pixel_total : 9591 time to create 1 rle with old method : 0.010891914367675781 time for calcul the mask position with numpy : 0.022772550582885742 nb_pixel_total : 10442 time to create 1 rle with old method : 0.011594295501708984 time for calcul the mask position with numpy : 0.02447056770324707 nb_pixel_total : 219534 time to create 1 rle with new method : 0.8196001052856445 time for calcul the mask position with numpy : 0.02151799201965332 nb_pixel_total : 114288 time to create 1 rle with old method : 0.1434175968170166 time for calcul the mask position with numpy : 0.034909963607788086 nb_pixel_total : 13758 time to create 1 rle with old method : 0.014717578887939453 time for calcul the mask position with numpy : 0.034055471420288086 nb_pixel_total : 102410 time to create 1 rle with old method : 0.10833287239074707 time for calcul the mask position with numpy : 0.035271406173706055 nb_pixel_total : 85414 time to create 1 rle with old method : 0.09441184997558594 time for calcul the mask position with numpy : 0.03888845443725586 nb_pixel_total : 144177 time to create 1 rle with old method : 0.16208362579345703 time for calcul the mask position with numpy : 0.03532218933105469 nb_pixel_total : 50110 time to create 1 rle with old method : 0.055905818939208984 time for calcul the mask position with numpy : 0.021501779556274414 nb_pixel_total : 24748 time to create 1 rle with old method : 0.027853727340698242 time for calcul the mask position with numpy : 0.02172088623046875 nb_pixel_total : 30509 time to create 1 rle with old method : 0.03379654884338379 time for calcul the mask position with numpy : 0.0218045711517334 nb_pixel_total : 9323 time to create 1 rle with old method : 0.010526657104492188 time for calcul the mask position with numpy : 0.021718978881835938 nb_pixel_total : 28291 time to create 1 rle with old method : 0.03141951560974121 time for calcul the mask position with numpy : 0.021330833435058594 nb_pixel_total : 26482 time to create 1 rle with old method : 0.03011608123779297 time for calcul the mask position with numpy : 0.024370193481445312 nb_pixel_total : 21002 time to create 1 rle with old method : 0.023647308349609375 time for calcul the mask position with numpy : 0.022417545318603516 nb_pixel_total : 9037 time to create 1 rle with old method : 0.010175704956054688 time for calcul the mask position with numpy : 0.021924972534179688 nb_pixel_total : 20551 time to create 1 rle with old method : 0.02262139320373535 create new chi : 4.217846155166626 time to delete rle : 0.0028183460235595703 batch 1 Loaded 51 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 17322 TO DO : save crop sub photo not yet done ! save time : 1.023796796798706 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 7.571988344192505 time for calcul the mask position with numpy : 0.46413111686706543 nb_pixel_total : 4632839 time to create 1 rle with new method : 0.4429931640625 time for calcul the mask position with numpy : 0.03464317321777344 nb_pixel_total : 6289 time to create 1 rle with old method : 0.007538795471191406 time for calcul the mask position with numpy : 0.036919355392456055 nb_pixel_total : 206719 time to create 1 rle with new method : 0.6552867889404297 time for calcul the mask position with numpy : 0.03447914123535156 nb_pixel_total : 150574 time to create 1 rle with new method : 0.4501469135284424 time for calcul the mask position with numpy : 0.03313422203063965 nb_pixel_total : 36381 time to create 1 rle with old method : 0.03865623474121094 time for calcul the mask position with numpy : 0.03377389907836914 nb_pixel_total : 69419 time to create 1 rle with old method : 0.07761263847351074 time for calcul the mask position with numpy : 0.0351407527923584 nb_pixel_total : 128894 time to create 1 rle with old method : 0.1424570083618164 time for calcul the mask position with numpy : 0.03273630142211914 nb_pixel_total : 54204 time to create 1 rle with old method : 0.07592153549194336 time for calcul the mask position with numpy : 0.038324832916259766 nb_pixel_total : 41433 time to create 1 rle with old method : 0.04502105712890625 time for calcul the mask position with numpy : 0.03481698036193848 nb_pixel_total : 111648 time to create 1 rle with old method : 0.12133669853210449 time for calcul the mask position with numpy : 0.021802186965942383 nb_pixel_total : 38033 time to create 1 rle with old method : 0.040799617767333984 time for calcul the mask position with numpy : 0.021383285522460938 nb_pixel_total : 36447 time to create 1 rle with old method : 0.03924965858459473 time for calcul the mask position with numpy : 0.02150440216064453 nb_pixel_total : 45254 time to create 1 rle with old method : 0.049648284912109375 time for calcul the mask position with numpy : 0.021099090576171875 nb_pixel_total : 37050 time to create 1 rle with old method : 0.04024195671081543 time for calcul the mask position with numpy : 0.02470564842224121 nb_pixel_total : 409915 time to create 1 rle with new method : 0.8773002624511719 time for calcul the mask position with numpy : 0.03553485870361328 nb_pixel_total : 78516 time to create 1 rle with old method : 0.08815264701843262 time for calcul the mask position with numpy : 0.037155866622924805 nb_pixel_total : 15620 time to create 1 rle with old method : 0.017763376235961914 time for calcul the mask position with numpy : 0.035796403884887695 nb_pixel_total : 165558 time to create 1 rle with new method : 0.8926477432250977 time for calcul the mask position with numpy : 0.03501629829406738 nb_pixel_total : 55675 time to create 1 rle with old method : 0.062288761138916016 time for calcul the mask position with numpy : 0.0396420955657959 nb_pixel_total : 587712 time to create 1 rle with new method : 0.6204049587249756 time for calcul the mask position with numpy : 0.03579235076904297 nb_pixel_total : 142060 time to create 1 rle with old method : 0.15989470481872559 create new chi : 6.202204704284668 time to delete rle : 0.003362417221069336 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 20893 TO DO : save crop sub photo not yet done ! save time : 1.2614622116088867 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 4.520414590835571 time for calcul the mask position with numpy : 0.49979567527770996 nb_pixel_total : 4460378 time to create 1 rle with new method : 0.780864953994751 time for calcul the mask position with numpy : 0.036958932876586914 nb_pixel_total : 314799 time to create 1 rle with new method : 0.4763932228088379 time for calcul the mask position with numpy : 0.03680586814880371 nb_pixel_total : 547129 time to create 1 rle with new method : 0.32586002349853516 time for calcul the mask position with numpy : 0.0422360897064209 nb_pixel_total : 315393 time to create 1 rle with new method : 0.4855775833129883 time for calcul the mask position with numpy : 0.033687591552734375 nb_pixel_total : 56643 time to create 1 rle with old method : 0.06255960464477539 time for calcul the mask position with numpy : 0.03178119659423828 nb_pixel_total : 14047 time to create 1 rle with old method : 0.014858245849609375 time for calcul the mask position with numpy : 0.03251910209655762 nb_pixel_total : 374216 time to create 1 rle with new method : 0.49400830268859863 time for calcul the mask position with numpy : 0.033593177795410156 nb_pixel_total : 18796 time to create 1 rle with old method : 0.02091503143310547 time for calcul the mask position with numpy : 0.031129837036132812 nb_pixel_total : 133 time to create 1 rle with old method : 0.0004947185516357422 time for calcul the mask position with numpy : 0.02871108055114746 nb_pixel_total : 75272 time to create 1 rle with old method : 0.1031491756439209 time for calcul the mask position with numpy : 0.02762603759765625 nb_pixel_total : 243156 time to create 1 rle with new method : 0.6783590316772461 time for calcul the mask position with numpy : 0.023443222045898438 nb_pixel_total : 346523 time to create 1 rle with new method : 0.5112779140472412 time for calcul the mask position with numpy : 0.021960973739624023 nb_pixel_total : 198719 time to create 1 rle with new method : 0.6113338470458984 time for calcul the mask position with numpy : 0.025959253311157227 nb_pixel_total : 49817 time to create 1 rle with old method : 0.052945852279663086 time for calcul the mask position with numpy : 0.03264784812927246 nb_pixel_total : 35219 time to create 1 rle with old method : 0.03740525245666504 create new chi : 5.7885825634002686 time to delete rle : 0.003711223602294922 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 17329 TO DO : save crop sub photo not yet done ! save time : 1.0415699481964111 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 4.635250806808472 time for calcul the mask position with numpy : 0.3614215850830078 nb_pixel_total : 5172934 time to create 1 rle with new method : 0.7495968341827393 time for calcul the mask position with numpy : 0.020606279373168945 nb_pixel_total : 14688 time to create 1 rle with old method : 0.015902042388916016 time for calcul the mask position with numpy : 0.02032923698425293 nb_pixel_total : 152983 time to create 1 rle with new method : 0.6942973136901855 time for calcul the mask position with numpy : 0.02263331413269043 nb_pixel_total : 160723 time to create 1 rle with new method : 0.3591439723968506 time for calcul the mask position with numpy : 0.019689559936523438 nb_pixel_total : 14713 time to create 1 rle with old method : 0.015583276748657227 time for calcul the mask position with numpy : 0.027800321578979492 nb_pixel_total : 785644 time to create 1 rle with new method : 0.30892515182495117 time for calcul the mask position with numpy : 0.0341038703918457 nb_pixel_total : 209001 time to create 1 rle with new method : 0.5767166614532471 time for calcul the mask position with numpy : 0.03328371047973633 nb_pixel_total : 19513 time to create 1 rle with old method : 0.020776748657226562 time for calcul the mask position with numpy : 0.032717227935791016 nb_pixel_total : 37798 time to create 1 rle with old method : 0.04021883010864258 time for calcul the mask position with numpy : 0.033254146575927734 nb_pixel_total : 39441 time to create 1 rle with old method : 0.040673255920410156 time for calcul the mask position with numpy : 0.03165721893310547 nb_pixel_total : 34648 time to create 1 rle with old method : 0.03595876693725586 time for calcul the mask position with numpy : 0.036396026611328125 nb_pixel_total : 214876 time to create 1 rle with new method : 0.4768695831298828 time for calcul the mask position with numpy : 0.03299546241760254 nb_pixel_total : 29918 time to create 1 rle with old method : 0.034089088439941406 time for calcul the mask position with numpy : 0.03297090530395508 nb_pixel_total : 27031 time to create 1 rle with old method : 0.029793262481689453 time for calcul the mask position with numpy : 0.03258514404296875 nb_pixel_total : 33060 time to create 1 rle with old method : 0.03506970405578613 time for calcul the mask position with numpy : 0.03286242485046387 nb_pixel_total : 19551 time to create 1 rle with old method : 0.02118206024169922 time for calcul the mask position with numpy : 0.03338360786437988 nb_pixel_total : 83718 time to create 1 rle with old method : 0.08557868003845215 create new chi : 4.535099983215332 time to delete rle : 0.003569364547729492 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 15927 TO DO : save crop sub photo not yet done ! save time : 0.9641168117523193 map_output_result : {1352450237: (0.0, 'Should be the crop_list due to order', 0), 1352450111: (0.0, 'Should be the crop_list due to order', 0), 1352449514: (0.0, 'Should be the crop_list due to order', 0), 1352449511: (0.0, 'Should be the crop_list due to order', 0), 1352449507: (0.0, 'Should be the crop_list due to order', 0), 1352449479: (0.0, 'Should be the crop_list due to order', 0), 1352449185: (0.0, 'Should be the crop_list due to order', 0), 1352449159: (0.0, 'Should be the crop_list due to order', 0), 1352449157: (0.0, 'Should be the crop_list due to order', 0), 1352449154: (0.0, 'Should be the crop_list due to order', 0), 1352449153: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1352450237, 1352450111, 1352449514, 1352449511, 1352449507, 1352449479, 1352449185, 1352449159, 1352449157, 1352449154, 1352449153] Looping around the photos to save general results len do output : 11 /1352450237.Didn't retrieve data . /1352450111.Didn't retrieve data . /1352449514.Didn't retrieve data . /1352449511.Didn't retrieve data . /1352449507.Didn't retrieve data . /1352449479.Didn't retrieve data . /1352449185.Didn't retrieve data . /1352449159.Didn't retrieve data . /1352449157.Didn't retrieve data . /1352449154.Didn't retrieve data . /1352449153.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352450237', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352450111', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449514', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449511', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449507', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449479', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449185', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449159', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449157', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449154', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449153', None, None, None, None, None, '2745607') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01750493049621582 save_final save missing photos in datou_result : time spend for datou_step_exec : 112.43342018127441 time spend to save output : 0.018004894256591797 total time spend for step 3 : 112.451425075531 step4:ventilate_hashtags_in_portfolio Mon Apr 21 20:25:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22278784 get user id for portfolio 22278784 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22278784 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','papier','mal_croppe','pet_fonce','pehd','pet_clair','carton','autre','metal','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22278784 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','papier','mal_croppe','pet_fonce','pehd','pet_clair','carton','autre','metal','flou')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22278784 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','environnement','papier','mal_croppe','pet_fonce','pehd','pet_clair','carton','autre','metal','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22278786,22278787,22278788,22278789,22278790,22278791,22278792,22278793,22278794,22278795,22278796?tags=background,environnement,papier,mal_croppe,pet_fonce,pehd,pet_clair,carton,autre,metal,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1352450237, 1352450111, 1352449514, 1352449511, 1352449507, 1352449479, 1352449185, 1352449159, 1352449157, 1352449154, 1352449153] Looping around the photos to save general results len do output : 1 /22278784. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352450237', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352450111', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449514', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449511', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449507', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449479', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449185', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449159', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449157', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449154', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449153', None, None, None, None, None, '2745607') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.014787435531616211 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6470439434051514 time spend to save output : 0.015033721923828125 total time spend for step 4 : 1.6620776653289795 step5:final Mon Apr 21 20:25:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1352450237: ('0.17837087170726879',), 1352450111: ('0.17837087170726879',), 1352449514: ('0.17837087170726879',), 1352449511: ('0.17837087170726879',), 1352449507: ('0.17837087170726879',), 1352449479: ('0.17837087170726879',), 1352449185: ('0.17837087170726879',), 1352449159: ('0.17837087170726879',), 1352449157: ('0.17837087170726879',), 1352449154: ('0.17837087170726879',), 1352449153: ('0.17837087170726879',)} new output for save of step final : {1352450237: ('0.17837087170726879',), 1352450111: ('0.17837087170726879',), 1352449514: ('0.17837087170726879',), 1352449511: ('0.17837087170726879',), 1352449507: ('0.17837087170726879',), 1352449479: ('0.17837087170726879',), 1352449185: ('0.17837087170726879',), 1352449159: ('0.17837087170726879',), 1352449157: ('0.17837087170726879',), 1352449154: ('0.17837087170726879',), 1352449153: ('0.17837087170726879',)} [1352450237, 1352450111, 1352449514, 1352449511, 1352449507, 1352449479, 1352449185, 1352449159, 1352449157, 1352449154, 1352449153] Looping around the photos to save general results len do output : 11 /1352450237.Didn't retrieve data . /1352450111.Didn't retrieve data . /1352449514.Didn't retrieve data . /1352449511.Didn't retrieve data . /1352449507.Didn't retrieve data . /1352449479.Didn't retrieve data . /1352449185.Didn't retrieve data . /1352449159.Didn't retrieve data . /1352449157.Didn't retrieve data . /1352449154.Didn't retrieve data . /1352449153.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352450237', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352450111', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449514', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449511', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449507', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449479', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449185', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449159', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449157', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449154', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449153', None, None, None, None, None, '2745607') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01350855827331543 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11870098114013672 time spend to save output : 0.04422879219055176 total time spend for step 5 : 0.16292977333068848 step6:blur_detection Mon Apr 21 20:26:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8.jpg resize: (2160, 3264) 1352450237 -0.8717512149401041 treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c.jpg resize: (2160, 3264) 1352450111 -1.2582953545855946 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca.jpg resize: (2160, 3264) 1352449514 -0.4372584574201867 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c.jpg resize: (2160, 3264) 1352449511 -0.9882038557307465 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a.jpg resize: (2160, 3264) 1352449507 -2.3673083502326007 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd.jpg resize: (2160, 3264) 1352449479 -1.864884339157071 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757.jpg resize: (2160, 3264) 1352449185 -1.5696204453222262 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788.jpg resize: (2160, 3264) 1352449159 -2.499686851553515 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460.jpg resize: (2160, 3264) 1352449157 -1.5644814078165332 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0.jpg resize: (2160, 3264) 1352449154 -1.53153499219254 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba.jpg resize: (2160, 3264) 1352449153 -2.717343064300364 treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054473_0.png resize: (317, 484) 1352453050 0.8581542112950801 treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054470_0.png resize: (533, 493) 1352453051 0.3633448304619546 treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054475_0.png resize: (306, 508) 1352453052 -0.6617178033028761 treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054471_0.png resize: (371, 182) 1352453053 -0.06074049002336747 treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054474_0.png resize: (333, 424) 1352453054 -1.2014742502229094 treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054477_0.png resize: (337, 293) 1352453055 -0.8010657217551503 treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054472_0.png resize: (324, 156) 1352453056 -1.6191921548470862 treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054479_0.png resize: (199, 206) 1352453057 -1.3914626612540615 treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054487_0.png resize: (882, 626) 1352453058 -1.6851815606907774 treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054481_0.png resize: (127, 165) 1352453059 1.7528529239514425 treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054486_0.png resize: (75, 130) 1352453060 -1.3918912375558958 treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054480_0.png resize: (227, 217) 1352453061 -1.0276998563063213 treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054485_0.png resize: (203, 261) 1352453062 -2.2832128165635877 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054499_0.png resize: (77, 74) 1352453063 -0.15056484117123436 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054506_0.png resize: (353, 267) 1352453064 -1.7623284367631455 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054496_0.png resize: (69, 79) 1352453065 -1.0690794514255397 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054507_0.png resize: (167, 97) 1352453066 -0.8634338602783229 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054511_0.png resize: (203, 153) 1352453067 -1.0451656341238267 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054498_0.png resize: (290, 153) 1352453068 -1.0545677195352356 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054500_0.png resize: (154, 167) 1352453070 -0.9278649687960465 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054505_0.png resize: (175, 168) 1352453073 -1.3452013108396168 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054495_0.png resize: (182, 126) 1352453077 -0.253429683085661 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054497_0.png resize: (110, 111) 1352453081 -1.8077936276971682 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054492_0.png resize: (216, 201) 1352453085 -0.13626487055327166 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054503_0.png resize: (59, 155) 1352453089 2.1666566098909654 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054502_0.png resize: (527, 274) 1352453094 -0.8496574945186872 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054490_0.png resize: (142, 226) 1352453097 -0.8011795315414064 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054509_0.png resize: (118, 123) 1352453101 -1.4862180112745162 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054494_0.png resize: (100, 109) 1352453105 -1.270542951741525 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054510_0.png resize: (146, 129) 1352453109 -1.3393066809022698 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054493_0.png resize: (116, 222) 1352453113 -3.056754568917949 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054523_0.png resize: (172, 152) 1352453117 -1.79923209696445 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054514_0.png resize: (412, 553) 1352453121 -1.5972395338093826 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054513_0.png resize: (444, 857) 1352453125 -0.7027065215912874 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054522_0.png resize: (278, 732) 1352453129 -1.399026171118574 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054517_0.png resize: (129, 179) 1352453133 -2.1293065846665216 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054520_0.png resize: (739, 955) 1352453137 -0.9230416733674803 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054524_0.png resize: (749, 777) 1352453140 0.2202736505244355 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054516_0.png resize: (220, 219) 1352453144 -2.4389247684636275 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054530_0.png resize: (253, 120) 1352453148 -1.020150952138021 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054519_0.png resize: (396, 436) 1352453152 -0.9902271551055966 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054529_0.png resize: (111, 196) 1352453156 -1.1982797657508948 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054515_0.png resize: (181, 260) 1352453160 -1.31020560542336 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054518_0.png resize: (154, 155) 1352453164 -2.0989920153462887 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054528_0.png resize: (272, 213) 1352453168 -1.220609400278599 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054525_0.png resize: (572, 271) 1352453171 -1.1468703634700683 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054539_0.png resize: (145, 207) 1352453175 -1.0217955348950445 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054540_0.png resize: (131, 224) 1352453179 -0.9466373973020574 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054535_0.png resize: (137, 85) 1352453183 0.2412274438503082 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054532_0.png resize: (103, 115) 1352453187 -0.6077849306067652 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054541_0.png resize: (131, 115) 1352453191 -0.7441680678393885 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054536_0.png resize: (128, 136) 1352453195 -0.7079567139232812 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054546_0.png resize: (297, 233) 1352453199 -1.392839055374322 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054551_0.png resize: (666, 435) 1352453203 -1.2069250258345101 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054547_0.png resize: (192, 129) 1352453207 -0.9392376823859366 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054549_0.png resize: (203, 239) 1352453211 -1.308270593202101 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054552_0.png resize: (188, 155) 1352453215 -1.9699601736757495 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054562_0.png resize: (157, 214) 1352453219 -0.6148805067015815 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054558_0.png resize: (300, 865) 1352453223 -1.0841795248982302 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054561_0.png resize: (246, 213) 1352453227 -1.1086750044133316 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054564_0.png resize: (158, 81) 1352453231 -1.402404324223562 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054553_0.png resize: (274, 232) 1352453235 -1.0315849039205436 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054548_0.png resize: (288, 320) 1352453238 -0.9679790774434052 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054557_0.png resize: (121, 191) 1352453242 0.06871784450065666 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054563_0.png resize: (241, 175) 1352453246 -0.7681580838646831 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054550_0.png resize: (486, 420) 1352453250 -2.307639884108537 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054555_0.png resize: (263, 298) 1352453254 -1.189171773942276 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054556_0.png resize: (75, 127) 1352453258 -2.339947097575753 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054566_0.png resize: (234, 205) 1352453262 -1.7467380737281262 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054577_0.png resize: (162, 220) 1352453266 -1.7127619414461408 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054569_0.png resize: (128, 155) 1352453270 -1.4057441568313547 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054576_0.png resize: (147, 181) 1352453274 0.38944038609305215 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054572_0.png resize: (170, 166) 1352453278 -2.749009736096795 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054568_0.png resize: (181, 182) 1352453282 -2.9776764725778007 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054570_0.png resize: (309, 163) 1352453286 -0.9143465129976225 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054573_0.png resize: (90, 126) 1352453289 -1.0735969299974533 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054588_0.png resize: (522, 474) 1352453293 -1.1833143741310297 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054587_0.png resize: (379, 195) 1352453297 -1.0414007581092617 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054591_0.png resize: (87, 240) 1352453301 -0.8055591820726882 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054594_0.png resize: (122, 162) 1352453305 -1.0678856812948436 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054596_0.png resize: (240, 186) 1352453309 -2.7734361561324445 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054602_0.png resize: (217, 268) 1352453313 -0.3586459155680812 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054586_0.png resize: (229, 201) 1352453317 -1.7838290603654718 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054584_0.png resize: (89, 122) 1352453321 0.599279068740304 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054589_0.png resize: (520, 238) 1352453325 -0.20990515293825146 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054590_0.png resize: (467, 348) 1352453329 -1.2982651474646365 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054600_0.png resize: (234, 520) 1352453333 -3.220091775983369 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054580_0.png resize: (95, 174) 1352453337 -1.5939761824138234 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054582_0.png resize: (174, 269) 1352453341 -2.5629803693122026 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054585_0.png resize: (229, 177) 1352453345 -1.1701421670943715 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054598_0.png resize: (172, 152) 1352453349 -3.065140217102139 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054581_0.png resize: (195, 170) 1352453353 -1.9620799442874182 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054579_0.png resize: (257, 108) 1352453356 -1.3321959872708933 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054595_0.png resize: (120, 121) 1352453360 -3.4672015051397413 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054609_0.png resize: (643, 194) 1352453364 -1.4937959460335244 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054606_0.png resize: (246, 367) 1352453368 -1.9620793445209972 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054607_0.png resize: (505, 530) 1352453372 -2.8231157827483124 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054616_0.png resize: (296, 222) 1352453376 -1.7459521148236843 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054617_0.png resize: (281, 300) 1352453380 -0.7638580913046027 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054611_0.png resize: (208, 433) 1352453384 -2.846285810894301 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054612_0.png resize: (260, 321) 1352453387 -1.6506701412978273 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054622_0.png resize: (580, 566) 1352453391 -0.8261770955874314 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054621_0.png resize: (635, 389) 1352453395 -1.3594313454232763 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054614_0.png resize: (328, 204) 1352453399 -2.699289304825497 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054605_0.png resize: (1206, 787) 1352453403 -1.1767601585956082 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054608_0.png resize: (169, 153) 1352453407 -2.7331121341980458 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054615_0.png resize: (710, 214) 1352453411 0.21905390556896115 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054627_0.png resize: (865, 512) 1352453414 -1.1959185167976996 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054624_0.png resize: (312, 171) 1352453415 -0.8129301187735203 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054625_0.png resize: (366, 375) 1352453416 -2.191725567767686 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054631_0.png resize: (124, 283) 1352453417 -1.9421736140839696 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054628_0.png resize: (749, 594) 1352453418 -0.28805975918457355 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054634_0.png resize: (374, 458) 1352453419 -0.6884346234627043 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054636_0.png resize: (1093, 732) 1352453420 -0.6788958955574961 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054632_0.png resize: (765, 599) 1352453421 -1.5852998665064288 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054630_0.png resize: (438, 249) 1352453422 -2.8006608720228603 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054640_0.png resize: (282, 229) 1352453423 -2.153316903143578 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054643_0.png resize: (832, 568) 1352453424 -1.025728175384664 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054645_0.png resize: (348, 263) 1352453425 -3.2155479226235495 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054646_0.png resize: (163, 362) 1352453426 -2.2343889337129883 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054644_0.png resize: (215, 233) 1352453427 -0.5615395349797028 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054642_0.png resize: (170, 288) 1352453428 -2.512789746178936 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054653_0.png resize: (175, 136) 1352453429 -2.3315666748899275 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054650_0.png resize: (406, 117) 1352453430 -2.2831290825498227 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054639_0.png resize: (191, 204) 1352453431 -2.0892587170864956 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054648_0.png resize: (718, 420) 1352453432 -1.225472116961249 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054638_0.png resize: (652, 205) 1352453433 -0.9155334117072874 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054647_0.png resize: (180, 158) 1352453434 -3.1001202681873643 treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054478_0.png resize: (85, 126) 1352453442 -0.23903189046095105 treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054476_0.png resize: (300, 257) 1352453443 -0.040987796540242996 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054508_0.png resize: (143, 123) 1352453444 -1.8316805954879793 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054491_0.png resize: (228, 164) 1352453445 -0.35788730916285844 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054489_0.png resize: (184, 258) 1352453446 0.913148992778678 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054504_0.png resize: (239, 286) 1352453447 -0.5373650785373488 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054512_0.png resize: (116, 205) 1352453448 -0.8948738891157548 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054521_0.png resize: (209, 174) 1352453449 -0.622474332247852 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054531_0.png resize: (119, 210) 1352453450 -0.21074208049189577 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054543_0.png resize: (123, 219) 1352453451 -1.165756379320241 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054533_0.png resize: (148, 116) 1352453452 -0.7877546809090313 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054574_0.png resize: (202, 121) 1352453453 -1.8150668730233193 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054567_0.png resize: (654, 938) 1352453455 0.21522208064845863 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054597_0.png resize: (119, 213) 1352453456 -1.0623312584661828 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054583_0.png resize: (194, 196) 1352453457 -1.091168591622179 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054610_0.png resize: (591, 808) 1352453458 0.49907252704139493 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054623_0.png resize: (660, 376) 1352453459 -1.0738336101417605 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054618_0.png resize: (446, 427) 1352453460 -1.827785011767779 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054613_0.png resize: (262, 185) 1352453462 -2.2417340403210515 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054604_0.png resize: (548, 341) 1352453463 -0.7351800029775521 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054635_0.png resize: (649, 811) 1352453464 -1.5816121676485666 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054633_0.png resize: (221, 127) 1352453466 -1.9770983187083708 treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054482_0.png resize: (286, 170) 1352453482 -1.8210873597678945 treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054484_0.png resize: (256, 326) 1352453483 -1.2107372462054324 treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054488_0.png resize: (188, 230) 1352453484 -2.135708449493357 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054527_0.png resize: (234, 245) 1352453485 -2.8452468772474733 treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054526_0.png resize: (337, 276) 1352453486 -1.2809657241804429 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054545_0.png resize: (228, 450) 1352453487 -0.8345646763785612 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054538_0.png resize: (164, 319) 1352453488 -0.5785578061068065 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054544_0.png resize: (196, 307) 1352453489 -2.104328109276444 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054542_0.png resize: (131, 298) 1352453490 -0.6808407955898979 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054560_0.png resize: (301, 307) 1352453491 -1.5021187621418854 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054559_0.png resize: (239, 219) 1352453492 -3.2136975519397812 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054565_0.png resize: (275, 203) 1352453493 -1.7491490055087924 treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054554_0.png resize: (396, 157) 1352453494 -2.3499436456415164 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054578_0.png resize: (510, 303) 1352453495 -1.8313448313974352 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054571_0.png resize: (261, 124) 1352453496 -3.91570916146774 treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054575_0.png resize: (177, 391) 1352453497 -3.8012130208278303 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054601_0.png resize: (456, 379) 1352453498 -1.424943940521072 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054599_0.png resize: (515, 537) 1352453499 -2.4794136841837155 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054593_0.png resize: (686, 418) 1352453500 -0.7736384019573295 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054592_0.png resize: (278, 662) 1352453501 -0.7723166291891865 treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054603_0.png resize: (184, 190) 1352453502 -2.4247039096308356 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054619_0.png resize: (348, 303) 1352453503 -2.378809317735771 treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054620_0.png resize: (277, 188) 1352453504 -2.5175949277054595 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054626_0.png resize: (313, 714) 1352453505 -2.2325822945672242 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054637_0.png resize: (725, 738) 1352453506 0.07681185902889594 treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054629_0.png resize: (462, 254) 1352453507 -2.863601563729976 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054649_0.png resize: (1008, 1158) 1352453508 -0.9302977321938753 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054651_0.png resize: (688, 295) 1352453509 -1.3534468485055486 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054652_0.png resize: (503, 442) 1352453510 -2.8991456010780396 treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054501_0.png resize: (106, 111) 1352453512 1.9475441732402992 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054537_0.png resize: (242, 184) 1352453513 -1.14012055328937 treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054534_0.png resize: (139, 69) 1352453514 0.6801626391445823 treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054641_0.png resize: (184, 178) 1352453515 -0.8038130142730877 treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054483_0.png resize: (98, 95) 1352453516 1.0297275948663593 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 195 time used for this insertion : 0.023114681243896484 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 195 time used for this insertion : 0.03318357467651367 save missing photos in datou_result : time spend for datou_step_exec : 41.878480434417725 time spend to save output : 0.09663820266723633 total time spend for step 6 : 41.97511863708496 step7:brightness Mon Apr 21 20:26:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8.jpg treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c.jpg treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca.jpg treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c.jpg treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a.jpg treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd.jpg treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757.jpg treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788.jpg treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460.jpg treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0.jpg treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba.jpg treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054473_0.png treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054470_0.png treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054475_0.png treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054471_0.png treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054474_0.png treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054477_0.png treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054472_0.png treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054479_0.png treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054487_0.png treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054481_0.png treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054486_0.png treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054480_0.png treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054485_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054499_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054506_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054496_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054507_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054511_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054498_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054500_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054505_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054495_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054497_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054492_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054503_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054502_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054490_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054509_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054494_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054510_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054493_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054523_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054514_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054513_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054522_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054517_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054520_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054524_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054516_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054530_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054519_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054529_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054515_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054518_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054528_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054525_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054539_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054540_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054535_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054532_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054541_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054536_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054546_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054551_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054547_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054549_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054552_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054562_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054558_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054561_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054564_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054553_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054548_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054557_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054563_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054550_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054555_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054556_0.png treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054566_0.png treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054577_0.png treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054569_0.png treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054576_0.png treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054572_0.png treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054568_0.png treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054570_0.png treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054573_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054588_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054587_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054591_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054594_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054596_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054602_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054586_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054584_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054589_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054590_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054600_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054580_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054582_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054585_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054598_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054581_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054579_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054595_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054609_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054606_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054607_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054616_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054617_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054611_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054612_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054622_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054621_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054614_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054605_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054608_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054615_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054627_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054624_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054625_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054631_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054628_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054634_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054636_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054632_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054630_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054640_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054643_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054645_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054646_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054644_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054642_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054653_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054650_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054639_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054648_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054638_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054647_0.png treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054478_0.png treat image : temp/1745259627_3319467_1352450237_dc5467cedfe47cc953b88741843989a8_rle_crop_3762054476_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054508_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054491_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054489_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054504_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054512_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054521_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054531_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054543_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054533_0.png treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054574_0.png treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054567_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054597_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054583_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054610_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054623_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054618_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054613_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054604_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054635_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054633_0.png treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054482_0.png treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054484_0.png treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054488_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054527_0.png treat image : temp/1745259627_3319467_1352449511_edc1075e903313a4851a48d7cd6daa7c_rle_crop_3762054526_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054545_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054538_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054544_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054542_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054560_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054559_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054565_0.png treat image : temp/1745259627_3319467_1352449479_add52ce023f344e4fcdbaf33ef5dcccd_rle_crop_3762054554_0.png treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054578_0.png treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054571_0.png treat image : temp/1745259627_3319467_1352449185_51d4c2752463481b3b24834a65871757_rle_crop_3762054575_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054601_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054599_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054593_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054592_0.png treat image : temp/1745259627_3319467_1352449159_43cf767374afe8dffaec00494159f788_rle_crop_3762054603_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054619_0.png treat image : temp/1745259627_3319467_1352449157_1f0b40c8f82b0025ed24cc7128df1460_rle_crop_3762054620_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054626_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054637_0.png treat image : temp/1745259627_3319467_1352449154_86d6abf559e2ee5e48d530a32e08b0a0_rle_crop_3762054629_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054649_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054651_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054652_0.png treat image : temp/1745259627_3319467_1352449514_c7afc335cc8e9e73ea8065215cf47dca_rle_crop_3762054501_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054537_0.png treat image : temp/1745259627_3319467_1352449507_e646acf0c4b7e7a423c1b4c5eca8030a_rle_crop_3762054534_0.png treat image : temp/1745259627_3319467_1352449153_6c212b6e58a57415c14d751044bdf9ba_rle_crop_3762054641_0.png treat image : temp/1745259627_3319467_1352450111_93d771527a532ee550c5f56897050a7c_rle_crop_3762054483_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 195 time used for this insertion : 0.02068948745727539 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 195 time used for this insertion : 0.035268545150756836 save missing photos in datou_result : time spend for datou_step_exec : 10.666154146194458 time spend to save output : 0.061627864837646484 total time spend for step 7 : 10.727782011032104 step8:velours_tree Mon Apr 21 20:26:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.7128067016601562 time spend to save output : 4.839897155761719e-05 total time spend for step 8 : 0.7128551006317139 step9:send_mail_cod Mon Apr 21 20:26:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22278784_21-04-2025_20_26_53.pdf 22278786 imagette222787861745260013 22278788 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette222787881745260013 22278789 imagette222787891745260015 22278790 imagette222787901745260015 22278791 change filename to text .imagette222787911745260015 22278792 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette222787921745260015 22278793 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette222787931745260017 22278794 change filename to text .change filename to text .change filename to text .change filename to text .imagette222787941745260018 22278795 imagette222787951745260019 22278796 imagette222787961745260019 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22278784 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22278786,22278787,22278788,22278789,22278790,22278791,22278792,22278793,22278794,22278795,22278796?tags=background,environnement,papier,mal_croppe,pet_fonce,pehd,pet_clair,carton,autre,metal,flou args[1352450237] : ((1352450237, -0.8717512149401041, 492688767), (1352450237, 0.1670775905002939, 2107752395), '0.17837087170726879') We are sending mail with results at report@fotonower.com args[1352450111] : ((1352450111, -1.2582953545855946, 492688767), (1352450111, 0.23029954407192102, 2107752395), '0.17837087170726879') We are sending mail with results at report@fotonower.com args[1352449514] : ((1352449514, -0.4372584574201867, 492688767), (1352449514, 0.16587101463259002, 2107752395), '0.17837087170726879') We are sending mail with results at report@fotonower.com args[1352449511] : ((1352449511, -0.9882038557307465, 492688767), (1352449511, -0.050096035786148865, 2107752395), '0.17837087170726879') We are sending mail with results at report@fotonower.com args[1352449507] : ((1352449507, -2.3673083502326007, 492609224), (1352449507, 0.2559282895985669, 2107752395), '0.17837087170726879') We are sending mail with results at report@fotonower.com args[1352449479] : ((1352449479, -1.864884339157071, 492688767), (1352449479, 0.007433065814981751, 2107752395), '0.17837087170726879') We are sending mail with results at report@fotonower.com args[1352449185] : ((1352449185, -1.5696204453222262, 492688767), (1352449185, 0.0010636955372003152, 2107752395), '0.17837087170726879') We are sending mail with results at report@fotonower.com args[1352449159] : ((1352449159, -2.499686851553515, 492609224), (1352449159, -0.02260654402589733, 2107752395), '0.17837087170726879') We are sending mail with results at report@fotonower.com args[1352449157] : ((1352449157, -1.5644814078165332, 492688767), (1352449157, -0.1577079329745401, 496442774), '0.17837087170726879') We are sending mail with results at report@fotonower.com args[1352449154] : ((1352449154, -1.53153499219254, 492688767), (1352449154, 0.18591549477951033, 2107752395), '0.17837087170726879') We are sending mail with results at report@fotonower.com args[1352449153] : ((1352449153, -2.717343064300364, 492609224), (1352449153, 0.17591021313366353, 2107752395), '0.17837087170726879') We are sending mail with results at report@fotonower.com refus_total : 0.17837087170726879 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22278784 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22278784_21-04-2025_20_26_53.pdf results_Auto_P22278784_21-04-2025_20_26_53.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22278784_21-04-2025_20_26_53.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22278784','results_Auto_P22278784_21-04-2025_20_26_53.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22278784_21-04-2025_20_26_53.pdf','pdf','','0.92','0.17837087170726879') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22278784

https://www.fotonower.com/image?json=false&list_photos_id=1352450237
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352450111
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352449514
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352449511
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352449507
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352449479
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352449185
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352449159
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352449157
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352449154
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1352449153
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 17.84%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/22278788?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22278791?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22278792?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22278793?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22278794?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22278784_21-04-2025_20_26_53.pdf.

Lien vers velours :https://www.fotonower.com/velours/22278786,22278787,22278788,22278789,22278790,22278791,22278792,22278793,22278794,22278795,22278796?tags=background,environnement,papier,mal_croppe,pet_fonce,pehd,pet_clair,carton,autre,metal,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 21 Apr 2025 18:27:01 GMT Content-Length: 0 Connection: close X-Message-Id: Xs4F8YerTCiLwnXTQ-f-wg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1352450237, 1352450111, 1352449514, 1352449511, 1352449507, 1352449479, 1352449185, 1352449159, 1352449157, 1352449154, 1352449153] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352450237', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352450111', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449514', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449511', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449507', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449479', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449185', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449159', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449157', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449154', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449153', None, None, None, None, None, '2745607') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.014680862426757812 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.257638692855835 time spend to save output : 0.015030622482299805 total time spend for step 9 : 8.272669315338135 step10:split_time_score Mon Apr 21 20:27:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('19', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21042025 22278784 Nombre de photos uploadées : 11 / 23040 (0%) 21042025 22278784 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 21042025 22278784 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 1.3113021850585938e-05 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006258487701416016 elapsed_time : insert_dashboard_record_day_entry 0.024433612823486328 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.04337451976659396 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22271368_21-04-2025_09_12_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22271368 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22271368 AND mptpi.`type`=3726 To do Qualite : 0.16541958964408407 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22271884_21-04-2025_11_07_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22271884 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22271884 AND mptpi.`type`=3594 To do Qualite : 0.2337219106987401 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22273522_21-04-2025_13_34_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22273522 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22273522 AND mptpi.`type`=3726 To do Qualite : 0.09842876352931662 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22272413_21-04-2025_11_52_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22272413 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22272413 AND mptpi.`type`=3726 To do Qualite : 0.04707785783914661 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22275552_21-04-2025_14_53_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22275552 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22275552 AND mptpi.`type`=3726 To do Qualite : 0.12239702971567042 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22275554_21-04-2025_15_08_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22275554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22275554 AND mptpi.`type`=3594 To do Qualite : 0.11851577423944616 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22277375_21-04-2025_18_39_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22277375 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22277375 AND mptpi.`type`=3594 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22277376_21-04-2025_18_22_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22277376 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22277376 AND mptpi.`type`=3594 To do Qualite : 0.1316013513172759 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22278267_21-04-2025_19_15_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22278267 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22278267 AND mptpi.`type`=3594 To do Qualite : 0.05157844480697816 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22278269_21-04-2025_19_12_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22278269 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22278269 AND mptpi.`type`=3726 To do Qualite : 0.17837087170726879 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22278784_21-04-2025_20_26_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22278784 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22278784 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21042025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1352450237, 1352450111, 1352449514, 1352449511, 1352449507, 1352449479, 1352449185, 1352449159, 1352449157, 1352449154, 1352449153] Looping around the photos to save general results len do output : 1 /22278784Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352450237', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352450111', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449514', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449511', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449507', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449479', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449185', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449159', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449157', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449154', None, None, None, None, None, '2745607') ('3318', None, None, None, None, None, None, None, '2745607') ('3318', '22278784', '1352449153', None, None, None, None, None, '2745607') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.014622926712036133 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.858609676361084 time spend to save output : 0.014811515808105469 total time spend for step 10 : 0.8734211921691895 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 182.46user 140.42system 6:37.62elapsed 81%CPU (0avgtext+0avgdata 6049252maxresident)k 602264inputs+130864outputs (7332major+17393439minor)pagefaults 0swaps