python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3093930 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2910391'] with mtr_portfolio_ids : ['23172907'] and first list_photo_ids : [] new path : /proc/3093930/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 1.7936670780181885 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 20 16:40:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-20 16:40:32.785745: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-20 16:40:32.795142: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-20 16:40:32.796757: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ff400000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-20 16:40:32.796817: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-20 16:40:32.800426: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-20 16:40:32.932985: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x101bf2a0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-20 16:40:32.933053: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-20 16:40:32.934555: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 16:40:32.935040: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 16:40:32.938102: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 16:40:32.940965: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 16:40:32.941389: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 16:40:32.944011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 16:40:32.945323: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 16:40:32.950434: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 16:40:32.951976: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 16:40:32.952059: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 16:40:32.952858: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 16:40:32.952874: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 16:40:32.952884: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 16:40:32.954514: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9671 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-20 16:40:33.224537: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 16:40:33.224625: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 16:40:33.224642: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 16:40:33.224658: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 16:40:33.224672: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 16:40:33.224686: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 16:40:33.224701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 16:40:33.224716: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 16:40:33.226010: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 16:40:33.227199: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 16:40:33.227233: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 16:40:33.227247: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 16:40:33.227261: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 16:40:33.227274: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 16:40:33.227288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 16:40:33.227301: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 16:40:33.227315: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 16:40:33.228588: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 16:40:33.228616: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 16:40:33.228625: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 16:40:33.228633: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 16:40:33.229974: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9671 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-20 16:40:44.703888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 16:40:44.875225: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 Detection mask done ! Trying to reset tf kernel 3094719 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5304 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10593 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0012557506561279297 nb_pixel_total : 42446 time to create 1 rle with old method : 0.05632352828979492 length of segment : 279 time for calcul the mask position with numpy : 0.005984783172607422 nb_pixel_total : 244848 time to create 1 rle with new method : 0.014786005020141602 length of segment : 590 time for calcul the mask position with numpy : 0.0006461143493652344 nb_pixel_total : 30709 time to create 1 rle with old method : 0.03649640083312988 length of segment : 265 time for calcul the mask position with numpy : 0.02520132064819336 nb_pixel_total : 301802 time to create 1 rle with new method : 0.04124712944030762 length of segment : 784 time for calcul the mask position with numpy : 0.0007829666137695312 nb_pixel_total : 28086 time to create 1 rle with old method : 0.04755353927612305 length of segment : 151 time for calcul the mask position with numpy : 0.0017788410186767578 nb_pixel_total : 96181 time to create 1 rle with old method : 0.11321830749511719 length of segment : 391 time for calcul the mask position with numpy : 0.0003743171691894531 nb_pixel_total : 11324 time to create 1 rle with old method : 0.014369726181030273 length of segment : 102 time for calcul the mask position with numpy : 0.00020766258239746094 nb_pixel_total : 9038 time to create 1 rle with old method : 0.011452674865722656 length of segment : 60 time for calcul the mask position with numpy : 0.0015316009521484375 nb_pixel_total : 90774 time to create 1 rle with old method : 0.12124919891357422 length of segment : 479 time for calcul the mask position with numpy : 0.0016171932220458984 nb_pixel_total : 70716 time to create 1 rle with old method : 0.08647513389587402 length of segment : 471 time for calcul the mask position with numpy : 0.004954338073730469 nb_pixel_total : 187908 time to create 1 rle with new method : 0.014082670211791992 length of segment : 552 time for calcul the mask position with numpy : 0.0025718212127685547 nb_pixel_total : 73860 time to create 1 rle with old method : 0.09116959571838379 length of segment : 388 time for calcul the mask position with numpy : 0.0018939971923828125 nb_pixel_total : 57762 time to create 1 rle with old method : 0.0753335952758789 length of segment : 359 time for calcul the mask position with numpy : 0.005207061767578125 nb_pixel_total : 77775 time to create 1 rle with old method : 0.09883666038513184 length of segment : 321 time for calcul the mask position with numpy : 0.001909494400024414 nb_pixel_total : 29159 time to create 1 rle with old method : 0.03394675254821777 length of segment : 201 time for calcul the mask position with numpy : 0.06803011894226074 nb_pixel_total : 683964 time to create 1 rle with new method : 0.25216126441955566 length of segment : 2061 time for calcul the mask position with numpy : 0.0015704631805419922 nb_pixel_total : 42539 time to create 1 rle with old method : 0.04968738555908203 length of segment : 333 time for calcul the mask position with numpy : 0.001142263412475586 nb_pixel_total : 70521 time to create 1 rle with old method : 0.09374642372131348 length of segment : 466 time for calcul the mask position with numpy : 0.0021278858184814453 nb_pixel_total : 100323 time to create 1 rle with old method : 0.12213277816772461 length of segment : 723 time for calcul the mask position with numpy : 0.0004673004150390625 nb_pixel_total : 21960 time to create 1 rle with old method : 0.026222705841064453 length of segment : 181 time for calcul the mask position with numpy : 0.00036072731018066406 nb_pixel_total : 16430 time to create 1 rle with old method : 0.021275043487548828 length of segment : 182 time for calcul the mask position with numpy : 0.010230541229248047 nb_pixel_total : 145163 time to create 1 rle with old method : 0.2307424545288086 length of segment : 463 time for calcul the mask position with numpy : 0.003272533416748047 nb_pixel_total : 98553 time to create 1 rle with old method : 0.12010955810546875 length of segment : 399 time for calcul the mask position with numpy : 0.001336812973022461 nb_pixel_total : 50459 time to create 1 rle with old method : 0.06019997596740723 length of segment : 260 time for calcul the mask position with numpy : 0.0030019283294677734 nb_pixel_total : 120221 time to create 1 rle with old method : 0.1447598934173584 length of segment : 268 time for calcul the mask position with numpy : 0.0018122196197509766 nb_pixel_total : 71760 time to create 1 rle with old method : 0.08586454391479492 length of segment : 274 time for calcul the mask position with numpy : 0.006233692169189453 nb_pixel_total : 246262 time to create 1 rle with new method : 0.009358644485473633 length of segment : 630 time for calcul the mask position with numpy : 0.0024852752685546875 nb_pixel_total : 94791 time to create 1 rle with old method : 0.11335301399230957 length of segment : 433 time for calcul the mask position with numpy : 0.0029404163360595703 nb_pixel_total : 92648 time to create 1 rle with old method : 0.11031460762023926 length of segment : 450 time for calcul the mask position with numpy : 0.0016815662384033203 nb_pixel_total : 53701 time to create 1 rle with old method : 0.0630338191986084 length of segment : 336 time for calcul the mask position with numpy : 0.0028839111328125 nb_pixel_total : 60153 time to create 1 rle with old method : 0.07250499725341797 length of segment : 270 time for calcul the mask position with numpy : 0.003454446792602539 nb_pixel_total : 108897 time to create 1 rle with old method : 0.12844586372375488 length of segment : 394 time for calcul the mask position with numpy : 0.002011537551879883 nb_pixel_total : 74244 time to create 1 rle with old method : 0.08776354789733887 length of segment : 347 time for calcul the mask position with numpy : 0.0010159015655517578 nb_pixel_total : 41207 time to create 1 rle with old method : 0.04924583435058594 length of segment : 219 time for calcul the mask position with numpy : 0.00514674186706543 nb_pixel_total : 154128 time to create 1 rle with new method : 0.010096311569213867 length of segment : 422 time for calcul the mask position with numpy : 0.0016565322875976562 nb_pixel_total : 44417 time to create 1 rle with old method : 0.05666184425354004 length of segment : 325 time for calcul the mask position with numpy : 0.001680135726928711 nb_pixel_total : 61761 time to create 1 rle with old method : 0.07426905632019043 length of segment : 467 time for calcul the mask position with numpy : 0.0071277618408203125 nb_pixel_total : 202978 time to create 1 rle with new method : 0.008488893508911133 length of segment : 475 time for calcul the mask position with numpy : 0.0016138553619384766 nb_pixel_total : 32432 time to create 1 rle with old method : 0.0386357307434082 length of segment : 311 time for calcul the mask position with numpy : 0.0018124580383300781 nb_pixel_total : 35188 time to create 1 rle with old method : 0.04311943054199219 length of segment : 216 time for calcul the mask position with numpy : 0.006258487701416016 nb_pixel_total : 138968 time to create 1 rle with old method : 0.1622028350830078 length of segment : 391 time for calcul the mask position with numpy : 0.002601146697998047 nb_pixel_total : 68269 time to create 1 rle with old method : 0.10116720199584961 length of segment : 273 time for calcul the mask position with numpy : 0.003124713897705078 nb_pixel_total : 70031 time to create 1 rle with old method : 0.0837857723236084 length of segment : 411 time for calcul the mask position with numpy : 0.0035767555236816406 nb_pixel_total : 95782 time to create 1 rle with old method : 0.13643288612365723 length of segment : 334 time for calcul the mask position with numpy : 0.006329774856567383 nb_pixel_total : 182525 time to create 1 rle with new method : 0.00821375846862793 length of segment : 590 time for calcul the mask position with numpy : 0.008438825607299805 nb_pixel_total : 141317 time to create 1 rle with old method : 0.17071199417114258 length of segment : 522 time for calcul the mask position with numpy : 0.0017998218536376953 nb_pixel_total : 42048 time to create 1 rle with old method : 0.050229787826538086 length of segment : 228 time for calcul the mask position with numpy : 0.0007059574127197266 nb_pixel_total : 17502 time to create 1 rle with old method : 0.021405935287475586 length of segment : 185 time for calcul the mask position with numpy : 0.005979299545288086 nb_pixel_total : 139859 time to create 1 rle with old method : 0.16484665870666504 length of segment : 558 time for calcul the mask position with numpy : 0.00691533088684082 nb_pixel_total : 197444 time to create 1 rle with new method : 0.012717247009277344 length of segment : 766 time for calcul the mask position with numpy : 0.0012960433959960938 nb_pixel_total : 19370 time to create 1 rle with old method : 0.023087263107299805 length of segment : 318 time for calcul the mask position with numpy : 0.0048253536224365234 nb_pixel_total : 102793 time to create 1 rle with old method : 0.12125301361083984 length of segment : 652 time for calcul the mask position with numpy : 0.0010862350463867188 nb_pixel_total : 23161 time to create 1 rle with old method : 0.02746415138244629 length of segment : 276 time for calcul the mask position with numpy : 0.001644134521484375 nb_pixel_total : 46685 time to create 1 rle with old method : 0.05616426467895508 length of segment : 181 time for calcul the mask position with numpy : 0.0010538101196289062 nb_pixel_total : 27563 time to create 1 rle with old method : 0.03300666809082031 length of segment : 161 time for calcul the mask position with numpy : 0.0031936168670654297 nb_pixel_total : 78555 time to create 1 rle with old method : 0.10259556770324707 length of segment : 382 time for calcul the mask position with numpy : 0.005873918533325195 nb_pixel_total : 156277 time to create 1 rle with new method : 0.007019996643066406 length of segment : 653 time for calcul the mask position with numpy : 0.0015552043914794922 nb_pixel_total : 37750 time to create 1 rle with old method : 0.04490208625793457 length of segment : 216 time for calcul the mask position with numpy : 0.0020792484283447266 nb_pixel_total : 82770 time to create 1 rle with old method : 0.09860348701477051 length of segment : 273 time for calcul the mask position with numpy : 0.0038328170776367188 nb_pixel_total : 97738 time to create 1 rle with old method : 0.12805414199829102 length of segment : 305 time for calcul the mask position with numpy : 0.006827592849731445 nb_pixel_total : 166805 time to create 1 rle with new method : 0.01063847541809082 length of segment : 1025 time for calcul the mask position with numpy : 0.0012655258178710938 nb_pixel_total : 27951 time to create 1 rle with old method : 0.03324174880981445 length of segment : 320 time for calcul the mask position with numpy : 0.0016179084777832031 nb_pixel_total : 42444 time to create 1 rle with old method : 0.05053353309631348 length of segment : 362 time for calcul the mask position with numpy : 0.005343198776245117 nb_pixel_total : 103348 time to create 1 rle with old method : 0.14202356338500977 length of segment : 366 time for calcul the mask position with numpy : 0.0014414787292480469 nb_pixel_total : 42074 time to create 1 rle with old method : 0.04998970031738281 length of segment : 348 time for calcul the mask position with numpy : 0.0006771087646484375 nb_pixel_total : 19976 time to create 1 rle with old method : 0.024120807647705078 length of segment : 185 time for calcul the mask position with numpy : 0.0022149085998535156 nb_pixel_total : 52338 time to create 1 rle with old method : 0.0627894401550293 length of segment : 498 time for calcul the mask position with numpy : 0.0007648468017578125 nb_pixel_total : 15490 time to create 1 rle with old method : 0.018854618072509766 length of segment : 192 time for calcul the mask position with numpy : 0.00023484230041503906 nb_pixel_total : 6780 time to create 1 rle with old method : 0.008318185806274414 length of segment : 105 time for calcul the mask position with numpy : 0.014821052551269531 nb_pixel_total : 378014 time to create 1 rle with new method : 0.027283906936645508 length of segment : 968 time for calcul the mask position with numpy : 0.0013341903686523438 nb_pixel_total : 72529 time to create 1 rle with old method : 0.08471798896789551 length of segment : 349 time for calcul the mask position with numpy : 0.0035567283630371094 nb_pixel_total : 54680 time to create 1 rle with old method : 0.06550216674804688 length of segment : 394 time for calcul the mask position with numpy : 0.000537872314453125 nb_pixel_total : 27954 time to create 1 rle with old method : 0.03325223922729492 length of segment : 313 time for calcul the mask position with numpy : 0.0002429485321044922 nb_pixel_total : 10233 time to create 1 rle with old method : 0.012815475463867188 length of segment : 116 time for calcul the mask position with numpy : 0.0011081695556640625 nb_pixel_total : 29363 time to create 1 rle with old method : 0.03523969650268555 length of segment : 310 time for calcul the mask position with numpy : 0.001077890396118164 nb_pixel_total : 29484 time to create 1 rle with old method : 0.03518819808959961 length of segment : 372 time for calcul the mask position with numpy : 0.008730411529541016 nb_pixel_total : 263932 time to create 1 rle with new method : 0.014708757400512695 length of segment : 862 time for calcul the mask position with numpy : 0.0018961429595947266 nb_pixel_total : 59838 time to create 1 rle with old method : 0.09132504463195801 length of segment : 316 time for calcul the mask position with numpy : 0.0024945735931396484 nb_pixel_total : 36381 time to create 1 rle with old method : 0.044740915298461914 length of segment : 317 time for calcul the mask position with numpy : 0.0008323192596435547 nb_pixel_total : 16411 time to create 1 rle with old method : 0.020214557647705078 length of segment : 99 time for calcul the mask position with numpy : 0.001039743423461914 nb_pixel_total : 12416 time to create 1 rle with old method : 0.015200138092041016 length of segment : 222 time for calcul the mask position with numpy : 0.003738880157470703 nb_pixel_total : 51648 time to create 1 rle with old method : 0.062093257904052734 length of segment : 816 time for calcul the mask position with numpy : 0.003849029541015625 nb_pixel_total : 59211 time to create 1 rle with old method : 0.07509660720825195 length of segment : 332 time for calcul the mask position with numpy : 0.013738870620727539 nb_pixel_total : 408480 time to create 1 rle with new method : 0.025084257125854492 length of segment : 1093 time for calcul the mask position with numpy : 0.00400853157043457 nb_pixel_total : 96153 time to create 1 rle with old method : 0.1351327896118164 length of segment : 675 time for calcul the mask position with numpy : 0.007969379425048828 nb_pixel_total : 218294 time to create 1 rle with new method : 0.016623258590698242 length of segment : 853 time for calcul the mask position with numpy : 0.0033521652221679688 nb_pixel_total : 116648 time to create 1 rle with old method : 0.15314435958862305 length of segment : 379 time for calcul the mask position with numpy : 0.0014531612396240234 nb_pixel_total : 21054 time to create 1 rle with old method : 0.025287389755249023 length of segment : 420 time for calcul the mask position with numpy : 0.0014071464538574219 nb_pixel_total : 35353 time to create 1 rle with old method : 0.04210638999938965 length of segment : 340 time for calcul the mask position with numpy : 0.0006134510040283203 nb_pixel_total : 8807 time to create 1 rle with old method : 0.010788202285766602 length of segment : 144 time for calcul the mask position with numpy : 0.0010170936584472656 nb_pixel_total : 20265 time to create 1 rle with old method : 0.025232315063476562 length of segment : 231 time for calcul the mask position with numpy : 0.005510807037353516 nb_pixel_total : 144597 time to create 1 rle with old method : 0.17061495780944824 length of segment : 448 time for calcul the mask position with numpy : 0.005948066711425781 nb_pixel_total : 183933 time to create 1 rle with new method : 0.007559061050415039 length of segment : 507 time for calcul the mask position with numpy : 0.0012264251708984375 nb_pixel_total : 39577 time to create 1 rle with old method : 0.04803776741027832 length of segment : 257 time for calcul the mask position with numpy : 0.0024881362915039062 nb_pixel_total : 91401 time to create 1 rle with old method : 0.11091971397399902 length of segment : 281 time for calcul the mask position with numpy : 0.005635976791381836 nb_pixel_total : 167454 time to create 1 rle with new method : 0.007604122161865234 length of segment : 467 time for calcul the mask position with numpy : 0.002016782760620117 nb_pixel_total : 44371 time to create 1 rle with old method : 0.054219961166381836 length of segment : 283 time for calcul the mask position with numpy : 0.0017838478088378906 nb_pixel_total : 62300 time to create 1 rle with old method : 0.07422208786010742 length of segment : 344 time for calcul the mask position with numpy : 0.005059957504272461 nb_pixel_total : 157703 time to create 1 rle with new method : 0.007079601287841797 length of segment : 567 time for calcul the mask position with numpy : 0.005076408386230469 nb_pixel_total : 65630 time to create 1 rle with old method : 0.07832813262939453 length of segment : 564 time for calcul the mask position with numpy : 0.0007317066192626953 nb_pixel_total : 16048 time to create 1 rle with old method : 0.019442319869995117 length of segment : 134 time for calcul the mask position with numpy : 0.012534618377685547 nb_pixel_total : 415473 time to create 1 rle with new method : 0.03940629959106445 length of segment : 956 time for calcul the mask position with numpy : 0.003051280975341797 nb_pixel_total : 34514 time to create 1 rle with old method : 0.04116082191467285 length of segment : 408 time for calcul the mask position with numpy : 0.0022487640380859375 nb_pixel_total : 86066 time to create 1 rle with old method : 0.10240626335144043 length of segment : 359 time for calcul the mask position with numpy : 0.008486032485961914 nb_pixel_total : 308786 time to create 1 rle with new method : 0.014620065689086914 length of segment : 625 time for calcul the mask position with numpy : 0.000392913818359375 nb_pixel_total : 16949 time to create 1 rle with old method : 0.020812511444091797 length of segment : 140 time for calcul the mask position with numpy : 0.0007476806640625 nb_pixel_total : 27573 time to create 1 rle with old method : 0.03546261787414551 length of segment : 168 time for calcul the mask position with numpy : 0.0027043819427490234 nb_pixel_total : 57038 time to create 1 rle with old method : 0.07069778442382812 length of segment : 619 time for calcul the mask position with numpy : 0.0020401477813720703 nb_pixel_total : 46828 time to create 1 rle with old method : 0.057403564453125 length of segment : 302 time for calcul the mask position with numpy : 0.0006067752838134766 nb_pixel_total : 18213 time to create 1 rle with old method : 0.022454500198364258 length of segment : 211 time for calcul the mask position with numpy : 0.003395557403564453 nb_pixel_total : 96091 time to create 1 rle with old method : 0.12469220161437988 length of segment : 621 time for calcul the mask position with numpy : 0.011049509048461914 nb_pixel_total : 271695 time to create 1 rle with new method : 0.012883663177490234 length of segment : 530 time for calcul the mask position with numpy : 0.002565145492553711 nb_pixel_total : 65588 time to create 1 rle with old method : 0.07773399353027344 length of segment : 454 time for calcul the mask position with numpy : 0.02480292320251465 nb_pixel_total : 785523 time to create 1 rle with new method : 0.35082125663757324 length of segment : 1044 time for calcul the mask position with numpy : 0.006268978118896484 nb_pixel_total : 185117 time to create 1 rle with new method : 0.008997678756713867 length of segment : 675 time for calcul the mask position with numpy : 0.00165557861328125 nb_pixel_total : 31772 time to create 1 rle with old method : 0.03757476806640625 length of segment : 341 time for calcul the mask position with numpy : 0.0011036396026611328 nb_pixel_total : 39483 time to create 1 rle with old method : 0.04717445373535156 length of segment : 230 time for calcul the mask position with numpy : 0.0008516311645507812 nb_pixel_total : 26635 time to create 1 rle with old method : 0.03179287910461426 length of segment : 157 time for calcul the mask position with numpy : 0.00035762786865234375 nb_pixel_total : 15420 time to create 1 rle with old method : 0.019440650939941406 length of segment : 208 time for calcul the mask position with numpy : 0.0013818740844726562 nb_pixel_total : 35530 time to create 1 rle with old method : 0.0427546501159668 length of segment : 474 time for calcul the mask position with numpy : 0.0015425682067871094 nb_pixel_total : 43954 time to create 1 rle with old method : 0.05215573310852051 length of segment : 242 time for calcul the mask position with numpy : 0.003331899642944336 nb_pixel_total : 46641 time to create 1 rle with old method : 0.055222272872924805 length of segment : 652 time for calcul the mask position with numpy : 0.002552032470703125 nb_pixel_total : 74489 time to create 1 rle with old method : 0.08643460273742676 length of segment : 350 time for calcul the mask position with numpy : 0.0041790008544921875 nb_pixel_total : 161274 time to create 1 rle with new method : 0.00729680061340332 length of segment : 435 time for calcul the mask position with numpy : 0.0010302066802978516 nb_pixel_total : 28433 time to create 1 rle with old method : 0.034796953201293945 length of segment : 131 time for calcul the mask position with numpy : 0.002327442169189453 nb_pixel_total : 110704 time to create 1 rle with old method : 0.13001418113708496 length of segment : 459 time for calcul the mask position with numpy : 0.0024178028106689453 nb_pixel_total : 89283 time to create 1 rle with old method : 0.10471272468566895 length of segment : 301 time for calcul the mask position with numpy : 0.005799293518066406 nb_pixel_total : 179275 time to create 1 rle with new method : 0.012426137924194336 length of segment : 628 time for calcul the mask position with numpy : 0.014603853225708008 nb_pixel_total : 676626 time to create 1 rle with new method : 0.3952662944793701 length of segment : 2197 time for calcul the mask position with numpy : 0.0010561943054199219 nb_pixel_total : 24298 time to create 1 rle with old method : 0.06320905685424805 length of segment : 155 time for calcul the mask position with numpy : 0.007215023040771484 nb_pixel_total : 197557 time to create 1 rle with new method : 0.011559486389160156 length of segment : 661 time for calcul the mask position with numpy : 0.00048351287841796875 nb_pixel_total : 16543 time to create 1 rle with old method : 0.019864559173583984 length of segment : 418 time for calcul the mask position with numpy : 0.0011987686157226562 nb_pixel_total : 39123 time to create 1 rle with old method : 0.05702614784240723 length of segment : 177 time for calcul the mask position with numpy : 0.0008890628814697266 nb_pixel_total : 28350 time to create 1 rle with old method : 0.03540849685668945 length of segment : 242 time for calcul the mask position with numpy : 0.0022580623626708984 nb_pixel_total : 36215 time to create 1 rle with old method : 0.04290151596069336 length of segment : 578 time for calcul the mask position with numpy : 0.0034384727478027344 nb_pixel_total : 133691 time to create 1 rle with old method : 0.15616345405578613 length of segment : 466 time for calcul the mask position with numpy : 0.001191854476928711 nb_pixel_total : 63181 time to create 1 rle with old method : 0.07586884498596191 length of segment : 444 time for calcul the mask position with numpy : 0.00034737586975097656 nb_pixel_total : 13926 time to create 1 rle with old method : 0.017242431640625 length of segment : 145 time for calcul the mask position with numpy : 0.0006461143493652344 nb_pixel_total : 22391 time to create 1 rle with old method : 0.02718496322631836 length of segment : 164 time for calcul the mask position with numpy : 0.0007371902465820312 nb_pixel_total : 26190 time to create 1 rle with old method : 0.034447431564331055 length of segment : 172 time for calcul the mask position with numpy : 0.002789735794067383 nb_pixel_total : 83907 time to create 1 rle with old method : 0.1284162998199463 length of segment : 349 time for calcul the mask position with numpy : 0.002186298370361328 nb_pixel_total : 87787 time to create 1 rle with old method : 0.10853123664855957 length of segment : 342 time for calcul the mask position with numpy : 0.002262592315673828 nb_pixel_total : 103202 time to create 1 rle with old method : 0.12354040145874023 length of segment : 318 time for calcul the mask position with numpy : 0.0008420944213867188 nb_pixel_total : 26848 time to create 1 rle with old method : 0.032448768615722656 length of segment : 183 time for calcul the mask position with numpy : 0.00197601318359375 nb_pixel_total : 43996 time to create 1 rle with old method : 0.05294537544250488 length of segment : 253 time for calcul the mask position with numpy : 0.0030107498168945312 nb_pixel_total : 135325 time to create 1 rle with old method : 0.19460654258728027 length of segment : 435 time for calcul the mask position with numpy : 0.010820627212524414 nb_pixel_total : 292682 time to create 1 rle with new method : 0.23828411102294922 length of segment : 952 time for calcul the mask position with numpy : 0.05782175064086914 nb_pixel_total : 1160112 time to create 1 rle with new method : 0.34636783599853516 length of segment : 1243 time for calcul the mask position with numpy : 0.0009813308715820312 nb_pixel_total : 49894 time to create 1 rle with old method : 0.05852699279785156 length of segment : 380 time for calcul the mask position with numpy : 0.0002186298370361328 nb_pixel_total : 12515 time to create 1 rle with old method : 0.015163421630859375 length of segment : 121 time for calcul the mask position with numpy : 0.008913278579711914 nb_pixel_total : 282447 time to create 1 rle with new method : 0.011894464492797852 length of segment : 636 time for calcul the mask position with numpy : 0.0019369125366210938 nb_pixel_total : 50552 time to create 1 rle with old method : 0.06360840797424316 length of segment : 397 time for calcul the mask position with numpy : 0.014980792999267578 nb_pixel_total : 330752 time to create 1 rle with new method : 0.03944969177246094 length of segment : 1093 time for calcul the mask position with numpy : 0.001996278762817383 nb_pixel_total : 33447 time to create 1 rle with old method : 0.043182373046875 length of segment : 454 time for calcul the mask position with numpy : 0.0018973350524902344 nb_pixel_total : 50432 time to create 1 rle with old method : 0.0595090389251709 length of segment : 563 time for calcul the mask position with numpy : 0.0024929046630859375 nb_pixel_total : 169329 time to create 1 rle with new method : 0.005318164825439453 length of segment : 293 time for calcul the mask position with numpy : 0.0026509761810302734 nb_pixel_total : 95172 time to create 1 rle with old method : 0.11413431167602539 length of segment : 400 time for calcul the mask position with numpy : 0.003220796585083008 nb_pixel_total : 133278 time to create 1 rle with old method : 0.16372942924499512 length of segment : 561 time for calcul the mask position with numpy : 0.0014696121215820312 nb_pixel_total : 55476 time to create 1 rle with old method : 0.0673065185546875 length of segment : 270 time for calcul the mask position with numpy : 0.0026543140411376953 nb_pixel_total : 139240 time to create 1 rle with old method : 0.1666576862335205 length of segment : 501 time for calcul the mask position with numpy : 0.0008730888366699219 nb_pixel_total : 22665 time to create 1 rle with old method : 0.027486324310302734 length of segment : 140 time for calcul the mask position with numpy : 0.0030333995819091797 nb_pixel_total : 94252 time to create 1 rle with old method : 0.11099553108215332 length of segment : 488 time for calcul the mask position with numpy : 0.0007243156433105469 nb_pixel_total : 25741 time to create 1 rle with old method : 0.030645132064819336 length of segment : 136 time for calcul the mask position with numpy : 0.002008199691772461 nb_pixel_total : 47242 time to create 1 rle with old method : 0.0751352310180664 length of segment : 274 time for calcul the mask position with numpy : 0.00478672981262207 nb_pixel_total : 173944 time to create 1 rle with new method : 0.0059354305267333984 length of segment : 429 time for calcul the mask position with numpy : 0.003933429718017578 nb_pixel_total : 87541 time to create 1 rle with old method : 0.11906933784484863 length of segment : 190 time for calcul the mask position with numpy : 0.004080057144165039 nb_pixel_total : 135750 time to create 1 rle with old method : 0.15985608100891113 length of segment : 433 time for calcul the mask position with numpy : 0.0012538433074951172 nb_pixel_total : 31615 time to create 1 rle with old method : 0.05091357231140137 length of segment : 109 time for calcul the mask position with numpy : 0.001428365707397461 nb_pixel_total : 26908 time to create 1 rle with old method : 0.031999826431274414 length of segment : 416 time for calcul the mask position with numpy : 0.004415988922119141 nb_pixel_total : 163452 time to create 1 rle with new method : 0.008884906768798828 length of segment : 1051 time for calcul the mask position with numpy : 0.0005395412445068359 nb_pixel_total : 8198 time to create 1 rle with old method : 0.010177373886108398 length of segment : 136 time for calcul the mask position with numpy : 0.0014176368713378906 nb_pixel_total : 37727 time to create 1 rle with old method : 0.04481792449951172 length of segment : 348 time for calcul the mask position with numpy : 0.0030333995819091797 nb_pixel_total : 115879 time to create 1 rle with old method : 0.15197539329528809 length of segment : 597 time for calcul the mask position with numpy : 0.0009930133819580078 nb_pixel_total : 28508 time to create 1 rle with old method : 0.03439784049987793 length of segment : 190 time for calcul the mask position with numpy : 0.0014498233795166016 nb_pixel_total : 46688 time to create 1 rle with old method : 0.056097984313964844 length of segment : 312 time for calcul the mask position with numpy : 0.004817962646484375 nb_pixel_total : 140357 time to create 1 rle with old method : 0.16402649879455566 length of segment : 473 time for calcul the mask position with numpy : 0.002334117889404297 nb_pixel_total : 137927 time to create 1 rle with old method : 0.1635758876800537 length of segment : 476 time for calcul the mask position with numpy : 0.0032143592834472656 nb_pixel_total : 99778 time to create 1 rle with old method : 0.11758852005004883 length of segment : 897 time for calcul the mask position with numpy : 0.0058193206787109375 nb_pixel_total : 208081 time to create 1 rle with new method : 0.010690689086914062 length of segment : 580 time for calcul the mask position with numpy : 0.0018410682678222656 nb_pixel_total : 57793 time to create 1 rle with old method : 0.11265420913696289 length of segment : 220 time for calcul the mask position with numpy : 0.0004973411560058594 nb_pixel_total : 8604 time to create 1 rle with old method : 0.010696649551391602 length of segment : 138 time for calcul the mask position with numpy : 0.0007302761077880859 nb_pixel_total : 31208 time to create 1 rle with old method : 0.03819775581359863 length of segment : 185 time for calcul the mask position with numpy : 0.0022640228271484375 nb_pixel_total : 75018 time to create 1 rle with old method : 0.09391045570373535 length of segment : 332 time spent for convertir_results : 27.55520224571228 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 183 chid ids of type : 3594 Number RLEs to save : 76980 save missing photos in datou_result : time spend for datou_step_exec : 113.03248357772827 time spend to save output : 4.8747594356536865 total time spend for step 1 : 117.90724301338196 step2:crop_condition Tue May 20 16:42:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 183 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 149 About to insert : list_path_to_insert length 149 new photo from crops ! About to upload 149 photos upload in portfolio : 3736932 init cache_photo without model_param we have 149 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747752219_3093930 we have uploaded 149 photos in the portfolio 3736932 time of upload the photos Elapsed time : 36.30750393867493 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747752266_3093930 we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.375470399856567 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747752273_3093930 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7821745872497559 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747752283_3093930 we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.017864227294922 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747752290_3093930 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8781967163085938 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747752293_3093930 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5939390659332275 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747752295_3093930 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6381833553314209 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1359818864, 1359818829, 1359818825, 1359818821, 1359818818, 1359818814, 1359818742, 1359818740, 1359818738, 1359818734, 1359818730] Looping around the photos to save general results len do output : 183 /1359827225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359827566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818864', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818829', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818825', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818821', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818818', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818814', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818742', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818740', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818738', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818734', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818730', None, None, None, None, None, '2910391') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 560 time used for this insertion : 0.034055471420288086 save_final save missing photos in datou_result : time spend for datou_step_exec : 148.10493350028992 time spend to save output : 0.03934884071350098 total time spend for step 2 : 148.14428234100342 step3:rle_unique_nms_with_priority Tue May 20 16:44:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 183 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 9.29811716079712 time for calcul the mask position with numpy : 0.6211354732513428 nb_pixel_total : 6215617 time to create 1 rle with new method : 0.9804880619049072 time for calcul the mask position with numpy : 0.02511119842529297 nb_pixel_total : 42539 time to create 1 rle with old method : 0.0467832088470459 time for calcul the mask position with numpy : 0.032121896743774414 nb_pixel_total : 683964 time to create 1 rle with new method : 0.9808957576751709 time for calcul the mask position with numpy : 0.025867462158203125 nb_pixel_total : 29159 time to create 1 rle with old method : 0.03324723243713379 time for calcul the mask position with numpy : 0.03466391563415527 nb_pixel_total : 77775 time to create 1 rle with old method : 0.11436796188354492 time for calcul the mask position with numpy : 0.03965616226196289 nb_pixel_total : 57762 time to create 1 rle with old method : 0.06417036056518555 time for calcul the mask position with numpy : 0.024567604064941406 nb_pixel_total : 73820 time to create 1 rle with old method : 0.08318066596984863 time for calcul the mask position with numpy : 0.026633262634277344 nb_pixel_total : 187840 time to create 1 rle with new method : 0.9207577705383301 time for calcul the mask position with numpy : 0.026612520217895508 nb_pixel_total : 70716 time to create 1 rle with old method : 0.08153223991394043 time for calcul the mask position with numpy : 0.025812864303588867 nb_pixel_total : 90774 time to create 1 rle with old method : 0.10128641128540039 time for calcul the mask position with numpy : 0.025421857833862305 nb_pixel_total : 9038 time to create 1 rle with old method : 0.010401725769042969 time for calcul the mask position with numpy : 0.02520608901977539 nb_pixel_total : 11324 time to create 1 rle with old method : 0.012591361999511719 time for calcul the mask position with numpy : 0.02653193473815918 nb_pixel_total : 96181 time to create 1 rle with old method : 0.10662698745727539 time for calcul the mask position with numpy : 0.02549123764038086 nb_pixel_total : 28086 time to create 1 rle with old method : 0.03265261650085449 time for calcul the mask position with numpy : 0.030434131622314453 nb_pixel_total : 301802 time to create 1 rle with new method : 1.1668250560760498 time for calcul the mask position with numpy : 0.02895665168762207 nb_pixel_total : 30709 time to create 1 rle with old method : 0.038820743560791016 time for calcul the mask position with numpy : 0.028348445892333984 nb_pixel_total : 244848 time to create 1 rle with new method : 1.2903354167938232 time for calcul the mask position with numpy : 0.025252342224121094 nb_pixel_total : 42446 time to create 1 rle with old method : 0.04742264747619629 create new chi : 7.367251396179199 time to delete rle : 0.0169680118560791 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 17703 TO DO : save crop sub photo not yet done ! save time : 1.0992121696472168 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 13.636175870895386 time for calcul the mask position with numpy : 0.9003643989562988 nb_pixel_total : 6606327 time to create 1 rle with new method : 1.3630397319793701 time for calcul the mask position with numpy : 0.045171499252319336 nb_pixel_total : 60781 time to create 1 rle with old method : 0.07011818885803223 time for calcul the mask position with numpy : 0.04168963432312012 nb_pixel_total : 17060 time to create 1 rle with old method : 0.031624794006347656 time for calcul the mask position with numpy : 0.047809600830078125 nb_pixel_total : 154128 time to create 1 rle with new method : 0.49868297576904297 time for calcul the mask position with numpy : 0.04008984565734863 nb_pixel_total : 41097 time to create 1 rle with old method : 0.04686379432678223 time for calcul the mask position with numpy : 0.03956103324890137 nb_pixel_total : 74244 time to create 1 rle with old method : 0.08424758911132812 time for calcul the mask position with numpy : 0.04745793342590332 nb_pixel_total : 108311 time to create 1 rle with old method : 0.13007640838623047 time for calcul the mask position with numpy : 0.04658865928649902 nb_pixel_total : 60153 time to create 1 rle with old method : 0.07201814651489258 time for calcul the mask position with numpy : 0.048940420150756836 nb_pixel_total : 43877 time to create 1 rle with old method : 0.05366253852844238 time for calcul the mask position with numpy : 0.04853630065917969 nb_pixel_total : 92648 time to create 1 rle with old method : 0.12030887603759766 time for calcul the mask position with numpy : 0.04180598258972168 nb_pixel_total : 94791 time to create 1 rle with old method : 0.11040806770324707 time for calcul the mask position with numpy : 0.041968345642089844 nb_pixel_total : 246262 time to create 1 rle with new method : 0.6018803119659424 time for calcul the mask position with numpy : 0.05486607551574707 nb_pixel_total : 71186 time to create 1 rle with old method : 0.0907752513885498 time for calcul the mask position with numpy : 0.04386591911315918 nb_pixel_total : 120221 time to create 1 rle with old method : 0.13933086395263672 time for calcul the mask position with numpy : 0.040793657302856445 nb_pixel_total : 50459 time to create 1 rle with old method : 0.05875515937805176 time for calcul the mask position with numpy : 0.03689861297607422 nb_pixel_total : 98553 time to create 1 rle with old method : 0.11901569366455078 time for calcul the mask position with numpy : 0.03687286376953125 nb_pixel_total : 145163 time to create 1 rle with old method : 0.18037700653076172 time for calcul the mask position with numpy : 0.03671908378601074 nb_pixel_total : 16430 time to create 1 rle with old method : 0.019440174102783203 time for calcul the mask position with numpy : 0.031664133071899414 nb_pixel_total : 21865 time to create 1 rle with old method : 0.025502681732177734 time for calcul the mask position with numpy : 0.029206037521362305 nb_pixel_total : 100323 time to create 1 rle with old method : 0.11835789680480957 time for calcul the mask position with numpy : 0.027933359146118164 nb_pixel_total : 70521 time to create 1 rle with old method : 0.08367276191711426 create new chi : 5.866473913192749 time to delete rle : 0.0045070648193359375 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 16567 TO DO : save crop sub photo not yet done ! save time : 1.0589380264282227 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 14.182204961776733 time for calcul the mask position with numpy : 0.8852572441101074 nb_pixel_total : 6263359 time to create 1 rle with new method : 1.0276589393615723 time for calcul the mask position with numpy : 0.0490264892578125 nb_pixel_total : 97738 time to create 1 rle with old method : 0.11578774452209473 time for calcul the mask position with numpy : 0.04430365562438965 nb_pixel_total : 82770 time to create 1 rle with old method : 0.09640645980834961 time for calcul the mask position with numpy : 0.043651580810546875 nb_pixel_total : 37750 time to create 1 rle with old method : 0.04822254180908203 time for calcul the mask position with numpy : 0.04681873321533203 nb_pixel_total : 156277 time to create 1 rle with new method : 0.7651658058166504 time for calcul the mask position with numpy : 0.04189181327819824 nb_pixel_total : 78555 time to create 1 rle with old method : 0.0942392349243164 time for calcul the mask position with numpy : 0.04443693161010742 nb_pixel_total : 27563 time to create 1 rle with old method : 0.03390049934387207 time for calcul the mask position with numpy : 0.04699444770812988 nb_pixel_total : 46685 time to create 1 rle with old method : 0.054280757904052734 time for calcul the mask position with numpy : 0.04387974739074707 nb_pixel_total : 23161 time to create 1 rle with old method : 0.027188539505004883 time for calcul the mask position with numpy : 0.04450392723083496 nb_pixel_total : 96846 time to create 1 rle with old method : 0.1159052848815918 time for calcul the mask position with numpy : 0.04922842979431152 nb_pixel_total : 19370 time to create 1 rle with old method : 0.024440765380859375 time for calcul the mask position with numpy : 0.042647361755371094 nb_pixel_total : 197444 time to create 1 rle with new method : 0.8851885795593262 time for calcul the mask position with numpy : 0.041916847229003906 nb_pixel_total : 139859 time to create 1 rle with old method : 0.16167044639587402 time for calcul the mask position with numpy : 0.04246830940246582 nb_pixel_total : 17485 time to create 1 rle with old method : 0.02046990394592285 time for calcul the mask position with numpy : 0.043770551681518555 nb_pixel_total : 42048 time to create 1 rle with old method : 0.04926443099975586 time for calcul the mask position with numpy : 0.04259824752807617 nb_pixel_total : 141317 time to create 1 rle with old method : 0.1664717197418213 time for calcul the mask position with numpy : 0.04223370552062988 nb_pixel_total : 182525 time to create 1 rle with new method : 1.7991724014282227 time for calcul the mask position with numpy : 0.04533267021179199 nb_pixel_total : 95782 time to create 1 rle with old method : 0.12500739097595215 time for calcul the mask position with numpy : 0.04578876495361328 nb_pixel_total : 70031 time to create 1 rle with old method : 0.08300900459289551 time for calcul the mask position with numpy : 0.04202723503112793 nb_pixel_total : 68269 time to create 1 rle with old method : 0.07784056663513184 time for calcul the mask position with numpy : 0.0478055477142334 nb_pixel_total : 138968 time to create 1 rle with old method : 0.16099929809570312 time for calcul the mask position with numpy : 0.04586672782897949 nb_pixel_total : 35188 time to create 1 rle with old method : 0.04083538055419922 time for calcul the mask position with numpy : 0.04398751258850098 nb_pixel_total : 32432 time to create 1 rle with old method : 0.03824281692504883 time for calcul the mask position with numpy : 0.04602980613708496 nb_pixel_total : 202978 time to create 1 rle with new method : 1.1195120811462402 create new chi : 9.202969074249268 time to delete rle : 0.003045797348022461 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++Number RLEs to save : 19145 TO DO : save crop sub photo not yet done ! save time : 1.2502954006195068 nb_obj : 17 nb_hashtags : 2 time to prepare the origin masks : 12.599650144577026 time for calcul the mask position with numpy : 1.1044948101043701 nb_pixel_total : 7001125 time to create 1 rle with new method : 1.8053629398345947 time for calcul the mask position with numpy : 0.026376008987426758 nb_pixel_total : 263932 time to create 1 rle with new method : 0.7088840007781982 time for calcul the mask position with numpy : 0.026187658309936523 nb_pixel_total : 29484 time to create 1 rle with old method : 0.03443121910095215 time for calcul the mask position with numpy : 0.02635049819946289 nb_pixel_total : 29363 time to create 1 rle with old method : 0.03487372398376465 time for calcul the mask position with numpy : 0.027144193649291992 nb_pixel_total : 7892 time to create 1 rle with old method : 0.00970458984375 time for calcul the mask position with numpy : 0.027963876724243164 nb_pixel_total : 1213 time to create 1 rle with old method : 0.0015397071838378906 time for calcul the mask position with numpy : 0.03584647178649902 nb_pixel_total : 54680 time to create 1 rle with old method : 0.0632929801940918 time for calcul the mask position with numpy : 0.041056156158447266 nb_pixel_total : 58631 time to create 1 rle with old method : 0.07248616218566895 time for calcul the mask position with numpy : 0.04191279411315918 nb_pixel_total : 378014 time to create 1 rle with new method : 1.0162088871002197 time for calcul the mask position with numpy : 0.0392916202545166 nb_pixel_total : 6780 time to create 1 rle with old method : 0.0078105926513671875 time for calcul the mask position with numpy : 0.04180121421813965 nb_pixel_total : 15490 time to create 1 rle with old method : 0.02536320686340332 time for calcul the mask position with numpy : 0.046163320541381836 nb_pixel_total : 52338 time to create 1 rle with old method : 0.060909271240234375 time for calcul the mask position with numpy : 0.04085350036621094 nb_pixel_total : 19976 time to create 1 rle with old method : 0.024888992309570312 time for calcul the mask position with numpy : 0.048731088638305664 nb_pixel_total : 34934 time to create 1 rle with old method : 0.04659461975097656 time for calcul the mask position with numpy : 0.048288822174072266 nb_pixel_total : 103348 time to create 1 rle with old method : 0.12083745002746582 time for calcul the mask position with numpy : 0.045710086822509766 nb_pixel_total : 42444 time to create 1 rle with old method : 0.054406166076660156 time for calcul the mask position with numpy : 0.04154229164123535 nb_pixel_total : 27951 time to create 1 rle with old method : 0.03276968002319336 time for calcul the mask position with numpy : 0.04250741004943848 nb_pixel_total : 166805 time to create 1 rle with new method : 0.8577914237976074 create new chi : 6.887229919433594 time to delete rle : 0.0036089420318603516 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 15174 TO DO : save crop sub photo not yet done ! save time : 0.9019551277160645 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 8.446288824081421 time for calcul the mask position with numpy : 0.7253849506378174 nb_pixel_total : 7133464 time to create 1 rle with new method : 1.11871337890625 time for calcul the mask position with numpy : 0.05921196937561035 nb_pixel_total : 20265 time to create 1 rle with old method : 0.023725509643554688 time for calcul the mask position with numpy : 0.04298901557922363 nb_pixel_total : 8807 time to create 1 rle with old method : 0.010267496109008789 time for calcul the mask position with numpy : 0.043056488037109375 nb_pixel_total : 35353 time to create 1 rle with old method : 0.04510998725891113 time for calcul the mask position with numpy : 0.04041886329650879 nb_pixel_total : 21054 time to create 1 rle with old method : 0.02454233169555664 time for calcul the mask position with numpy : 0.04032087326049805 nb_pixel_total : 116648 time to create 1 rle with old method : 0.13622069358825684 time for calcul the mask position with numpy : 0.03534674644470215 nb_pixel_total : 218271 time to create 1 rle with new method : 0.8553297519683838 time for calcul the mask position with numpy : 0.04233670234680176 nb_pixel_total : 96153 time to create 1 rle with old method : 0.11239790916442871 time for calcul the mask position with numpy : 0.0437164306640625 nb_pixel_total : 408480 time to create 1 rle with new method : 0.6125679016113281 time for calcul the mask position with numpy : 0.039170265197753906 nb_pixel_total : 59211 time to create 1 rle with old method : 0.06857895851135254 time for calcul the mask position with numpy : 0.041339874267578125 nb_pixel_total : 51648 time to create 1 rle with old method : 0.059925079345703125 time for calcul the mask position with numpy : 0.040726661682128906 nb_pixel_total : 12416 time to create 1 rle with old method : 0.014531612396240234 time for calcul the mask position with numpy : 0.04121828079223633 nb_pixel_total : 16411 time to create 1 rle with old method : 0.019276857376098633 time for calcul the mask position with numpy : 0.04364514350891113 nb_pixel_total : 36381 time to create 1 rle with old method : 0.042729854583740234 time for calcul the mask position with numpy : 0.04203534126281738 nb_pixel_total : 59838 time to create 1 rle with old method : 0.0888669490814209 create new chi : 4.665015935897827 time to delete rle : 0.005042552947998047 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 14613 TO DO : save crop sub photo not yet done ! save time : 0.9134311676025391 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 11.514578580856323 time for calcul the mask position with numpy : 0.6757256984710693 nb_pixel_total : 6265675 time to create 1 rle with new method : 1.437436580657959 time for calcul the mask position with numpy : 0.03500103950500488 nb_pixel_total : 96091 time to create 1 rle with old method : 0.11108088493347168 time for calcul the mask position with numpy : 0.02602863311767578 nb_pixel_total : 18213 time to create 1 rle with old method : 0.020995616912841797 time for calcul the mask position with numpy : 0.03455853462219238 nb_pixel_total : 46828 time to create 1 rle with old method : 0.05437922477722168 time for calcul the mask position with numpy : 0.040639400482177734 nb_pixel_total : 57038 time to create 1 rle with old method : 0.0658407211303711 time for calcul the mask position with numpy : 0.03993082046508789 nb_pixel_total : 26707 time to create 1 rle with old method : 0.030050277709960938 time for calcul the mask position with numpy : 0.04308485984802246 nb_pixel_total : 308786 time to create 1 rle with new method : 0.8593168258666992 time for calcul the mask position with numpy : 0.04239225387573242 nb_pixel_total : 84585 time to create 1 rle with old method : 0.09511494636535645 time for calcul the mask position with numpy : 0.03913450241088867 nb_pixel_total : 32047 time to create 1 rle with old method : 0.036708831787109375 time for calcul the mask position with numpy : 0.04198431968688965 nb_pixel_total : 385416 time to create 1 rle with new method : 1.0220320224761963 time for calcul the mask position with numpy : 0.04625296592712402 nb_pixel_total : 16048 time to create 1 rle with old method : 0.026696443557739258 time for calcul the mask position with numpy : 0.04651308059692383 nb_pixel_total : 65630 time to create 1 rle with old method : 0.07657170295715332 time for calcul the mask position with numpy : 0.04014730453491211 nb_pixel_total : 157703 time to create 1 rle with new method : 0.5254306793212891 time for calcul the mask position with numpy : 0.03897380828857422 nb_pixel_total : 62300 time to create 1 rle with old method : 0.07280516624450684 time for calcul the mask position with numpy : 0.0262908935546875 nb_pixel_total : 44371 time to create 1 rle with old method : 0.06246161460876465 time for calcul the mask position with numpy : 0.028287410736083984 nb_pixel_total : 167454 time to create 1 rle with new method : 0.9297919273376465 time for calcul the mask position with numpy : 0.02629232406616211 nb_pixel_total : 91401 time to create 1 rle with old method : 0.10599732398986816 time for calcul the mask position with numpy : 0.02592611312866211 nb_pixel_total : 39577 time to create 1 rle with old method : 0.050450801849365234 time for calcul the mask position with numpy : 0.04498028755187988 nb_pixel_total : 183933 time to create 1 rle with new method : 1.2380602359771729 time for calcul the mask position with numpy : 0.04344940185546875 nb_pixel_total : 144597 time to create 1 rle with old method : 0.17211389541625977 create new chi : 8.565682172775269 time to delete rle : 0.004822492599487305 batch 1 Loaded 40 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 18017 TO DO : save crop sub photo not yet done ! save time : 1.1940433979034424 nb_obj : 21 nb_hashtags : 3 time to prepare the origin masks : 13.542243480682373 time for calcul the mask position with numpy : 0.5949530601501465 nb_pixel_total : 5585154 time to create 1 rle with new method : 1.002129077911377 time for calcul the mask position with numpy : 0.04050397872924805 nb_pixel_total : 14526 time to create 1 rle with old method : 0.01686859130859375 time for calcul the mask position with numpy : 0.040709733963012695 nb_pixel_total : 197557 time to create 1 rle with new method : 1.1788890361785889 time for calcul the mask position with numpy : 0.04445505142211914 nb_pixel_total : 24298 time to create 1 rle with old method : 0.027668476104736328 time for calcul the mask position with numpy : 0.04278373718261719 nb_pixel_total : 329277 time to create 1 rle with new method : 1.1652538776397705 time for calcul the mask position with numpy : 0.04117774963378906 nb_pixel_total : 143186 time to create 1 rle with old method : 0.17136025428771973 time for calcul the mask position with numpy : 0.039685964584350586 nb_pixel_total : 89283 time to create 1 rle with old method : 0.10416007041931152 time for calcul the mask position with numpy : 0.027091026306152344 nb_pixel_total : 110704 time to create 1 rle with old method : 0.16501259803771973 time for calcul the mask position with numpy : 0.027109861373901367 nb_pixel_total : 28433 time to create 1 rle with old method : 0.0338892936706543 time for calcul the mask position with numpy : 0.027180910110473633 nb_pixel_total : 161274 time to create 1 rle with new method : 0.7784984111785889 time for calcul the mask position with numpy : 0.026726961135864258 nb_pixel_total : 74489 time to create 1 rle with old method : 0.08724188804626465 time for calcul the mask position with numpy : 0.0400691032409668 nb_pixel_total : 46641 time to create 1 rle with old method : 0.05817723274230957 time for calcul the mask position with numpy : 0.03955817222595215 nb_pixel_total : 43954 time to create 1 rle with old method : 0.048735857009887695 time for calcul the mask position with numpy : 0.04316592216491699 nb_pixel_total : 25258 time to create 1 rle with old method : 0.02878403663635254 time for calcul the mask position with numpy : 0.0394594669342041 nb_pixel_total : 14553 time to create 1 rle with old method : 0.01630401611328125 time for calcul the mask position with numpy : 0.039327383041381836 nb_pixel_total : 26635 time to create 1 rle with old method : 0.03005242347717285 time for calcul the mask position with numpy : 0.042012691497802734 nb_pixel_total : 39483 time to create 1 rle with old method : 0.0454106330871582 time for calcul the mask position with numpy : 0.04384565353393555 nb_pixel_total : 31772 time to create 1 rle with old method : 0.036603689193725586 time for calcul the mask position with numpy : 0.0318148136138916 nb_pixel_total : 185117 time to create 1 rle with new method : 1.3357338905334473 time for calcul the mask position with numpy : 0.053314208984375 nb_pixel_total : 785523 time to create 1 rle with new method : 1.0034286975860596 time for calcul the mask position with numpy : 0.04443717002868652 nb_pixel_total : 65588 time to create 1 rle with old method : 0.07437586784362793 time for calcul the mask position with numpy : 0.04347348213195801 nb_pixel_total : 271695 time to create 1 rle with new method : 1.0185034275054932 create new chi : 10.048831224441528 time to delete rle : 0.005262613296508789 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++++++++++Number RLEs to save : 20600 TO DO : save crop sub photo not yet done ! save time : 1.271026611328125 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 6.999837398529053 time for calcul the mask position with numpy : 0.8038425445556641 nb_pixel_total : 7932650 time to create 1 rle with new method : 0.6223020553588867 time for calcul the mask position with numpy : 0.043268442153930664 nb_pixel_total : 26190 time to create 1 rle with old method : 0.030492782592773438 time for calcul the mask position with numpy : 0.04181718826293945 nb_pixel_total : 22391 time to create 1 rle with old method : 0.026114463806152344 time for calcul the mask position with numpy : 0.02655816078186035 nb_pixel_total : 13926 time to create 1 rle with old method : 0.01643991470336914 time for calcul the mask position with numpy : 0.029611587524414062 nb_pixel_total : 61864 time to create 1 rle with old method : 0.07244515419006348 time for calcul the mask position with numpy : 0.027149438858032227 nb_pixel_total : 133691 time to create 1 rle with old method : 0.16255569458007812 time for calcul the mask position with numpy : 0.04138636589050293 nb_pixel_total : 36215 time to create 1 rle with old method : 0.04161691665649414 time for calcul the mask position with numpy : 0.035240888595581055 nb_pixel_total : 28350 time to create 1 rle with old method : 0.032530784606933594 time for calcul the mask position with numpy : 0.024493694305419922 nb_pixel_total : 39123 time to create 1 rle with old method : 0.04458260536193848 create new chi : 2.1729540824890137 time to delete rle : 0.001132965087890625 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++Number RLEs to save : 6803 TO DO : save crop sub photo not yet done ! save time : 0.4810154438018799 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 5.201918125152588 time for calcul the mask position with numpy : 0.7647910118103027 nb_pixel_total : 6309861 time to create 1 rle with new method : 0.6125295162200928 time for calcul the mask position with numpy : 0.02451801300048828 nb_pixel_total : 8014 time to create 1 rle with old method : 0.009400606155395508 time for calcul the mask position with numpy : 0.029872417449951172 nb_pixel_total : 49872 time to create 1 rle with old method : 0.057839155197143555 time for calcul the mask position with numpy : 0.038487911224365234 nb_pixel_total : 1153278 time to create 1 rle with new method : 0.670036792755127 time for calcul the mask position with numpy : 0.031058311462402344 nb_pixel_total : 292682 time to create 1 rle with new method : 0.960512638092041 time for calcul the mask position with numpy : 0.02949666976928711 nb_pixel_total : 134953 time to create 1 rle with old method : 0.1930849552154541 time for calcul the mask position with numpy : 0.044869422912597656 nb_pixel_total : 43996 time to create 1 rle with old method : 0.05118131637573242 time for calcul the mask position with numpy : 0.04310154914855957 nb_pixel_total : 26848 time to create 1 rle with old method : 0.0376589298248291 time for calcul the mask position with numpy : 0.04872775077819824 nb_pixel_total : 103202 time to create 1 rle with old method : 0.13240480422973633 time for calcul the mask position with numpy : 0.03999066352844238 nb_pixel_total : 87787 time to create 1 rle with old method : 0.10677170753479004 time for calcul the mask position with numpy : 0.0338139533996582 nb_pixel_total : 83907 time to create 1 rle with old method : 0.11010026931762695 create new chi : 4.185941457748413 time to delete rle : 0.0019061565399169922 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 11142 TO DO : save crop sub photo not yet done ! save time : 0.7116832733154297 nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 10.030211925506592 time for calcul the mask position with numpy : 0.5995275974273682 nb_pixel_total : 6172373 time to create 1 rle with new method : 1.2428529262542725 time for calcul the mask position with numpy : 0.03889584541320801 nb_pixel_total : 3941 time to create 1 rle with old method : 0.004634380340576172 time for calcul the mask position with numpy : 0.039771318435668945 nb_pixel_total : 163452 time to create 1 rle with new method : 0.9712061882019043 time for calcul the mask position with numpy : 0.03794240951538086 nb_pixel_total : 26908 time to create 1 rle with old method : 0.03148031234741211 time for calcul the mask position with numpy : 0.04015636444091797 nb_pixel_total : 31615 time to create 1 rle with old method : 0.03685307502746582 time for calcul the mask position with numpy : 0.04239630699157715 nb_pixel_total : 135750 time to create 1 rle with old method : 0.15242338180541992 time for calcul the mask position with numpy : 0.02614283561706543 nb_pixel_total : 87541 time to create 1 rle with old method : 0.09924554824829102 time for calcul the mask position with numpy : 0.030497074127197266 nb_pixel_total : 173944 time to create 1 rle with new method : 0.8344924449920654 time for calcul the mask position with numpy : 0.04249215126037598 nb_pixel_total : 47242 time to create 1 rle with old method : 0.05550813674926758 time for calcul the mask position with numpy : 0.040120601654052734 nb_pixel_total : 25741 time to create 1 rle with old method : 0.029181480407714844 time for calcul the mask position with numpy : 0.03955411911010742 nb_pixel_total : 94252 time to create 1 rle with old method : 0.10838174819946289 time for calcul the mask position with numpy : 0.04801607131958008 nb_pixel_total : 22665 time to create 1 rle with old method : 0.03774905204772949 time for calcul the mask position with numpy : 0.04385566711425781 nb_pixel_total : 138943 time to create 1 rle with old method : 0.15883779525756836 time for calcul the mask position with numpy : 0.040503501892089844 nb_pixel_total : 55476 time to create 1 rle with old method : 0.06649303436279297 time for calcul the mask position with numpy : 0.04236578941345215 nb_pixel_total : 133278 time to create 1 rle with old method : 0.15565180778503418 time for calcul the mask position with numpy : 0.039649009704589844 nb_pixel_total : 95172 time to create 1 rle with old method : 0.10622382164001465 time for calcul the mask position with numpy : 0.03903961181640625 nb_pixel_total : 138477 time to create 1 rle with old method : 0.15340495109558105 time for calcul the mask position with numpy : 0.03746676445007324 nb_pixel_total : 50432 time to create 1 rle with old method : 0.0579531192779541 time for calcul the mask position with numpy : 0.029163837432861328 nb_pixel_total : 33447 time to create 1 rle with old method : 0.03866744041442871 time for calcul the mask position with numpy : 0.03020620346069336 nb_pixel_total : 330752 time to create 1 rle with new method : 1.0057165622711182 time for calcul the mask position with numpy : 0.02535080909729004 nb_pixel_total : 50552 time to create 1 rle with old method : 0.05736660957336426 time for calcul the mask position with numpy : 0.026837825775146484 nb_pixel_total : 282447 time to create 1 rle with new method : 1.0825448036193848 create new chi : 8.019861459732056 time to delete rle : 0.005524873733520508 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19695 TO DO : save crop sub photo not yet done ! save time : 1.1957221031188965 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 6.19764256477356 time for calcul the mask position with numpy : 0.6463565826416016 nb_pixel_total : 7459673 time to create 1 rle with new method : 1.1954896450042725 time for calcul the mask position with numpy : 0.03380084037780762 nb_pixel_total : 75018 time to create 1 rle with old method : 0.08580279350280762 time for calcul the mask position with numpy : 0.025850772857666016 nb_pixel_total : 31208 time to create 1 rle with old method : 0.03666424751281738 time for calcul the mask position with numpy : 0.025496482849121094 nb_pixel_total : 8604 time to create 1 rle with old method : 0.009777069091796875 time for calcul the mask position with numpy : 0.024437427520751953 nb_pixel_total : 57793 time to create 1 rle with old method : 0.06482553482055664 time for calcul the mask position with numpy : 0.04052162170410156 nb_pixel_total : 208081 time to create 1 rle with new method : 0.9008398056030273 time for calcul the mask position with numpy : 0.03926706314086914 nb_pixel_total : 83484 time to create 1 rle with old method : 0.09472298622131348 time for calcul the mask position with numpy : 0.04149675369262695 nb_pixel_total : 1380 time to create 1 rle with old method : 0.002004861831665039 time for calcul the mask position with numpy : 0.03683662414550781 nb_pixel_total : 140357 time to create 1 rle with old method : 0.1571650505065918 time for calcul the mask position with numpy : 0.034230709075927734 nb_pixel_total : 46688 time to create 1 rle with old method : 0.05314230918884277 time for calcul the mask position with numpy : 0.027862071990966797 nb_pixel_total : 28508 time to create 1 rle with old method : 0.03255581855773926 time for calcul the mask position with numpy : 0.025454998016357422 nb_pixel_total : 115879 time to create 1 rle with old method : 0.1328411102294922 time for calcul the mask position with numpy : 0.024914026260375977 nb_pixel_total : 37727 time to create 1 rle with old method : 0.04285907745361328 create new chi : 3.906942129135132 time to delete rle : 0.00168609619140625 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 10683 TO DO : save crop sub photo not yet done ! save time : 0.7515265941619873 map_output_result : {1359818864: (0.0, 'Should be the crop_list due to order', 0), 1359818829: (0.0, 'Should be the crop_list due to order', 0), 1359818825: (0.0, 'Should be the crop_list due to order', 0), 1359818821: (0.0, 'Should be the crop_list due to order', 0), 1359818818: (0.0, 'Should be the crop_list due to order', 0), 1359818814: (0.0, 'Should be the crop_list due to order', 0), 1359818742: (0.0, 'Should be the crop_list due to order', 0), 1359818740: (0.0, 'Should be the crop_list due to order', 0), 1359818738: (0.0, 'Should be the crop_list due to order', 0), 1359818734: (0.0, 'Should be the crop_list due to order', 0), 1359818730: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1359818864, 1359818829, 1359818825, 1359818821, 1359818818, 1359818814, 1359818742, 1359818740, 1359818738, 1359818734, 1359818730] Looping around the photos to save general results len do output : 11 /1359818864.Didn't retrieve data . /1359818829.Didn't retrieve data . /1359818825.Didn't retrieve data . /1359818821.Didn't retrieve data . /1359818818.Didn't retrieve data . /1359818814.Didn't retrieve data . /1359818742.Didn't retrieve data . /1359818740.Didn't retrieve data . /1359818738.Didn't retrieve data . /1359818734.Didn't retrieve data . /1359818730.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818864', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818829', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818825', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818821', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818818', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818814', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818742', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818740', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818738', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818734', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818730', None, None, None, None, None, '2910391') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01383066177368164 save_final save missing photos in datou_result : time spend for datou_step_exec : 195.39484906196594 time spend to save output : 0.01459193229675293 total time spend for step 3 : 195.4094409942627 step4:ventilate_hashtags_in_portfolio Tue May 20 16:48:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23172907 get user id for portfolio 23172907 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23172907 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','background','papier','pet_clair','pet_fonce','environnement','carton','mal_croppe','flou','metal','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23172907 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','background','papier','pet_clair','pet_fonce','environnement','carton','mal_croppe','flou','metal','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23172907 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','background','papier','pet_clair','pet_fonce','environnement','carton','mal_croppe','flou','metal','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23173593,23173594,23173595,23173596,23173597,23173598,23173599,23173600,23173601,23173602,23173603?tags=autre,background,papier,pet_clair,pet_fonce,environnement,carton,mal_croppe,flou,metal,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1359818864, 1359818829, 1359818825, 1359818821, 1359818818, 1359818814, 1359818742, 1359818740, 1359818738, 1359818734, 1359818730] Looping around the photos to save general results len do output : 1 /23172907. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818864', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818829', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818825', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818821', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818818', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818814', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818742', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818740', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818738', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818734', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818730', None, None, None, None, None, '2910391') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.017404556274414062 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6514763832092285 time spend to save output : 0.017803668975830078 total time spend for step 4 : 1.6692800521850586 step5:final Tue May 20 16:48:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1359818864: ('0.20049805783529734',), 1359818829: ('0.20049805783529734',), 1359818825: ('0.20049805783529734',), 1359818821: ('0.20049805783529734',), 1359818818: ('0.20049805783529734',), 1359818814: ('0.20049805783529734',), 1359818742: ('0.20049805783529734',), 1359818740: ('0.20049805783529734',), 1359818738: ('0.20049805783529734',), 1359818734: ('0.20049805783529734',), 1359818730: ('0.20049805783529734',)} new output for save of step final : {1359818864: ('0.20049805783529734',), 1359818829: ('0.20049805783529734',), 1359818825: ('0.20049805783529734',), 1359818821: ('0.20049805783529734',), 1359818818: ('0.20049805783529734',), 1359818814: ('0.20049805783529734',), 1359818742: ('0.20049805783529734',), 1359818740: ('0.20049805783529734',), 1359818738: ('0.20049805783529734',), 1359818734: ('0.20049805783529734',), 1359818730: ('0.20049805783529734',)} [1359818864, 1359818829, 1359818825, 1359818821, 1359818818, 1359818814, 1359818742, 1359818740, 1359818738, 1359818734, 1359818730] Looping around the photos to save general results len do output : 11 /1359818864.Didn't retrieve data . /1359818829.Didn't retrieve data . /1359818825.Didn't retrieve data . /1359818821.Didn't retrieve data . /1359818818.Didn't retrieve data . /1359818814.Didn't retrieve data . /1359818742.Didn't retrieve data . /1359818740.Didn't retrieve data . /1359818738.Didn't retrieve data . /1359818734.Didn't retrieve data . /1359818730.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818864', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818829', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818825', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818821', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818818', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818814', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818742', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818740', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818738', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818734', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818730', None, None, None, None, None, '2910391') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.013145923614501953 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11280083656311035 time spend to save output : 0.013693809509277344 total time spend for step 5 : 0.1264946460723877 step6:blur_detection Tue May 20 16:48:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d.jpg resize: (2160, 3840) 1359818864 -5.7720909384731875 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492.jpg resize: (2160, 3840) 1359818829 -5.64013114684008 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a.jpg resize: (2160, 3840) 1359818825 -5.708375962553575 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f.jpg resize: (2160, 3840) 1359818821 -5.96477522551527 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71.jpg resize: (2160, 3840) 1359818818 -5.890328306922733 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd.jpg resize: (2160, 3840) 1359818814 -5.701889897276462 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637.jpg resize: (2160, 3840) 1359818742 -5.8297347594973035 treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad.jpg resize: (2160, 3840) 1359818740 -3.4639219682390316 treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab.jpg resize: (2160, 3840) 1359818738 -5.492918283171125 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13.jpg resize: (2160, 3840) 1359818734 -5.575365594418047 treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5.jpg resize: (2160, 3840) 1359818730 -5.586043180019925 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417943_0.png resize: (274, 200) 1359827225 -0.05518562310206272 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417944_0.png resize: (577, 553) 1359827226 -4.518251414464012 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417945_0.png resize: (264, 160) 1359827228 -2.5857775521729307 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417946_0.png resize: (759, 677) 1359827229 -3.4053483991149713 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417947_0.png resize: (146, 298) 1359827230 -3.172632412193878 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417948_0.png resize: (384, 361) 1359827232 -3.749660651901718 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417950_0.png resize: (57, 208) 1359827233 -2.8984016154758354 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417951_0.png resize: (466, 245) 1359827234 -1.4909521058298052 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417953_0.png resize: (481, 711) 1359827235 -2.026122607397834 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417956_0.png resize: (321, 335) 1359827237 -3.1023535077759083 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417958_0.png resize: (1764, 760) 1359827238 -4.416148428289999 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417959_0.png resize: (307, 194) 1359827239 -4.076935418746571 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417960_0.png resize: (341, 297) 1359827241 -2.448055586427676 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417961_0.png resize: (558, 334) 1359827242 -3.561932678393575 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417962_0.png resize: (179, 174) 1359827243 -2.1070240599400263 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417963_0.png resize: (180, 146) 1359827245 -2.8355432498694912 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417964_0.png resize: (324, 651) 1359827246 -4.703233337013737 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417965_0.png resize: (399, 387) 1359827247 -3.678970805247328 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417966_0.png resize: (260, 270) 1359827249 -1.1578942073177645 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417968_0.png resize: (235, 409) 1359827250 -1.5074841777840546 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417969_0.png resize: (630, 505) 1359827251 -4.780184097740551 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417970_0.png resize: (400, 426) 1359827253 -2.721581075998416 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417971_0.png resize: (418, 311) 1359827254 -3.325339602683207 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417972_0.png resize: (336, 238) 1359827256 -3.274641763594845 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417973_0.png resize: (266, 313) 1359827258 -5.154975032260258 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417974_0.png resize: (340, 511) 1359827259 -3.689617357664939 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417975_0.png resize: (329, 297) 1359827260 -3.9240672716896716 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417976_0.png resize: (214, 292) 1359827262 -3.556521933398083 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417978_0.png resize: (279, 277) 1359827263 -4.700257025035297 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417980_0.png resize: (473, 582) 1359827264 -4.4691131527561705 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417981_0.png resize: (222, 189) 1359827266 -2.498113887271154 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417983_0.png resize: (391, 618) 1359827267 -1.691135811203605 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417984_0.png resize: (273, 402) 1359827268 -2.7461456320675746 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417985_0.png resize: (220, 510) 1359827269 -3.4295481560412933 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417986_0.png resize: (269, 515) 1359827271 -3.5294510203135174 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417987_0.png resize: (566, 426) 1359827272 -4.599156752053775 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417988_0.png resize: (522, 445) 1359827273 -2.37501112781671 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417989_0.png resize: (201, 278) 1359827275 -3.171090261348716 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417990_0.png resize: (181, 163) 1359827276 -3.0487659379149177 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417991_0.png resize: (476, 482) 1359827277 -3.8917271852842097 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417992_0.png resize: (731, 418) 1359827279 -4.391833654504321 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417993_0.png resize: (313, 77) 1359827280 -1.2653386689530792 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417994_0.png resize: (496, 335) 1359827281 -3.830439335462368 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417995_0.png resize: (248, 125) 1359827283 -4.246599061672893 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417997_0.png resize: (160, 212) 1359827284 -3.583799769238776 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417998_0.png resize: (367, 303) 1359827285 -1.927206169052963 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417999_0.png resize: (645, 320) 1359827287 -3.727310458745074 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806418000_0.png resize: (209, 233) 1359827288 -2.838351393367068 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806418001_0.png resize: (267, 357) 1359827289 -1.5988725688975647 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806418002_0.png resize: (261, 482) 1359827291 -3.4035914724507887 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418003_0.png resize: (669, 399) 1359827293 -3.699774165485253 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418004_0.png resize: (320, 143) 1359827294 -3.3493282996685383 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418005_0.png resize: (361, 169) 1359827296 -1.178061671373115 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418006_0.png resize: (321, 430) 1359827299 -4.440065781431163 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418007_0.png resize: (290, 248) 1359827300 -3.193729660638524 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418008_0.png resize: (184, 165) 1359827302 -1.362171465324168 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418009_0.png resize: (488, 129) 1359827306 -3.507119175570718 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418010_0.png resize: (159, 145) 1359827307 -3.4145065545735314 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418011_0.png resize: (105, 104) 1359827309 -1.180048215903491 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418012_0.png resize: (951, 619) 1359827311 -4.23020502550318 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418013_0.png resize: (277, 335) 1359827312 -3.4923577144380973 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418014_0.png resize: (398, 337) 1359827314 -3.262223176996312 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418015_0.png resize: (265, 156) 1359827316 -0.48100208813671763 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418017_0.png resize: (264, 156) 1359827317 -3.356969833094577 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418018_0.png resize: (360, 225) 1359827318 -2.4367098809608403 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418019_0.png resize: (620, 740) 1359827321 -4.711617223799585 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418020_0.png resize: (300, 262) 1359827322 -1.0297030243841707 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418021_0.png resize: (310, 310) 1359827323 -2.5383511660720703 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418024_0.png resize: (501, 192) 1359827326 -2.0641281988597266 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418025_0.png resize: (294, 462) 1359827327 -2.385207287953226 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418026_0.png resize: (766, 895) 1359827328 -4.714843311125056 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418027_0.png resize: (548, 354) 1359827331 -4.107503205365862 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418028_0.png resize: (850, 526) 1359827332 -4.334512168858831 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418029_0.png resize: (360, 522) 1359827333 -4.006845507179853 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418030_0.png resize: (420, 126) 1359827336 -3.772441605263185 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418031_0.png resize: (339, 134) 1359827338 -3.4146013059044655 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418033_0.png resize: (214, 170) 1359827339 -0.4611391746275021 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418034_0.png resize: (432, 480) 1359827342 -2.412081467241274 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418035_0.png resize: (502, 504) 1359827343 -0.22361127955486854 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418036_0.png resize: (257, 233) 1359827344 -4.231254373081219 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418038_0.png resize: (334, 685) 1359827347 -3.669970934118866 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418039_0.png resize: (258, 272) 1359827348 -2.462266603879972 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418040_0.png resize: (281, 350) 1359827349 -1.4278326127687184 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418041_0.png resize: (376, 640) 1359827351 -3.2698411344855165 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418042_0.png resize: (388, 384) 1359827353 -2.866609151755512 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418043_0.png resize: (132, 164) 1359827354 -3.366681142852806 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418044_0.png resize: (934, 636) 1359827355 -3.986313570874365 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418045_0.png resize: (330, 353) 1359827357 -2.645403778163817 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418046_0.png resize: (359, 359) 1359827358 -4.167959798824788 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418047_0.png resize: (583, 754) 1359827359 -4.500524721021323 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418048_0.png resize: (140, 193) 1359827361 -2.895618439077816 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418049_0.png resize: (167, 296) 1359827364 -2.7251926587157516 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418050_0.png resize: (386, 297) 1359827365 -3.0209210657886167 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418051_0.png resize: (293, 251) 1359827367 -3.8279369422045373 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418054_0.png resize: (501, 786) 1359827368 -3.9210210229069253 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418055_0.png resize: (436, 225) 1359827369 -3.413863340983868 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418056_0.png resize: (1038, 1023) 1359827371 -3.6964167469303284 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418057_0.png resize: (632, 461) 1359827372 -4.6126219509411674 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418059_0.png resize: (230, 242) 1359827373 -0.9287235398880996 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418060_0.png resize: (154, 221) 1359827375 -1.6295681112296287 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418061_0.png resize: (188, 155) 1359827376 -2.55750211998648 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418062_0.png resize: (328, 270) 1359827377 -3.3349434790537815 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418063_0.png resize: (233, 279) 1359827379 1.3847023854797875 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418064_0.png resize: (535, 211) 1359827380 -1.611598994109743 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418066_0.png resize: (413, 577) 1359827381 -3.171269461578209 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418067_0.png resize: (129, 339) 1359827383 -3.454572213055116 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418068_0.png resize: (451, 387) 1359827384 -4.166629574973136 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418069_0.png resize: (297, 379) 1359827385 -2.8777681021078445 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418070_0.png resize: (645, 657) 1359827386 -3.3625261243738382 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418071_0.png resize: (1182, 1276) 1359827388 -4.595494912895876 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418074_0.png resize: (316, 105) 1359827389 -4.681875274009971 treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418075_0.png resize: (167, 285) 1359827391 -1.9517953055488448 treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418076_0.png resize: (241, 153) 1359827392 -3.2325566586607177 treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418077_0.png resize: (385, 201) 1359827393 -0.5505435626192983 treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418078_0.png resize: (439, 543) 1359827394 -2.4603057993339643 treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418079_0.png resize: (357, 262) 1359827395 -2.9200361965245927 treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418082_0.png resize: (172, 173) 1359827396 -4.052157699981533 treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418086_0.png resize: (155, 323) 1359827398 -0.9487553774530755 treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418087_0.png resize: (239, 440) 1359827399 -3.334393903286716 treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418091_0.png resize: (263, 312) 1359827400 -2.9235375221764364 treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418092_0.png resize: (121, 142) 1359827402 -1.9305692095379348 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418093_0.png resize: (636, 816) 1359827403 -1.0235392788249116 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418094_0.png resize: (356, 210) 1359827404 -1.2763177145903266 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418095_0.png resize: (630, 1180) 1359827406 -3.5698946816645774 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418096_0.png resize: (286, 342) 1359827407 -2.7456640374635866 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418097_0.png resize: (329, 279) 1359827408 -1.0703052947768195 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418098_0.png resize: (291, 727) 1359827409 -3.6291927831896382 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418099_0.png resize: (400, 369) 1359827410 -3.0841619917594176 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418100_0.png resize: (560, 455) 1359827411 -2.765622734355522 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418101_0.png resize: (233, 359) 1359827412 -1.975997251799511 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418102_0.png resize: (393, 526) 1359827413 -3.008679372709456 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418103_0.png resize: (136, 220) 1359827415 -4.461045264441546 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418104_0.png resize: (433, 333) 1359827417 -3.5247882580668004 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418105_0.png resize: (136, 302) 1359827418 -3.33352042234641 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418106_0.png resize: (274, 238) 1359827419 -4.548771133264874 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418107_0.png resize: (425, 562) 1359827420 -5.163485308971813 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418111_0.png resize: (364, 125) 1359827421 -3.5962180093624867 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418112_0.png resize: (465, 521) 1359827422 -4.297103721884451 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418113_0.png resize: (136, 104) 1359827423 -3.0274820623458107 treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418114_0.png resize: (348, 156) 1359827424 -2.34608293252269 treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418115_0.png resize: (591, 215) 1359827425 -2.8796162520154556 treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418116_0.png resize: (190, 209) 1359827426 -5.150374331943871 treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418117_0.png resize: (312, 255) 1359827427 -3.0676517665219163 treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418118_0.png resize: (473, 435) 1359827428 -3.461125615911524 treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418120_0.png resize: (516, 423) 1359827429 -3.862263058459628 treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418121_0.png resize: (555, 539) 1359827430 -5.650594449560861 treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418123_0.png resize: (118, 125) 1359827431 -3.565304900515586 treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418124_0.png resize: (185, 251) 1359827432 -3.154389461385772 treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418125_0.png resize: (331, 320) 1359827433 -4.162542604498974 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417952_0.png resize: (425, 286) 1359827441 -2.9732599620333136 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417955_0.png resize: (326, 253) 1359827442 -3.9949696679149587 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417979_0.png resize: (354, 306) 1359827443 -3.18315850810034 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417982_0.png resize: (212, 292) 1359827444 -4.228193214577355 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418023_0.png resize: (222, 158) 1359827445 -3.3989745204857846 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418032_0.png resize: (142, 91) 1359827446 -3.717036126394262 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418037_0.png resize: (277, 470) 1359827447 -3.1476170522800566 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418058_0.png resize: (327, 154) 1359827448 -2.4905015902592824 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418065_0.png resize: (349, 277) 1359827449 -2.5569445260116455 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418072_0.png resize: (155, 185) 1359827450 -2.8699688526683715 treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418080_0.png resize: (145, 131) 1359827451 -1.6842639630569822 treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418090_0.png resize: (990, 1702) 1359827452 -5.596542022832454 treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418119_0.png resize: (476, 424) 1359827453 -3.478586401925282 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418052_0.png resize: (211, 108) 1359827474 -4.048939572791773 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417949_0.png resize: (100, 157) 1359827529 -3.2100189356538733 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417954_0.png resize: (386, 250) 1359827530 -3.7285453184326762 treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417957_0.png resize: (196, 206) 1359827531 -1.9192266843289176 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417967_0.png resize: (265, 563) 1359827532 -3.7882714421718986 treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417977_0.png resize: (416, 544) 1359827533 -4.277239313575347 treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418022_0.png resize: (98, 233) 1359827535 -3.5176316758549366 treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418053_0.png resize: (553, 290) 1359827536 -4.95542197145395 treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418073_0.png resize: (661, 367) 1359827537 -3.7038294081846934 treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418083_0.png resize: (349, 383) 1359827538 -4.7745998508014456 treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418084_0.png resize: (308, 431) 1359827539 -4.331932774679961 treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418085_0.png resize: (310, 433) 1359827540 -4.908967073203188 treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418088_0.png resize: (410, 637) 1359827541 -3.259961666656538 treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418089_0.png resize: (580, 1199) 1359827542 -3.610994914609235 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418108_0.png resize: (178, 797) 1359827543 -3.252208829820895 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418109_0.png resize: (400, 438) 1359827544 -1.8710631114283416 treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418110_0.png resize: (99, 445) 1359827545 -3.15221277967112 treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418016_0.png resize: (113, 134) 1359827549 -2.1167569465089513 treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418081_0.png resize: (164, 176) 1359827551 -4.168769177248752 treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417996_0.png resize: (178, 330) 1359827553 -3.222772131327276 treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418122_0.png resize: (220, 389) 1359827566 -5.225050101300085 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 194 time used for this insertion : 0.0233457088470459 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 194 time used for this insertion : 0.037171125411987305 save missing photos in datou_result : time spend for datou_step_exec : 54.47668218612671 time spend to save output : 0.06624770164489746 total time spend for step 6 : 54.542929887771606 step7:brightness Tue May 20 16:49:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d.jpg treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492.jpg treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a.jpg treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f.jpg treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71.jpg treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd.jpg treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637.jpg treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad.jpg treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab.jpg treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13.jpg treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5.jpg treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417943_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417944_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417945_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417946_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417947_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417948_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417950_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417951_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417953_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417956_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417958_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417959_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417960_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417961_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417962_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417963_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417964_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417965_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417966_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417968_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417969_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417970_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417971_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417972_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417973_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417974_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417975_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417976_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417978_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417980_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417981_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417983_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417984_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417985_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417986_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417987_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417988_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417989_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417990_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417991_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417992_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417993_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417994_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417995_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417997_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417998_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417999_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806418000_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806418001_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806418002_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418003_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418004_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418005_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418006_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418007_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418008_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418009_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418010_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418011_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418012_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418013_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418014_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418015_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418017_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418018_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418019_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418020_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418021_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418024_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418025_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418026_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418027_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418028_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418029_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418030_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418031_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418033_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418034_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418035_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418036_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418038_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418039_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418040_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418041_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418042_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418043_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418044_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418045_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418046_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418047_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418048_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418049_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418050_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418051_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418054_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418055_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418056_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418057_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418059_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418060_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418061_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418062_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418063_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418064_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418066_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418067_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418068_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418069_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418070_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418071_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418074_0.png treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418075_0.png treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418076_0.png treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418077_0.png treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418078_0.png treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418079_0.png treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418082_0.png treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418086_0.png treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418087_0.png treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418091_0.png treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418092_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418093_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418094_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418095_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418096_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418097_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418098_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418099_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418100_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418101_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418102_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418103_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418104_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418105_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418106_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418107_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418111_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418112_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418113_0.png treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418114_0.png treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418115_0.png treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418116_0.png treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418117_0.png treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418118_0.png treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418120_0.png treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418121_0.png treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418123_0.png treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418124_0.png treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418125_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417952_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417955_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417979_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417982_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418023_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418032_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418037_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418058_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418065_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418072_0.png treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418080_0.png treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418090_0.png treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418119_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418052_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417949_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417954_0.png treat image : temp/1747752028_3093930_1359818864_d243c3f1b5db7a26983c698bd788be0d_rle_crop_3806417957_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417967_0.png treat image : temp/1747752028_3093930_1359818829_97a46139c4e24c049fa849e95d94a492_rle_crop_3806417977_0.png treat image : temp/1747752028_3093930_1359818818_cebb32f63636278891b1c606bd1d7d71_rle_crop_3806418022_0.png treat image : temp/1747752028_3093930_1359818814_69ed0cc3ee274513c8ee7541b29b7edd_rle_crop_3806418053_0.png treat image : temp/1747752028_3093930_1359818742_df286eef2c3d6c3e7728a2659ca21637_rle_crop_3806418073_0.png treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418083_0.png treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418084_0.png treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418085_0.png treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418088_0.png treat image : temp/1747752028_3093930_1359818738_b2b0983e71bf140a9e3ea4039ce780ab_rle_crop_3806418089_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418108_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418109_0.png treat image : temp/1747752028_3093930_1359818734_2e050a3a9055c08e489e76ca2a39ce13_rle_crop_3806418110_0.png treat image : temp/1747752028_3093930_1359818821_24895050f64068304eecb0dd2e9dbb7f_rle_crop_3806418016_0.png treat image : temp/1747752028_3093930_1359818740_cfb4938dfb06f70310eaac0c23165bad_rle_crop_3806418081_0.png treat image : temp/1747752028_3093930_1359818825_b00ce522a92d77907826151e9611387a_rle_crop_3806417996_0.png treat image : temp/1747752028_3093930_1359818730_207801200a9d3172f0c3a4da947cf8f5_rle_crop_3806418122_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 194 time used for this insertion : 0.021495342254638672 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 194 time used for this insertion : 0.036139726638793945 save missing photos in datou_result : time spend for datou_step_exec : 13.451314687728882 time spend to save output : 0.06353569030761719 total time spend for step 7 : 13.514850378036499 step8:velours_tree Tue May 20 16:49:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.10276985168457031 time spend to save output : 4.649162292480469e-05 total time spend for step 8 : 0.10281634330749512 step9:send_mail_cod Tue May 20 16:49:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23172907_20-05-2025_16_49_21.pdf 23173593 change filename to text .change filename to text .imagette231735931747752561 23173594 imagette231735941747752561 23173595 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231735951747752561 23173596 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231735961747752563 23173597 change filename to text .imagette231735971747752564 23173599 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231735991747752564 23173600 imagette231736001747752565 23173601 imagette231736011747752565 23173602 change filename to text .imagette231736021747752565 23173603 change filename to text .imagette231736031747752565 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23172907 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23173593,23173594,23173595,23173596,23173597,23173598,23173599,23173600,23173601,23173602,23173603?tags=autre,background,papier,pet_clair,pet_fonce,environnement,carton,mal_croppe,flou,metal,pehd args[1359818864] : ((1359818864, -5.7720909384731875, 492609224), (1359818864, 0.9677932316128703, 2107752395), '0.20049805783529734') We are sending mail with results at report@fotonower.com args[1359818829] : ((1359818829, -5.64013114684008, 492609224), (1359818829, 0.533684931924971, 2107752395), '0.20049805783529734') We are sending mail with results at report@fotonower.com args[1359818825] : ((1359818825, -5.708375962553575, 492609224), (1359818825, 0.9501546513339455, 2107752395), '0.20049805783529734') We are sending mail with results at report@fotonower.com args[1359818821] : ((1359818821, -5.96477522551527, 492609224), (1359818821, 1.1727861755390723, 2107752395), '0.20049805783529734') We are sending mail with results at report@fotonower.com args[1359818818] : ((1359818818, -5.890328306922733, 492609224), (1359818818, 1.128049921130348, 2107752395), '0.20049805783529734') We are sending mail with results at report@fotonower.com args[1359818814] : ((1359818814, -5.701889897276462, 492609224), (1359818814, 1.101330650280349, 2107752395), '0.20049805783529734') We are sending mail with results at report@fotonower.com args[1359818742] : ((1359818742, -5.8297347594973035, 492609224), (1359818742, 1.3129208130896892, 2107752395), '0.20049805783529734') We are sending mail with results at report@fotonower.com args[1359818740] : ((1359818740, -3.4639219682390316, 492609224), (1359818740, 0.04599017090119145, 2107752395), '0.20049805783529734') We are sending mail with results at report@fotonower.com args[1359818738] : ((1359818738, -5.492918283171125, 492609224), (1359818738, 0.38365446147542537, 2107752395), '0.20049805783529734') We are sending mail with results at report@fotonower.com args[1359818734] : ((1359818734, -5.575365594418047, 492609224), (1359818734, 0.6252928537932881, 2107752395), '0.20049805783529734') We are sending mail with results at report@fotonower.com args[1359818730] : ((1359818730, -5.586043180019925, 492609224), (1359818730, 0.38332932969414935, 2107752395), '0.20049805783529734') We are sending mail with results at report@fotonower.com refus_total : 0.20049805783529734 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23172907 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23172907_20-05-2025_16_49_21.pdf results_Auto_P23172907_20-05-2025_16_49_21.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23172907_20-05-2025_16_49_21.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23172907','results_Auto_P23172907_20-05-2025_16_49_21.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23172907_20-05-2025_16_49_21.pdf','pdf','','1.09','0.20049805783529734') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23172907

https://www.fotonower.com/image?json=false&list_photos_id=1359818864
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359818829
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359818825
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359818821
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359818818
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359818814
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359818742
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359818740
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359818738
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359818734
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359818730
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 20.05%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/23173593?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23173595?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23173596?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23173597?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23173599?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23173602?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/23173603?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23172907_20-05-2025_16_49_21.pdf.

Lien vers velours :https://www.fotonower.com/velours/23173593,23173594,23173595,23173596,23173597,23173598,23173599,23173600,23173601,23173602,23173603?tags=autre,background,papier,pet_clair,pet_fonce,environnement,carton,mal_croppe,flou,metal,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 20 May 2025 14:49:29 GMT Content-Length: 0 Connection: close X-Message-Id: 2oe1PyJFTJWwujyn4H5nzQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1359818864, 1359818829, 1359818825, 1359818821, 1359818818, 1359818814, 1359818742, 1359818740, 1359818738, 1359818734, 1359818730] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818864', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818829', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818825', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818821', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818818', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818814', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818742', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818740', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818738', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818734', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818730', None, None, None, None, None, '2910391') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01723456382751465 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.689399480819702 time spend to save output : 0.017488479614257812 total time spend for step 9 : 7.70688796043396 step10:split_time_score Tue May 20 16:49:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20052025 23172907 Nombre de photos uploadées : 11 / 23040 (0%) 20052025 23172907 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 20052025 23172907 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 7.3909759521484375e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.000606536865234375 elapsed_time : insert_dashboard_record_day_entry 0.028967857360839844 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09201400421027917 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23157181_20-05-2025_08_46_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23157181 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23157181 AND mptpi.`type`=3594 To do Qualite : 0.10180426772060878 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23157188_20-05-2025_08_35_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23157188 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23157188 AND mptpi.`type`=3594 To do Qualite : 0.09871742380401231 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23157192_20-05-2025_08_28_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23157192 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23157192 AND mptpi.`type`=3594 To do Qualite : 0.10408518822159352 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23161557_20-05-2025_10_30_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23161557 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23161557 AND mptpi.`type`=3594 To do Qualite : 0.1308608699845679 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23164737_20-05-2025_11_54_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23164737 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23164737 AND mptpi.`type`=3594 To do Qualite : 0.1064864810896508 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23164744_20-05-2025_12_03_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23164744 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23164744 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170102 order by id desc limit 1 Qualite : 0.11795572916666669 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23170104_20-05-2025_15_34_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170104 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23170104 AND mptpi.`type`=3594 To do Qualite : 0.02726871178050528 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23166958_20-05-2025_13_30_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23166958 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23166958 AND mptpi.`type`=3726 To do Qualite : 0.09543954354745371 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23166961_20-05-2025_13_20_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23166961 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23166961 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170110 order by id desc limit 1 Qualite : 0.10659472484016758 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23170112_20-05-2025_15_29_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23170112 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23170112 AND mptpi.`type`=3594 To do Qualite : 0.11812746691001888 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23171910_20-05-2025_16_37_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23171910 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23171910 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23172899 order by id desc limit 1 Qualite : 0.20049805783529734 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23172907_20-05-2025_16_49_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23172907 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23172907 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20052025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1359818864, 1359818829, 1359818825, 1359818821, 1359818818, 1359818814, 1359818742, 1359818740, 1359818738, 1359818734, 1359818730] Looping around the photos to save general results len do output : 1 /23172907Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818864', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818829', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818825', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818821', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818818', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818814', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818742', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818740', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818738', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818734', None, None, None, None, None, '2910391') ('3318', None, None, None, None, None, None, None, '2910391') ('3318', '23172907', '1359818730', None, None, None, None, None, '2910391') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.016465187072753906 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.511202812194824 time spend to save output : 0.01669597625732422 total time spend for step 10 : 3.5278987884521484 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 245.00user 237.60system 9:07.55elapsed 88%CPU (0avgtext+0avgdata 5520436maxresident)k 656840inputs+266640outputs (7758major+21995257minor)pagefaults 0swaps