python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3564198 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2911949'] with mtr_portfolio_ids : ['23177165'] and first list_photo_ids : [] new path : /proc/3564198/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.2654049396514893 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 20 19:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-20 19:20:32.777451: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-20 19:20:32.803062: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-20 19:20:32.805189: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f5944000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-20 19:20:32.805234: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-20 19:20:32.809019: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-20 19:20:32.950378: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xed406c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-20 19:20:32.950441: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-20 19:20:32.951934: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 19:20:32.952313: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 19:20:32.955204: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 19:20:32.957409: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 19:20:32.957803: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 19:20:32.960120: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 19:20:32.961362: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 19:20:32.965759: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 19:20:32.967284: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 19:20:32.967353: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 19:20:32.968142: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 19:20:32.968157: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 19:20:32.968166: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 19:20:32.969558: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9879 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-20 19:20:33.270779: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 19:20:33.270867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 19:20:33.270887: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 19:20:33.270931: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 19:20:33.270961: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 19:20:33.270987: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 19:20:33.271011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 19:20:33.271031: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 19:20:33.272606: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 19:20:33.273896: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 19:20:33.273931: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 19:20:33.273950: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 19:20:33.273967: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 19:20:33.273984: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 19:20:33.274001: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 19:20:33.274018: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 19:20:33.274035: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 19:20:33.275612: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 19:20:33.275641: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 19:20:33.275650: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 19:20:33.275657: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 19:20:33.276981: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9879 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_2025-05-20 19:20:44.408722: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 19:20:44.641565: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 45 Detection mask done ! Trying to reset tf kernel 3564928 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0008301734924316406 nb_pixel_total : 15886 time to create 1 rle with old method : 0.01963949203491211 length of segment : 161 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 7444 time to create 1 rle with old method : 0.009224176406860352 length of segment : 104 time for calcul the mask position with numpy : 0.0004017353057861328 nb_pixel_total : 15238 time to create 1 rle with old method : 0.017269134521484375 length of segment : 129 time for calcul the mask position with numpy : 0.0007843971252441406 nb_pixel_total : 26649 time to create 1 rle with old method : 0.04163646697998047 length of segment : 221 time for calcul the mask position with numpy : 0.0002880096435546875 nb_pixel_total : 7503 time to create 1 rle with old method : 0.008520126342773438 length of segment : 131 time for calcul the mask position with numpy : 0.0023932456970214844 nb_pixel_total : 89811 time to create 1 rle with old method : 0.10112214088439941 length of segment : 339 time for calcul the mask position with numpy : 0.00041294097900390625 nb_pixel_total : 18047 time to create 1 rle with old method : 0.01969289779663086 length of segment : 210 time for calcul the mask position with numpy : 0.0004930496215820312 nb_pixel_total : 26363 time to create 1 rle with old method : 0.029855012893676758 length of segment : 196 time for calcul the mask position with numpy : 0.0005159378051757812 nb_pixel_total : 25654 time to create 1 rle with old method : 0.02881932258605957 length of segment : 151 time for calcul the mask position with numpy : 0.00016164779663085938 nb_pixel_total : 4426 time to create 1 rle with old method : 0.005234241485595703 length of segment : 90 time for calcul the mask position with numpy : 0.0014014244079589844 nb_pixel_total : 55492 time to create 1 rle with old method : 0.07099699974060059 length of segment : 382 time for calcul the mask position with numpy : 0.0017032623291015625 nb_pixel_total : 87778 time to create 1 rle with old method : 0.09521102905273438 length of segment : 337 time for calcul the mask position with numpy : 0.0007932186126708984 nb_pixel_total : 22962 time to create 1 rle with old method : 0.025439739227294922 length of segment : 269 time for calcul the mask position with numpy : 0.00032138824462890625 nb_pixel_total : 12882 time to create 1 rle with old method : 0.014078855514526367 length of segment : 167 time for calcul the mask position with numpy : 0.0006251335144042969 nb_pixel_total : 40790 time to create 1 rle with old method : 0.04634737968444824 length of segment : 190 time for calcul the mask position with numpy : 0.002201557159423828 nb_pixel_total : 137576 time to create 1 rle with old method : 0.15068578720092773 length of segment : 379 time for calcul the mask position with numpy : 0.0015897750854492188 nb_pixel_total : 59690 time to create 1 rle with old method : 0.06584858894348145 length of segment : 409 time for calcul the mask position with numpy : 0.0004563331604003906 nb_pixel_total : 10808 time to create 1 rle with old method : 0.012927532196044922 length of segment : 114 time for calcul the mask position with numpy : 0.0003554821014404297 nb_pixel_total : 17358 time to create 1 rle with old method : 0.020122766494750977 length of segment : 152 time for calcul the mask position with numpy : 0.00018286705017089844 nb_pixel_total : 7394 time to create 1 rle with old method : 0.008607149124145508 length of segment : 138 time for calcul the mask position with numpy : 0.0005486011505126953 nb_pixel_total : 24700 time to create 1 rle with old method : 0.02748394012451172 length of segment : 294 time for calcul the mask position with numpy : 0.0010271072387695312 nb_pixel_total : 50082 time to create 1 rle with old method : 0.05777335166931152 length of segment : 304 time for calcul the mask position with numpy : 0.00037789344787597656 nb_pixel_total : 13878 time to create 1 rle with old method : 0.015947341918945312 length of segment : 153 time for calcul the mask position with numpy : 0.0005214214324951172 nb_pixel_total : 28993 time to create 1 rle with old method : 0.03255963325500488 length of segment : 239 time for calcul the mask position with numpy : 0.00039267539978027344 nb_pixel_total : 22308 time to create 1 rle with old method : 0.024912118911743164 length of segment : 173 time for calcul the mask position with numpy : 0.0002894401550292969 nb_pixel_total : 11897 time to create 1 rle with old method : 0.015506982803344727 length of segment : 99 time for calcul the mask position with numpy : 0.0003268718719482422 nb_pixel_total : 12975 time to create 1 rle with old method : 0.01430964469909668 length of segment : 171 time for calcul the mask position with numpy : 0.00030541419982910156 nb_pixel_total : 17545 time to create 1 rle with old method : 0.019147634506225586 length of segment : 127 time for calcul the mask position with numpy : 0.00019359588623046875 nb_pixel_total : 8036 time to create 1 rle with old method : 0.008949995040893555 length of segment : 79 time for calcul the mask position with numpy : 0.0005724430084228516 nb_pixel_total : 33441 time to create 1 rle with old method : 0.03526806831359863 length of segment : 239 time for calcul the mask position with numpy : 0.0005900859832763672 nb_pixel_total : 32883 time to create 1 rle with old method : 0.0349431037902832 length of segment : 297 time for calcul the mask position with numpy : 0.0012919902801513672 nb_pixel_total : 74628 time to create 1 rle with old method : 0.07991695404052734 length of segment : 286 time for calcul the mask position with numpy : 0.0006830692291259766 nb_pixel_total : 31607 time to create 1 rle with old method : 0.03529858589172363 length of segment : 238 time for calcul the mask position with numpy : 0.00102996826171875 nb_pixel_total : 67233 time to create 1 rle with old method : 0.07419705390930176 length of segment : 479 time for calcul the mask position with numpy : 0.00033545494079589844 nb_pixel_total : 16227 time to create 1 rle with old method : 0.017902851104736328 length of segment : 146 time for calcul the mask position with numpy : 0.0007631778717041016 nb_pixel_total : 46550 time to create 1 rle with old method : 0.05154871940612793 length of segment : 311 time for calcul the mask position with numpy : 0.00037217140197753906 nb_pixel_total : 24836 time to create 1 rle with old method : 0.02685236930847168 length of segment : 117 time for calcul the mask position with numpy : 0.0008137226104736328 nb_pixel_total : 24601 time to create 1 rle with old method : 0.026966094970703125 length of segment : 435 time for calcul the mask position with numpy : 0.0005657672882080078 nb_pixel_total : 21067 time to create 1 rle with old method : 0.023781538009643555 length of segment : 243 time for calcul the mask position with numpy : 0.0017709732055664062 nb_pixel_total : 54358 time to create 1 rle with old method : 0.0590057373046875 length of segment : 302 time for calcul the mask position with numpy : 0.0012924671173095703 nb_pixel_total : 34466 time to create 1 rle with old method : 0.03831839561462402 length of segment : 271 time for calcul the mask position with numpy : 0.0010311603546142578 nb_pixel_total : 31133 time to create 1 rle with old method : 0.0350341796875 length of segment : 134 time for calcul the mask position with numpy : 0.0026731491088867188 nb_pixel_total : 68717 time to create 1 rle with old method : 0.07449197769165039 length of segment : 326 time for calcul the mask position with numpy : 0.0006957054138183594 nb_pixel_total : 12940 time to create 1 rle with old method : 0.014334440231323242 length of segment : 171 time for calcul the mask position with numpy : 0.0005207061767578125 nb_pixel_total : 11597 time to create 1 rle with old method : 0.013814449310302734 length of segment : 103 time for calcul the mask position with numpy : 0.001209259033203125 nb_pixel_total : 21152 time to create 1 rle with old method : 0.02813863754272461 length of segment : 284 time for calcul the mask position with numpy : 0.005990505218505859 nb_pixel_total : 183006 time to create 1 rle with new method : 0.00803828239440918 length of segment : 479 time for calcul the mask position with numpy : 0.0024957656860351562 nb_pixel_total : 70913 time to create 1 rle with old method : 0.0774533748626709 length of segment : 310 time for calcul the mask position with numpy : 0.0019328594207763672 nb_pixel_total : 54180 time to create 1 rle with old method : 0.06022357940673828 length of segment : 249 time for calcul the mask position with numpy : 0.0020155906677246094 nb_pixel_total : 53288 time to create 1 rle with old method : 0.07088494300842285 length of segment : 351 time for calcul the mask position with numpy : 0.004854679107666016 nb_pixel_total : 113195 time to create 1 rle with old method : 0.12390732765197754 length of segment : 474 time for calcul the mask position with numpy : 0.0012965202331542969 nb_pixel_total : 67737 time to create 1 rle with old method : 0.1025857925415039 length of segment : 183 time for calcul the mask position with numpy : 0.0008356571197509766 nb_pixel_total : 19422 time to create 1 rle with old method : 0.0223538875579834 length of segment : 199 time for calcul the mask position with numpy : 0.0009317398071289062 nb_pixel_total : 22043 time to create 1 rle with old method : 0.025563955307006836 length of segment : 223 time for calcul the mask position with numpy : 0.000885009765625 nb_pixel_total : 20496 time to create 1 rle with old method : 0.022698640823364258 length of segment : 229 time for calcul the mask position with numpy : 0.002249479293823242 nb_pixel_total : 55921 time to create 1 rle with old method : 0.0628657341003418 length of segment : 309 time for calcul the mask position with numpy : 0.0006580352783203125 nb_pixel_total : 14200 time to create 1 rle with old method : 0.016289949417114258 length of segment : 110 time for calcul the mask position with numpy : 0.009626150131225586 nb_pixel_total : 200957 time to create 1 rle with new method : 0.013965129852294922 length of segment : 611 time for calcul the mask position with numpy : 0.0027894973754882812 nb_pixel_total : 67111 time to create 1 rle with old method : 0.0742197036743164 length of segment : 424 time for calcul the mask position with numpy : 0.0034012794494628906 nb_pixel_total : 115887 time to create 1 rle with old method : 0.12497615814208984 length of segment : 352 time for calcul the mask position with numpy : 0.0010020732879638672 nb_pixel_total : 25103 time to create 1 rle with old method : 0.02741241455078125 length of segment : 25length of segment : 147 time for calcul the mask position with numpy : 0.0051727294921875 nb_pixel_total : 163544 time to create 1 rle with new method : 0.009270668029785156 length of segment : 565 time for calcul the mask position with numpy : 0.002191305160522461 nb_pixel_total : 69352 time to create 1 rle with old method : 0.07430481910705566 length of segment : 349 time for calcul the mask position with numpy : 0.002408742904663086 nb_pixel_total : 72543 time to create 1 rle with old method : 0.0805513858795166 length of segment : 342 time for calcul the mask position with numpy : 0.0011417865753173828 nb_pixel_total : 32676 time to create 1 rle with old method : 0.03573441505432129 length of segment : 308 time for calcul the mask position with numpy : 0.0011827945709228516 nb_pixel_total : 33153 time to create 1 rle with old method : 0.03730177879333496 length of segment : 292 time for calcul the mask position with numpy : 0.0005853176116943359 nb_pixel_total : 11914 time to create 1 rle with old method : 0.013245344161987305 length of segment : 134 time for calcul the mask position with numpy : 0.00040435791015625 nb_pixel_total : 10235 time to create 1 rle with old method : 0.011639118194580078 length of segment : 90 time for calcul the mask position with numpy : 0.002061128616333008 nb_pixel_total : 46058 time to create 1 rle with old method : 0.051167964935302734 length of segment : 242 time for calcul the mask position with numpy : 0.02648758888244629 nb_pixel_total : 479300 time to create 1 rle with new method : 0.21986699104309082 length of segment : 1932 time for calcul the mask position with numpy : 0.0015783309936523438 nb_pixel_total : 67919 time to create 1 rle with old method : 0.07423663139343262 length of segment : 261 time for calcul the mask position with numpy : 0.0006256103515625 nb_pixel_total : 18469 time to create 1 rle with old method : 0.021149873733520508 length of segment : 219 time for calcul the mask position with numpy : 0.0007679462432861328 nb_pixel_total : 17027 time to create 1 rle with old method : 0.01929163932800293 length of segment : 192 time for calcul the mask position with numpy : 0.00040841102600097656 nb_pixel_total : 9355 time to create 1 rle with old method : 0.01048421859741211 length of segment : 152 time for calcul the mask position with numpy : 0.0003757476806640625 nb_pixel_total : 7669 time to create 1 rle with old method : 0.008555889129638672 length of segment : 212 time for calcul the mask position with numpy : 0.00048828125 nb_pixel_total : 13041 time to create 1 rle with old method : 0.014670133590698242 length of segment : 143 time for calcul the mask position with numpy : 0.0015032291412353516 nb_pixel_total : 47195 time to create 1 rle with old method : 0.05292916297912598 length of segment : 244 time for calcul the mask position with numpy : 0.0009686946868896484 nb_pixel_total : 31385 time to create 1 rle with old method : 0.03466081619262695 length of segment : 158 time for calcul the mask position with numpy : 0.0009582042694091797 nb_pixel_total : 29815 time to create 1 rle with old method : 0.03297901153564453 length of segment : 173 time for calcul the mask position with numpy : 0.0095977783203125 nb_pixel_total : 181836 time to create 1 rle with new method : 0.014345884323120117 length of segment : 762 time for calcul the mask position with numpy : 0.0006215572357177734 nb_pixel_total : 22580 time to create 1 rle with old method : 0.03699207305908203 length of segment : 170 time for calcul the mask position with numpy : 0.001995563507080078 nb_pixel_total : 40304 time to create 1 rle with old method : 0.0442807674407959 length of segment : 390 time for calcul the mask position with numpy : 0.000431060791015625 nb_pixel_total : 8612 time to create 1 rle with old method : 0.009716272354125977 length of segment : 119 time for calcul the mask position with numpy : 0.002133607864379883 nb_pixel_total : 58409 time to create 1 rle with old method : 0.07095694541931152 length of segment : 312 time for calcul the mask position with numpy : 0.0011529922485351562 nb_pixel_total : 23541 time to create 1 rle with old method : 0.02628922462463379 length of segment : 173 time for calcul the mask position with numpy : 0.0006167888641357422 nb_pixel_total : 12555 time to create 1 rle with old method : 0.01405954360961914 length of segment : 119 time for calcul the mask position with numpy : 0.0012693405151367188 nb_pixel_total : 24505 time to create 1 rle with old method : 0.027231454849243164 length of segment : 243 time for calcul the mask position with numpy : 0.0013515949249267578 nb_pixel_total : 24953 time to create 1 rle with old method : 0.028862953186035156 length of segment : 252 time for calcul the mask position with numpy : 0.0013415813446044922 nb_pixel_total : 44100 time to create 1 rle with old method : 0.04793262481689453 length of segment : 192 time for calcul the mask position with numpy : 0.0023407936096191406 nb_pixel_total : 51554 time to create 1 rle with old method : 0.05627608299255371 length of segment : 373 time for calcul the mask position with numpy : 0.0009007453918457031 nb_pixel_total : 21479 time to create 1 rle with old method : 0.023586511611938477 length of segment : 134 time for calcul the mask position with numpy : 0.0009107589721679688 nb_pixel_total : 16609 time to create 1 rle with old method : 0.018164396286010742 length of segment : 192 time for calcul the mask position with numpy : 0.0006055831909179688 nb_pixel_total : 12165 time to create 1 rle with old method : 0.013093233108520508 length of segment : 131 time for calcul the mask position with numpy : 0.005590200424194336 nb_pixel_total : 159889 time to create 1 rle with new method : 0.00674748420715332 length of segment : 447 time for calcul the mask position with numpy : 0.000415802001953125 nb_pixel_total : 8161 time to create 1 rle with old method : 0.008733749389648438 length of segment : 191 time for calcul the mask position with numpy : 0.0002040863037109375 nb_pixel_total : 9098 time to create 1 rle with old method : 0.009679079055786133 length of segment : 97 time for calcul the mask position with numpy : 0.0004372596740722656 nb_pixel_total : 9927 time to create 1 rle with old method : 0.011084794998168945 length of segment : 103 time for calcul the mask position with numpy : 0.0006852149963378906 nb_pixel_total : 17617 time to create 1 rle with old method : 0.019135236740112305 length of segment : 152 time for calcul the mask position with numpy : 0.004740238189697266 nb_pixel_total : 93909 time to create 1 rle with old method : 0.10056757926940918 length of segment : 497 time for calcul the mask position with numpy : 0.0019292831420898438 nb_pixel_total : 71923 time to create 1 rle with old method : 0.07807278633117676 length of segment : 375 time for calcul the mask position with numpy : 0.011624574661254883 nb_pixel_total : 381573 time to create 1 rle with new method : 0.01908254623413086 length of segment : 1045 time for calcul the mask position with numpy : 0.0015010833740234375 nb_pixel_total : 45969 time to create 1 rle with old method : 0.04894280433654785 length of segment : 456 time for calcul the mask position with numpy : 0.0019223690032958984 nb_pixel_total : 33064 time to create 1 rle with old method : 0.03627467155456543 length of segment : 195 time for calcul the mask position with numpy : 0.002871274948120117 nb_pixel_total : 41861 time to create 1 rle with old method : 0.045296430587768555 length of segment : 533 time for calcul the mask position with numpy : 0.0012574195861816406 nb_pixel_total : 25279 time to create 1 rle with old method : 0.02732992172241211 length of segment : 234 time for calcul the mask position with numpy : 0.0007162094116210938 nb_pixel_total : 16157 time to create 1 rle with old method : 0.017847299575805664 length of segment : 177 time for calcul the mask position with numpy : 0.003575563430786133 nb_pixel_total : 96449 time to create 1 rle with old method : 0.1035928726196289 length of segment : 407 time for calcul the mask position with numpy : 0.002052783966064453 nb_pixel_total : 46323 time to create 1 rle with old method : 0.0512392520904541 length of segment : 213 time for calcul the mask position with numpy : 0.0018796920776367188 nb_pixel_total : 45112 time to create 1 rle with old method : 0.04873061180114746 length of segment : 411 time for calcul the mask position with numpy : 0.002659320831298828 nb_pixel_total : 68339 time to create 1 rle with old method : 0.0734560489654541 length of segment : 250 time for calcul the mask position with numpy : 0.00041556358337402344 nb_pixel_total : 13493 time to create 1 rle with old method : 0.015613794326782227 length of segment : 141 time for calcul the mask position with numpy : 0.0006768703460693359 nb_pixel_total : 10418 time to create 1 rle with old method : 0.011999368667602539 length of segment : 148 time for calcul the mask position with numpy : 0.0022013187408447266 nb_pixel_total : 72678 time to create 1 rle with old method : 0.0816340446472168 length of segment : 267 time for calcul the mask position with numpy : 0.0003628730773925781 nb_pixel_total : 6439 time to create 1 rle with old method : 0.0074291229248046875 length of segment : 92 time for calcul the mask position with numpy : 0.0007457733154296875 nb_pixel_total : 16753 time to create 1 rle with old method : 0.018359899520874023 length of segment : 161 time for calcul the mask position with numpy : 0.0003147125244140625 nb_pixel_total : 7338 time to create 1 rle with old method : 0.008264780044555664 length of segment : 115 time for calcul the mask position with numpy : 0.0028269290924072266 nb_pixel_total : 60973 time to create 1 rle with old method : 0.06524467468261719 length of segment : 311 time for calcul the mask position with numpy : 0.0006253719329833984 nb_pixel_total : 17558 time to create 1 rle with old method : 0.01923370361328125 length of segment : 122 time for calcul the mask position with numpy : 0.00041985511779785156 nb_pixel_total : 12495 time to create 1 rle with old method : 0.013686180114746094 length of segment : 128 time for calcul the mask position with numpy : 0.0011210441589355469 nb_pixel_total : 28724 time to create 1 rle with old method : 0.031151533126831055 length of segment : 183 time for calcul the mask position with numpy : 0.0003616809844970703 nb_pixel_total : 9010 time to create 1 rle with old method : 0.010250568389892578 length of segment : 135 time for calcul the mask position with numpy : 0.0005033016204833984 nb_pixel_total : 11258 time to create 1 rle with old method : 0.012946128845214844 length of segment : 117 time for calcul the mask position with numpy : 0.00121307373046875 nb_pixel_total : 41536 time to create 1 rle with old method : 0.04491162300109863 length of segment : 192 time for calcul the mask position with numpy : 0.002876758575439453 nb_pixel_total : 66013 time to create 1 rle with old method : 0.07356452941894531 length of segment : 353 time for calcul the mask position with numpy : 0.0024139881134033203 nb_pixel_total : 39141 time to create 1 rle with old method : 0.06026411056518555 length of segment : 276 time for calcul the mask position with numpy : 0.000827789306640625 nb_pixel_total : 16537 time to create 1 rle with old method : 0.018632173538208008 length of segment : 159 time spent for convertir_results : 11.91303563117981 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 152 chid ids of type : 3594 Number RLEs to save : 39506 save missing photos in datou_result : time spend for datou_step_exec : 71.06088328361511 time spend to save output : 2.7329301834106445 total time spend for step 1 : 73.79381346702576 step2:crop_condition Tue May 20 19:21:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 152 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 96 About to insert : list_path_to_insert length 96 new photo from crops ! About to upload 96 photos upload in portfolio : 3736932 init cache_photo without model_param we have 96 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747761725_3564198 we have uploaded 96 photos in the portfolio 3736932 time of upload the photos Elapsed time : 21.72956085205078 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3736932 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747761752_3564198 we have uploaded 24 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.688804864883423 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747761766_3564198 we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.347150564193726 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747761774_3564198 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0703980922698975 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747761776_3564198 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5435225963592529 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1359841591, 1359841554, 1359841551, 1359841548, 1359841463, 1359841454, 1359841451, 1359841303, 1359841301] Looping around the photos to save general results len do output : 152 /1359847084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359847250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841591', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841554', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841551', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841548', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841463', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841454', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841451', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841303', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841301', None, None, None, None, None, '2911949') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 465 time used for this insertion : 0.030038118362426758 save_final save missing photos in datou_result : time spend for datou_step_exec : 72.76968812942505 time spend to save output : 0.03510856628417969 total time spend for step 2 : 72.80479669570923 step3:rle_unique_nms_with_priority Tue May 20 19:22:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 152 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 5.6185622215271 time for calcul the mask position with numpy : 0.5910708904266357 nb_pixel_total : 6593315 time to create 1 rle with new method : 1.5003662109375 time for calcul the mask position with numpy : 0.02287578582763672 nb_pixel_total : 40790 time to create 1 rle with old method : 0.04595470428466797 time for calcul the mask position with numpy : 0.02543497085571289 nb_pixel_total : 12882 time to create 1 rle with old method : 0.014270782470703125 time for calcul the mask position with numpy : 0.022186279296875 nb_pixel_total : 22962 time to create 1 rle with old method : 0.025299072265625 time for calcul the mask position with numpy : 0.022794723510742188 nb_pixel_total : 87778 time to create 1 rle with old method : 0.1078639030456543 time for calcul the mask position with numpy : 0.02300429344177246 nb_pixel_total : 55492 time to create 1 rle with old method : 0.061151742935180664 time for calcul the mask position with numpy : 0.021592140197753906 nb_pixel_total : 4426 time to create 1 rle with old method : 0.004983425140380859 time for calcul the mask position with numpy : 0.021820783615112305 nb_pixel_total : 25654 time to create 1 rle with old method : 0.028539419174194336 time for calcul the mask position with numpy : 0.02315545082092285 nb_pixel_total : 26363 time to create 1 rle with old method : 0.04028606414794922 time for calcul the mask position with numpy : 0.024827957153320312 nb_pixel_total : 18047 time to create 1 rle with old method : 0.027403593063354492 time for calcul the mask position with numpy : 0.022472381591796875 nb_pixel_total : 89811 time to create 1 rle with old method : 0.09775257110595703 time for calcul the mask position with numpy : 0.023186683654785156 nb_pixel_total : 7503 time to create 1 rle with old method : 0.00834965705871582 time for calcul the mask position with numpy : 0.02377033233642578 nb_pixel_total : 26649 time to create 1 rle with old method : 0.0294497013092041 time for calcul the mask position with numpy : 0.027745723724365234 nb_pixel_total : 15238 time to create 1 rle with old method : 0.016824007034301758 time for calcul the mask position with numpy : 0.02167797088623047 nb_pixel_total : 7444 time to create 1 rle with old method : 0.008064508438110352 time for calcul the mask position with numpy : 0.02147674560546875 nb_pixel_total : 15886 time to create 1 rle with old method : 0.017269611358642578 create new chi : 3.0053794384002686 time to delete rle : 0.022746562957763672 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 8314 TO DO : save crop sub photo not yet done ! save time : 0.5740456581115723 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 5.274181604385376 time for calcul the mask position with numpy : 0.5219037532806396 nb_pixel_total : 6635036 time to create 1 rle with new method : 0.7501125335693359 time for calcul the mask position with numpy : 0.02289438247680664 nb_pixel_total : 17545 time to create 1 rle with old method : 0.022867202758789062 time for calcul the mask position with numpy : 0.0212860107421875 nb_pixel_total : 12975 time to create 1 rle with old method : 0.014507532119750977 time for calcul the mask position with numpy : 0.022185087203979492 nb_pixel_total : 11897 time to create 1 rle with old method : 0.013041973114013672 time for calcul the mask position with numpy : 0.02533245086669922 nb_pixel_total : 22308 time to create 1 rle with old method : 0.024488449096679688 time for calcul the mask position with numpy : 0.02131199836730957 nb_pixel_total : 28993 time to create 1 rle with old method : 0.0311429500579834 time for calcul the mask position with numpy : 0.020954608917236328 nb_pixel_total : 13878 time to create 1 rle with old method : 0.015066862106323242 time for calcul the mask position with numpy : 0.022064685821533203 nb_pixel_total : 50082 time to create 1 rle with old method : 0.06944751739501953 time for calcul the mask position with numpy : 0.023038864135742188 nb_pixel_total : 24700 time to create 1 rle with old method : 0.03357267379760742 time for calcul the mask position with numpy : 0.03371238708496094 nb_pixel_total : 7394 time to create 1 rle with old method : 0.008259296417236328 time for calcul the mask position with numpy : 0.034493207931518555 nb_pixel_total : 17358 time to create 1 rle with old method : 0.01841902732849121 time for calcul the mask position with numpy : 0.03359413146972656 nb_pixel_total : 10808 time to create 1 rle with old method : 0.011973857879638672 time for calcul the mask position with numpy : 0.03335690498352051 nb_pixel_total : 59690 time to create 1 rle with old method : 0.0678400993347168 time for calcul the mask position with numpy : 0.03570127487182617 nb_pixel_total : 137576 time to create 1 rle with old method : 0.14890646934509277 create new chi : 2.149609088897705 time to delete rle : 0.001064300537109375 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 7664 TO DO : save crop sub photo not yet done ! save time : 0.596766471862793 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 4.78422999382019 time for calcul the mask position with numpy : 0.5203235149383545 nb_pixel_total : 6669131 time to create 1 rle with new method : 1.0059559345245361 time for calcul the mask position with numpy : 0.03624367713928223 nb_pixel_total : 21067 time to create 1 rle with old method : 0.023134469985961914 time for calcul the mask position with numpy : 0.03257274627685547 nb_pixel_total : 24601 time to create 1 rle with old method : 0.02722764015197754 time for calcul the mask position with numpy : 0.02966618537902832 nb_pixel_total : 24836 time to create 1 rle with old method : 0.028781414031982422 time for calcul the mask position with numpy : 0.02211928367614746 nb_pixel_total : 46550 time to create 1 rle with old method : 0.05020332336425781 time for calcul the mask position with numpy : 0.02034473419189453 nb_pixel_total : 16227 time to create 1 rle with old method : 0.017563581466674805 time for calcul the mask position with numpy : 0.021001577377319336 nb_pixel_total : 67233 time to create 1 rle with old method : 0.10045623779296875 time for calcul the mask position with numpy : 0.022978544235229492 nb_pixel_total : 31607 time to create 1 rle with old method : 0.03459954261779785 time for calcul the mask position with numpy : 0.031177043914794922 nb_pixel_total : 74628 time to create 1 rle with old method : 0.07891988754272461 time for calcul the mask position with numpy : 0.03365802764892578 nb_pixel_total : 32883 time to create 1 rle with old method : 0.03602242469787598 time for calcul the mask position with numpy : 0.03391909599304199 nb_pixel_total : 33441 time to create 1 rle with old method : 0.03578782081604004 time for calcul the mask position with numpy : 0.03524160385131836 nb_pixel_total : 8036 time to create 1 rle with old method : 0.013167858123779297 create new chi : 2.3319907188415527 time to delete rle : 0.0016255378723144531 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 7900 TO DO : save crop sub photo not yet done ! save time : 0.5480248928070068 nb_obj : 20 nb_hashtags : 2 time to prepare the origin masks : 7.294728994369507 time for calcul the mask position with numpy : 0.3971424102783203 nb_pixel_total : 5873606 time to create 1 rle with new method : 0.807715892791748 time for calcul the mask position with numpy : 0.020438432693481445 nb_pixel_total : 66913 time to create 1 rle with old method : 0.07079768180847168 time for calcul the mask position with numpy : 0.023162126541137695 nb_pixel_total : 200957 time to create 1 rle with new method : 0.739696741104126 time for calcul the mask position with numpy : 0.019878864288330078 nb_pixel_total : 14200 time to create 1 rle with old method : 0.015708446502685547 time for calcul the mask position with numpy : 0.020203828811645508 nb_pixel_total : 55921 time to create 1 rle with old method : 0.05718421936035156 time for calcul the mask position with numpy : 0.02087569236755371 nb_pixel_total : 20496 time to create 1 rle with old method : 0.021065950393676758 time for calcul the mask position with numpy : 0.019500017166137695 nb_pixel_total : 22043 time to create 1 rle with old method : 0.022840261459350586 time for calcul the mask position with numpy : 0.019699811935424805 nb_pixel_total : 19422 time to create 1 rle with old method : 0.020122766494750977 time for calcul the mask position with numpy : 0.02072882652282715 nb_pixel_total : 67737 time to create 1 rle with old method : 0.06972908973693848 time for calcul the mask position with numpy : 0.020872116088867188 nb_pixel_total : 113195 time to create 1 rle with old method : 0.12029027938842773 time for calcul the mask position with numpy : 0.020303726196289062 nb_pixel_total : 53288 time to create 1 rle with old method : 0.05621647834777832 time for calcul the mask position with numpy : 0.02060723304748535 nb_pixel_total : 54180 time to create 1 rle with old method : 0.05774545669555664 time for calcul the mask position with numpy : 0.021478891372680664 nb_pixel_total : 70913 time to create 1 rle with old method : 0.07569146156311035 time for calcul the mask position with numpy : 0.024662017822265625 nb_pixel_total : 183006 time to create 1 rle with new method : 0.644752025604248 time for calcul the mask position with numpy : 0.020519018173217773 nb_pixel_total : 21152 time to create 1 rle with old method : 0.02233123779296875 time for calcul the mask position with numpy : 0.020175933837890625 nb_pixel_total : 11597 time to create 1 rle with old method : 0.012243270874023438 time for calcul the mask position with numpy : 0.029204607009887695 nb_pixel_total : 12940 time to create 1 rle with old method : 0.013402938842773438 time for calcul the mask position with numpy : 0.03208637237548828 nb_pixel_total : 68717 time to create 1 rle with old method : 0.07148909568786621 time for calcul the mask position with numpy : 0.03263711929321289 nb_pixel_total : 31133 time to create 1 rle with old method : 0.03290152549743652 time for calcul the mask position with numpy : 0.03207039833068848 nb_pixel_total : 34466 time to create 1 rle with old method : 0.036556243896484375 time for calcul the mask position with numpy : 0.03123641014099121 nb_pixel_total : 54358 time to create 1 rle with old method : 0.07438516616821289 create new chi : 3.9865775108337402 time to delete rle : 0.0026340484619140625 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 13608 TO DO : save crop sub photo not yet done ! save time : 0.9331924915313721 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 5.769747972488403 time for calcul the mask position with numpy : 0.4442269802093506 nb_pixel_total : 6274929 time to create 1 rle with new method : 0.7409412860870361 time for calcul the mask position with numpy : 0.03296351432800293 nb_pixel_total : 26907 time to create 1 rle with old method : 0.028753995895385742 time for calcul the mask position with numpy : 0.02031111717224121 nb_pixel_total : 57851 time to create 1 rle with old method : 0.06121540069580078 time for calcul the mask position with numpy : 0.019893169403076172 nb_pixel_total : 20170 time to create 1 rle with old method : 0.021581649780273438 time for calcul the mask position with numpy : 0.01988077163696289 nb_pixel_total : 47329 time to create 1 rle with old method : 0.048302650451660156 time for calcul the mask position with numpy : 0.020419597625732422 nb_pixel_total : 93721 time to create 1 rle with old method : 0.09950447082519531 time for calcul the mask position with numpy : 0.019476890563964844 nb_pixel_total : 6271 time to create 1 rle with old method : 0.006451845169067383 time for calcul the mask position with numpy : 0.020880937576293945 nb_pixel_total : 62096 time to create 1 rle with old method : 0.06319022178649902 time for calcul the mask position with numpy : 0.020351648330688477 nb_pixel_total : 20490 time to create 1 rle with old method : 0.02207803726196289 time for calcul the mask position with numpy : 0.020285844802856445 nb_pixel_total : 56150 time to create 1 rle with old method : 0.06073141098022461 time for calcul the mask position with numpy : 0.020849943161010742 nb_pixel_total : 40845 time to create 1 rle with old method : 0.04299139976501465 time for calcul the mask position with numpy : 0.021236896514892578 nb_pixel_total : 26731 time to create 1 rle with old method : 0.028222322463989258 time for calcul the mask position with numpy : 0.020994186401367188 nb_pixel_total : 42374 time to create 1 rle with old method : 0.048024892807006836 time for calcul the mask position with numpy : 0.021857023239135742 nb_pixel_total : 38494 time to create 1 rle with old method : 0.040441036224365234 time for calcul the mask position with numpy : 0.021509647369384766 nb_pixel_total : 15149 time to create 1 rle with old method : 0.01679682731628418 time for calcul the mask position with numpy : 0.021784305572509766 nb_pixel_total : 41447 time to create 1 rle with old method : 0.044640541076660156 time for calcul the mask position with numpy : 0.02142810821533203 nb_pixel_total : 38296 time to create 1 rle with old method : 0.04150581359863281 time for calcul the mask position with numpy : 0.02209186553955078 nb_pixel_total : 25103 time to create 1 rle with old method : 0.027759313583374023 time for calcul the mask position with numpy : 0.021686077117919922 nb_pixel_total : 115887 time to create 1 rle with old method : 0.12548089027404785 create new chi : 2.4369349479675293 time to delete rle : 0.0016460418701171875 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 12060 TO DO : save crop sub photo not yet done ! save time : 0.8047120571136475 nb_obj : 10 nb_hashtags : 2 time to prepare the origin masks : 3.5175681114196777 time for calcul the mask position with numpy : 0.667762041091919 nb_pixel_total : 6737697 time to create 1 rle with new method : 0.7562792301177979 time for calcul the mask position with numpy : 0.020511150360107422 nb_pixel_total : 17521 time to create 1 rle with old method : 0.020455598831176758 time for calcul the mask position with numpy : 0.020039796829223633 nb_pixel_total : 14807 time to create 1 rle with old method : 0.01594257354736328 time for calcul the mask position with numpy : 0.020035982131958008 nb_pixel_total : 17098 time to create 1 rle with old method : 0.018048763275146484 time for calcul the mask position with numpy : 0.021611452102661133 nb_pixel_total : 22589 time to create 1 rle with old method : 0.024312734603881836 time for calcul the mask position with numpy : 0.02039790153503418 nb_pixel_total : 25282 time to create 1 rle with old method : 0.026465654373168945 time for calcul the mask position with numpy : 0.021268129348754883 nb_pixel_total : 29618 time to create 1 rle with old method : 0.03149127960205078 time for calcul the mask position with numpy : 0.020840167999267578 nb_pixel_total : 25437 time to create 1 rle with old method : 0.026732683181762695 time for calcul the mask position with numpy : 0.021674394607543945 nb_pixel_total : 70364 time to create 1 rle with old method : 0.07626652717590332 time for calcul the mask position with numpy : 0.023394346237182617 nb_pixel_total : 56545 time to create 1 rle with old method : 0.07885408401489258 time for calcul the mask position with numpy : 0.02134394645690918 nb_pixel_total : 33282 time to create 1 rle with old method : 0.03590273857116699 create new chi : 2.026251792907715 time to delete rle : 0.0008423328399658203 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 5884 TO DO : save crop sub photo not yet done ! save time : 0.39087867736816406 nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 6.989496946334839 time for calcul the mask position with numpy : 0.45676589012145996 nb_pixel_total : 5935445 time to create 1 rle with new method : 0.850360631942749 time for calcul the mask position with numpy : 0.025600910186767578 nb_pixel_total : 29815 time to create 1 rle with old method : 0.030394315719604492 time for calcul the mask position with numpy : 0.019789695739746094 nb_pixel_total : 31385 time to create 1 rle with old method : 0.032219648361206055 time for calcul the mask position with numpy : 0.02040863037109375 nb_pixel_total : 1798 time to create 1 rle with old method : 0.00226593017578125 time for calcul the mask position with numpy : 0.020822525024414062 nb_pixel_total : 13041 time to create 1 rle with old method : 0.01389622688293457 time for calcul the mask position with numpy : 0.021607398986816406 nb_pixel_total : 7669 time to create 1 rle with old method : 0.008453607559204102 time for calcul the mask position with numpy : 0.02149176597595215 nb_pixel_total : 9355 time to create 1 rle with old method : 0.010281801223754883 time for calcul the mask position with numpy : 0.021453142166137695 nb_pixel_total : 17027 time to create 1 rle with old method : 0.018579959869384766 time for calcul the mask position with numpy : 0.021265745162963867 nb_pixel_total : 18469 time to create 1 rle with old method : 0.01965785026550293 time for calcul the mask position with numpy : 0.02081775665283203 nb_pixel_total : 67919 time to create 1 rle with old method : 0.07511305809020996 time for calcul the mask position with numpy : 0.024816513061523438 nb_pixel_total : 478842 time to create 1 rle with new method : 0.6186797618865967 time for calcul the mask position with numpy : 0.02299046516418457 nb_pixel_total : 46058 time to create 1 rle with old method : 0.057721614837646484 time for calcul the mask position with numpy : 0.02097940444946289 nb_pixel_total : 10235 time to create 1 rle with old method : 0.010915517807006836 time for calcul the mask position with numpy : 0.020841121673583984 nb_pixel_total : 11914 time to create 1 rle with old method : 0.012689828872680664 time for calcul the mask position with numpy : 0.02195596694946289 nb_pixel_total : 33153 time to create 1 rle with old method : 0.05309915542602539 time for calcul the mask position with numpy : 0.023962736129760742 nb_pixel_total : 32676 time to create 1 rle with old method : 0.03682136535644531 time for calcul the mask position with numpy : 0.02179265022277832 nb_pixel_total : 72543 time to create 1 rle with old method : 0.07620573043823242 time for calcul the mask position with numpy : 0.021036863327026367 nb_pixel_total : 69352 time to create 1 rle with old method : 0.07788848876953125 time for calcul the mask position with numpy : 0.02317643165588379 nb_pixel_total : 163544 time to create 1 rle with new method : 0.4196507930755615 create new chi : 3.358471632003784 time to delete rle : 0.003113269805908203 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 13972 TO DO : save crop sub photo not yet done ! save time : 0.9172825813293457 nb_obj : 24 nb_hashtags : 3 time to prepare the origin masks : 8.52107548713684 time for calcul the mask position with numpy : 0.555065393447876 nb_pixel_total : 5675908 time to create 1 rle with new method : 0.9207391738891602 time for calcul the mask position with numpy : 0.03416037559509277 nb_pixel_total : 33064 time to create 1 rle with old method : 0.035872459411621094 time for calcul the mask position with numpy : 0.03484606742858887 nb_pixel_total : 45969 time to create 1 rle with old method : 0.07385969161987305 time for calcul the mask position with numpy : 0.03870820999145508 nb_pixel_total : 381573 time to create 1 rle with new method : 0.8525524139404297 time for calcul the mask position with numpy : 0.038271188735961914 nb_pixel_total : 71923 time to create 1 rle with old method : 0.07881760597229004 time for calcul the mask position with numpy : 0.03495645523071289 nb_pixel_total : 93909 time to create 1 rle with old method : 0.10361266136169434 time for calcul the mask position with numpy : 0.034012556076049805 nb_pixel_total : 17617 time to create 1 rle with old method : 0.01958465576171875 time for calcul the mask position with numpy : 0.03540825843811035 nb_pixel_total : 9927 time to create 1 rle with old method : 0.011113405227661133 time for calcul the mask position with numpy : 0.034780263900756836 nb_pixel_total : 9098 time to create 1 rle with old method : 0.010181665420532227 time for calcul the mask position with numpy : 0.03455352783203125 nb_pixel_total : 8161 time to create 1 rle with old method : 0.009229898452758789 time for calcul the mask position with numpy : 0.038013458251953125 nb_pixel_total : 159889 time to create 1 rle with new method : 0.634315013885498 time for calcul the mask position with numpy : 0.033770084381103516 nb_pixel_total : 12165 time to create 1 rle with old method : 0.013374567031860352 time for calcul the mask position with numpy : 0.033905982971191406 nb_pixel_total : 16609 time to create 1 rle with old method : 0.018345117568969727 time for calcul the mask position with numpy : 0.034125566482543945 nb_pixel_total : 21479 time to create 1 rle with old method : 0.023712158203125 time for calcul the mask position with numpy : 0.03358602523803711 nb_pixel_total : 51554 time to create 1 rle with old method : 0.05974745750427246 time for calcul the mask position with numpy : 0.03554177284240723 nb_pixel_total : 44100 time to create 1 rle with old method : 0.04841279983520508 time for calcul the mask position with numpy : 0.03400707244873047 nb_pixel_total : 24953 time to create 1 rle with old method : 0.02811884880065918 time for calcul the mask position with numpy : 0.030483007431030273 nb_pixel_total : 24505 time to create 1 rle with old method : 0.02693629264831543 time for calcul the mask position with numpy : 0.021285057067871094 nb_pixel_total : 12555 time to create 1 rle with old method : 0.013837099075317383 time for calcul the mask position with numpy : 0.021744728088378906 nb_pixel_total : 23541 time to create 1 rle with old method : 0.026912212371826172 time for calcul the mask position with numpy : 0.022402048110961914 nb_pixel_total : 58409 time to create 1 rle with old method : 0.06398749351501465 time for calcul the mask position with numpy : 0.0224001407623291 nb_pixel_total : 8612 time to create 1 rle with old method : 0.009556770324707031 time for calcul the mask position with numpy : 0.03383517265319824 nb_pixel_total : 40304 time to create 1 rle with old method : 0.04418778419494629 time for calcul the mask position with numpy : 0.03425288200378418 nb_pixel_total : 22580 time to create 1 rle with old method : 0.025269031524658203 time for calcul the mask position with numpy : 0.041113853454589844 nb_pixel_total : 181836 time to create 1 rle with new method : 0.8483705520629883 create new chi : 5.452040672302246 time to delete rle : 0.0033769607543945312 batch 1 Loaded 49 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++Number RLEs to save : 16400 TO DO : save crop sub photo not yet done ! save time : 1.058297872543335 nb_obj : 23 nb_hashtags : 4 time to prepare the origin masks : 8.251198530197144 time for calcul the mask position with numpy : 0.588853120803833 nb_pixel_total : 6280356 time to create 1 rle with new method : 0.49026942253112793 time for calcul the mask position with numpy : 0.020560264587402344 nb_pixel_total : 16537 time to create 1 rle with old method : 0.01813817024230957 time for calcul the mask position with numpy : 0.020351648330688477 nb_pixel_total : 39141 time to create 1 rle with old method : 0.042435646057128906 time for calcul the mask position with numpy : 0.021588563919067383 nb_pixel_total : 66013 time to create 1 rle with old method : 0.07128095626831055 time for calcul the mask position with numpy : 0.020930051803588867 nb_pixel_total : 41536 time to create 1 rle with old method : 0.04472184181213379 time for calcul the mask position with numpy : 0.021063804626464844 nb_pixel_total : 11258 time to create 1 rle with old method : 0.012376070022583008 time for calcul the mask position with numpy : 0.0213925838470459 nb_pixel_total : 9010 time to create 1 rle with old method : 0.00984954833984375 time for calcul the mask position with numpy : 0.02141594886779785 nb_pixel_total : 28724 time to create 1 rle with old method : 0.03063344955444336 time for calcul the mask position with numpy : 0.02433466911315918 nb_pixel_total : 12495 time to create 1 rle with old method : 0.013381242752075195 time for calcul the mask position with numpy : 0.021288394927978516 nb_pixel_total : 17558 time to create 1 rle with old method : 0.018817663192749023 time for calcul the mask position with numpy : 0.020956993103027344 nb_pixel_total : 60973 time to create 1 rle with old method : 0.06518268585205078 time for calcul the mask position with numpy : 0.021535634994506836 nb_pixel_total : 7338 time to create 1 rle with old method : 0.008286476135253906 time for calcul the mask position with numpy : 0.02433323860168457 nb_pixel_total : 16753 time to create 1 rle with old method : 0.02681446075439453 time for calcul the mask position with numpy : 0.022269725799560547 nb_pixel_total : 6439 time to create 1 rle with old method : 0.010444164276123047 time for calcul the mask position with numpy : 0.02019476890563965 nb_pixel_total : 72678 time to create 1 rle with old method : 0.07992362976074219 time for calcul the mask position with numpy : 0.02282571792602539 nb_pixel_total : 10418 time to create 1 rle with old method : 0.011797904968261719 time for calcul the mask position with numpy : 0.022734403610229492 nb_pixel_total : 13493 time to create 1 rle with old method : 0.015074491500854492 time for calcul the mask position with numpy : 0.030824899673461914 nb_pixel_total : 68339 time to create 1 rle with old method : 0.11631155014038086 time for calcul the mask position with numpy : 0.0595090389251709 nb_pixel_total : 45112 time to create 1 rle with old method : 0.07487916946411133 time for calcul the mask position with numpy : 0.04506802558898926 nb_pixel_total : 46323 time to create 1 rle with old method : 0.07088065147399902 time for calcul the mask position with numpy : 0.04448223114013672 nb_pixel_total : 96449 time to create 1 rle with old method : 0.1460409164428711 time for calcul the mask position with numpy : 0.047644615173339844 nb_pixel_total : 16157 time to create 1 rle with old method : 0.026142597198486328 time for calcul the mask position with numpy : 0.03225517272949219 nb_pixel_total : 25279 time to create 1 rle with old method : 0.03783559799194336 time for calcul the mask position with numpy : 0.026285171508789062 nb_pixel_total : 41861 time to create 1 rle with old method : 0.05189228057861328 create new chi : 2.7549941539764404 time to delete rle : 0.0031843185424804688 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 12410 TO DO : save crop sub photo not yet done ! save time : 0.846583366394043 map_output_result : {1359841591: (0.0, 'Should be the crop_list due to order', 0), 1359841554: (0.0, 'Should be the crop_list due to order', 0), 1359841551: (0.0, 'Should be the crop_list due to order', 0), 1359841548: (0.0, 'Should be the crop_list due to order', 0), 1359841463: (0.0, 'Should be the crop_list due to order', 0), 1359841454: (0.0, 'Should be the crop_list due to order', 0), 1359841451: (0.0, 'Should be the crop_list due to order', 0), 1359841303: (0.0, 'Should be the crop_list due to order', 0), 1359841301: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1359841591, 1359841554, 1359841551, 1359841548, 1359841463, 1359841454, 1359841451, 1359841303, 1359841301] Looping around the photos to save general results len do output : 9 /1359841591.Didn't retrieve data . /1359841554.Didn't retrieve data . /1359841551.Didn't retrieve data . /1359841548.Didn't retrieve data . /1359841463.Didn't retrieve data . /1359841454.Didn't retrieve data . /1359841451.Didn't retrieve data . /1359841303.Didn't retrieve data . /1359841301.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841591', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841554', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841551', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841548', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841463', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841454', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841451', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841303', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841301', None, None, None, None, None, '2911949') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.014249324798583984 save_final save missing photos in datou_result : time spend for datou_step_exec : 91.3199028968811 time spend to save output : 0.014671564102172852 total time spend for step 3 : 91.33457446098328 step4:ventilate_hashtags_in_portfolio Tue May 20 19:24:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23177165 get user id for portfolio 23177165 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23177165 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_clair','autre','mal_croppe','carton','environnement','pehd','background','flou','pet_fonce','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23177165 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_clair','autre','mal_croppe','carton','environnement','pehd','background','flou','pet_fonce','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23177165 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_clair','autre','mal_croppe','carton','environnement','pehd','background','flou','pet_fonce','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23178020,23178021,23178022,23178023,23178024,23178025,23178026,23178027,23178028,23178029,23178030?tags=papier,pet_clair,autre,mal_croppe,carton,environnement,pehd,background,flou,pet_fonce,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1359841591, 1359841554, 1359841551, 1359841548, 1359841463, 1359841454, 1359841451, 1359841303, 1359841301] Looping around the photos to save general results len do output : 1 /23177165. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841591', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841554', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841551', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841548', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841463', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841454', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841451', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841303', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841301', None, None, None, None, None, '2911949') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01610589027404785 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6071033477783203 time spend to save output : 0.01647019386291504 total time spend for step 4 : 1.6235735416412354 step5:final Tue May 20 19:24:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1359841591: ('0.10680072987271037',), 1359841554: ('0.10680072987271037',), 1359841551: ('0.10680072987271037',), 1359841548: ('0.10680072987271037',), 1359841463: ('0.10680072987271037',), 1359841454: ('0.10680072987271037',), 1359841451: ('0.10680072987271037',), 1359841303: ('0.10680072987271037',), 1359841301: ('0.10680072987271037',)} new output for save of step final : {1359841591: ('0.10680072987271037',), 1359841554: ('0.10680072987271037',), 1359841551: ('0.10680072987271037',), 1359841548: ('0.10680072987271037',), 1359841463: ('0.10680072987271037',), 1359841454: ('0.10680072987271037',), 1359841451: ('0.10680072987271037',), 1359841303: ('0.10680072987271037',), 1359841301: ('0.10680072987271037',)} [1359841591, 1359841554, 1359841551, 1359841548, 1359841463, 1359841454, 1359841451, 1359841303, 1359841301] Looping around the photos to save general results len do output : 9 /1359841591.Didn't retrieve data . /1359841554.Didn't retrieve data . /1359841551.Didn't retrieve data . /1359841548.Didn't retrieve data . /1359841463.Didn't retrieve data . /1359841454.Didn't retrieve data . /1359841451.Didn't retrieve data . /1359841303.Didn't retrieve data . /1359841301.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841591', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841554', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841551', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841548', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841463', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841454', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841451', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841303', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841301', None, None, None, None, None, '2911949') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.014647245407104492 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12241792678833008 time spend to save output : 0.015285491943359375 total time spend for step 5 : 0.13770341873168945 step6:blur_detection Tue May 20 19:24:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927.jpg resize: (2160, 3264) 1359841591 -2.9628517581707166 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718.jpg resize: (2160, 3264) 1359841554 -3.633805493855504 treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde.jpg resize: (2160, 3264) 1359841551 -2.149081704523931 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023.jpg resize: (2160, 3264) 1359841548 -2.9525824340266977 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69.jpg resize: (2160, 3264) 1359841463 -0.8253437658676595 treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0.jpg resize: (2160, 3264) 1359841454 -2.2559075316841075 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6.jpg resize: (2160, 3264) 1359841451 0.27129084950191656 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e.jpg resize: (2160, 3264) 1359841303 -1.8971838605966038 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c.jpg resize: (2160, 3264) 1359841301 -2.46657823577026 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510781_0.png resize: (104, 100) 1359847084 -0.22174974136369363 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510782_0.png resize: (128, 206) 1359847085 -2.175984181601605 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510783_0.png resize: (211, 181) 1359847087 -0.6094841103185317 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510784_0.png resize: (131, 106) 1359847088 -1.0214944503649097 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510786_0.png resize: (210, 129) 1359847089 -1.751421180280994 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510788_0.png resize: (140, 281) 1359847090 -1.4523163639243473 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510789_0.png resize: (90, 68) 1359847091 -0.16132737700486433 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510790_0.png resize: (379, 293) 1359847092 -1.044529924103223 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510791_0.png resize: (284, 422) 1359847093 -1.2655514727648627 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510792_0.png resize: (269, 265) 1359847095 -0.9603228039740529 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510793_0.png resize: (167, 120) 1359847096 -0.1419989791000199 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510794_0.png resize: (189, 260) 1359847097 0.014729330576381986 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510795_0.png resize: (353, 610) 1359847098 -2.2814531898757657 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510797_0.png resize: (114, 177) 1359847099 -1.7069132738249237 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510798_0.png resize: (138, 181) 1359847100 -1.7055328578416178 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510799_0.png resize: (138, 72) 1359847101 -0.9608796804953119 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510800_0.png resize: (238, 166) 1359847102 -2.476503138203859 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510801_0.png resize: (300, 309) 1359847103 -0.9591199998191445 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510805_0.png resize: (88, 198) 1359847104 -2.7327703718510783 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510806_0.png resize: (165, 143) 1359847105 -1.7806664757389712 treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510809_0.png resize: (239, 213) 1359847106 -0.41398579744578534 treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510810_0.png resize: (297, 157) 1359847107 -1.4125695492856172 treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510814_0.png resize: (143, 168) 1359847108 -0.9727660987218064 treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510818_0.png resize: (204, 261) 1359847109 -2.0479824063334533 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510819_0.png resize: (243, 304) 1359847110 -2.103949107756026 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510820_0.png resize: (258, 252) 1359847111 -1.9623234250385129 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510821_0.png resize: (123, 379) 1359847112 -2.572633011004798 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510822_0.png resize: (299, 382) 1359847113 -0.8127337625123762 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510823_0.png resize: (171, 133) 1359847114 -2.381444175796798 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510824_0.png resize: (103, 170) 1359847115 -1.223024487943076 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510825_0.png resize: (261, 153) 1359847117 -1.5767307507195307 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510829_0.png resize: (351, 221) 1359847118 -1.3770337058391655 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510830_0.png resize: (406, 482) 1359847119 -2.4821183591167646 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510832_0.png resize: (169, 189) 1359847120 -2.227194965478737 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510833_0.png resize: (140, 259) 1359847121 -1.7520001722570804 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510834_0.png resize: (229, 121) 1359847122 -2.164607382815525 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510837_0.png resize: (439, 665) 1359847123 -1.1538282402001336 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510838_0.png resize: (385, 305) 1359847124 -3.1196655268969806 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510839_0.png resize: (352, 430) 1359847125 -2.787294981312534 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510840_0.png resize: (207, 166) 1359847126 -2.007369011315864 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510841_0.png resize: (284, 270) 1359847127 -1.1598311360275264 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510843_0.png resize: (185, 154) 1359847128 -0.5251374660564118 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510845_0.png resize: (285, 262) 1359847129 -2.065259782577434 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510846_0.png resize: (156, 299) 1359847130 -1.9902014009786924 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510848_0.png resize: (270, 361) 1359847131 0.27808908949206657 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510849_0.png resize: (215, 152) 1359847132 -1.5870605266442448 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510852_0.png resize: (196, 613) 1359847133 -0.9212459761672581 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510855_0.png resize: (385, 305) 1359847134 0.6392490909377379 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510856_0.png resize: (205, 176) 1359847135 -0.6069601938879807 treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510858_0.png resize: (221, 463) 1359847136 -1.7282602272978833 treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510859_0.png resize: (284, 370) 1359847137 -0.7657331821199822 treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510860_0.png resize: (156, 237) 1359847138 -0.35470180339785373 treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510861_0.png resize: (182, 346) 1359847139 -0.5936342533235833 treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510862_0.png resize: (195, 159) 1359847140 -1.3545570097081732 treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510863_0.png resize: (142, 205) 1359847141 -3.068748135750032 treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510864_0.png resize: (138, 172) 1359847142 -0.6493663933842181 treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510865_0.png resize: (113, 185) 1359847143 -1.664314322716985 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510867_0.png resize: (565, 401) 1359847144 -0.763126478501789 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510868_0.png resize: (303, 332) 1359847145 -1.2306392985973167 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510870_0.png resize: (308, 156) 1359847146 -0.29223840096935033 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510872_0.png resize: (134, 127) 1359847147 -1.0090493976214094 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510873_0.png resize: (90, 161) 1359847148 -1.0786576607156915 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510874_0.png resize: (231, 349) 1359847149 -0.4698010471178873 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510875_0.png resize: (1413, 655) 1359847150 -1.7014062361092621 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510876_0.png resize: (245, 343) 1359847151 0.21029737735285856 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510877_0.png resize: (207, 185) 1359847153 -1.0842800948067672 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510879_0.png resize: (152, 79) 1359847154 -0.1059633269354878 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510880_0.png resize: (165, 68) 1359847155 -0.9767688836205088 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510881_0.png resize: (143, 163) 1359847156 -1.4049017542836604 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510883_0.png resize: (158, 262) 1359847157 -0.13910794038383836 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510886_0.png resize: (153, 224) 1359847158 -1.5078695451771893 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510887_0.png resize: (390, 195) 1359847159 -1.763502113575702 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510888_0.png resize: (119, 95) 1359847160 -0.8355600802822267 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510890_0.png resize: (173, 207) 1359847161 -0.5050484478437853 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510892_0.png resize: (239, 178) 1359847162 -1.0777018541254189 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510893_0.png resize: (207, 262) 1359847163 -2.2847986300997403 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510897_0.png resize: (188, 145) 1359847164 -0.2212420762180423 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510898_0.png resize: (128, 141) 1359847165 -0.5410107706425623 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510899_0.png resize: (403, 635) 1359847166 -1.650930395264148 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510900_0.png resize: (111, 96) 1359847167 -2.0008472954182923 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510903_0.png resize: (152, 163) 1359847168 -0.6824164356494745 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510904_0.png resize: (372, 574) 1359847169 -0.8947199494953144 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510906_0.png resize: (1009, 483) 1359847170 -0.6016555845606537 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510907_0.png resize: (265, 261) 1359847171 -2.5590747454993066 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510908_0.png resize: (181, 342) 1359847172 -1.3612776896325838 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510909_0.png resize: (533, 212) 1359847173 -1.101090020945886 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510910_0.png resize: (234, 161) 1359847174 -2.270288899952361 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510911_0.png resize: (168, 138) 1359847175 -0.9026786790917194 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510912_0.png resize: (403, 365) 1359847176 -0.5616922540706749 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510914_0.png resize: (404, 178) 1359847177 -1.6477299997967934 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510917_0.png resize: (140, 135) 1359847178 -1.0091418476149745 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510919_0.png resize: (91, 95) 1359847179 -1.1431512502633723 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510920_0.png resize: (160, 159) 1359847180 -0.7856708821110716 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510921_0.png resize: (115, 85) 1359847182 -0.8067467251340144 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510925_0.png resize: (178, 258) 1359847183 -1.3298073380457145 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510927_0.png resize: (117, 137) 1359847184 -0.5817073351837482 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510780_0.png resize: (161, 161) 1359847188 -1.2823363804708992 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510787_0.png resize: (188, 212) 1359847189 -0.8200536800748955 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510802_0.png resize: (142, 166) 1359847190 -2.179481570710614 treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510808_0.png resize: (79, 136) 1359847191 -0.5890783645796563 treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510812_0.png resize: (211, 299) 1359847192 -0.7963812889826143 treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510815_0.png resize: (311, 229) 1359847193 -0.5853697940131982 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510844_0.png resize: (165, 292) 1359847194 -1.6350791810019691 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510850_0.png resize: (276, 349) 1359847195 -1.7405589666442158 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510851_0.png resize: (146, 63) 1359847196 -1.0553194215546173 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510884_0.png resize: (172, 228) 1359847197 0.08172726420998552 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510885_0.png resize: (562, 775) 1359847198 -1.4284799176388463 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510891_0.png resize: (116, 138) 1359847199 -0.6350741766128547 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510894_0.png resize: (190, 279) 1359847200 -1.9049585715598893 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510895_0.png resize: (319, 224) 1359847201 -1.051017920199611 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510896_0.png resize: (134, 227) 1359847202 -0.5561172610067889 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510901_0.png resize: (97, 117) 1359847203 -0.029551837639076844 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510902_0.png resize: (103, 147) 1359847204 -1.416046058288351 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510905_0.png resize: (329, 322) 1359847205 -1.725767463225609 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510916_0.png resize: (141, 155) 1359847206 -0.9649645725908462 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510922_0.png resize: (298, 355) 1359847207 -1.0189467921424762 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510923_0.png resize: (118, 220) 1359847208 -1.0617774260962753 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510926_0.png resize: (135, 87) 1359847209 -0.253182636551808 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510928_0.png resize: (192, 250) 1359847210 -1.1833889581972739 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510931_0.png resize: (146, 184) 1359847211 -1.4531977909835545 treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510785_0.png resize: (329, 384) 1359847216 -4.78461056281821 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510796_0.png resize: (408, 194) 1359847217 -1.833199967605751 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510804_0.png resize: (173, 195) 1359847218 -4.303502404227666 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510807_0.png resize: (126, 185) 1359847219 -1.4948567438204199 treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510811_0.png resize: (285, 319) 1359847220 -0.9411105447099987 treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510816_0.png resize: (115, 306) 1359847221 -0.7340171504194042 treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510817_0.png resize: (292, 186) 1359847222 -1.3335148156043697 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510826_0.png resize: (448, 533) 1359847223 -1.3726543203878685 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510827_0.png resize: (306, 350) 1359847224 -3.099393300900259 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510828_0.png resize: (226, 302) 1359847225 -1.8707292433001352 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510831_0.png resize: (170, 507) 1359847226 -2.8878388279511396 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510835_0.png resize: (308, 257) 1359847227 -2.819594754476452 treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510836_0.png resize: (110, 172) 1359847228 -1.5715854740576036 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510842_0.png resize: (159, 444) 1359847229 -2.556583576937422 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510847_0.png resize: (324, 191) 1359847230 -0.06743871136874541 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510853_0.png resize: (248, 254) 1359847231 -1.9231269135797537 treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510854_0.png resize: (108, 222) 1359847232 -0.24125127993176426 treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510857_0.png resize: (152, 310) 1359847233 -1.6861500112697614 treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510866_0.png resize: (145, 190) 1359847234 -0.9048424879471976 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510869_0.png resize: (316, 317) 1359847235 -2.927767937481905 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510878_0.png resize: (182, 140) 1359847236 -2.8782018333637023 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510882_0.png resize: (229, 362) 1359847237 -0.5462918975981517 treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510889_0.png resize: (311, 244) 1359847238 -2.1895440255421024 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510913_0.png resize: (206, 306) 1359847239 -1.336755146381673 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510915_0.png resize: (196, 459) 1359847240 -1.360556609313953 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510918_0.png resize: (263, 343) 1359847241 -1.71414526930199 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510929_0.png resize: (300, 374) 1359847242 -1.9068554088796046 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510930_0.png resize: (210, 318) 1359847243 -3.257086345737832 treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510813_0.png resize: (479, 178) 1359847246 -1.1340877026543688 treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510871_0.png resize: (241, 186) 1359847247 -1.1499153245886709 treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510924_0.png resize: (125, 139) 1359847248 -0.08350823892778377 treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510803_0.png resize: (135, 318) 1359847250 -3.522958042653711 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 161 time used for this insertion : 0.021370887756347656 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 161 time used for this insertion : 0.03290581703186035 save missing photos in datou_result : time spend for datou_step_exec : 32.86978578567505 time spend to save output : 0.05985403060913086 total time spend for step 6 : 32.92963981628418 step7:brightness Tue May 20 19:25:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927.jpg treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718.jpg treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde.jpg treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023.jpg treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69.jpg treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0.jpg treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6.jpg treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e.jpg treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c.jpg treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510781_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510782_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510783_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510784_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510786_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510788_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510789_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510790_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510791_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510792_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510793_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510794_0.png treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510795_0.png treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510797_0.png treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510798_0.png treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510799_0.png treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510800_0.png treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510801_0.png treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510805_0.png treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510806_0.png treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510809_0.png treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510810_0.png treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510814_0.png treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510818_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510819_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510820_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510821_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510822_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510823_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510824_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510825_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510829_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510830_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510832_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510833_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510834_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510837_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510838_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510839_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510840_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510841_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510843_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510845_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510846_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510848_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510849_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510852_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510855_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510856_0.png treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510858_0.png treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510859_0.png treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510860_0.png treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510861_0.png treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510862_0.png treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510863_0.png treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510864_0.png treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510865_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510867_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510868_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510870_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510872_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510873_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510874_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510875_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510876_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510877_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510879_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510880_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510881_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510883_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510886_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510887_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510888_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510890_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510892_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510893_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510897_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510898_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510899_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510900_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510903_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510904_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510906_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510907_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510908_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510909_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510910_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510911_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510912_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510914_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510917_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510919_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510920_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510921_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510925_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510927_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510780_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510787_0.png treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510802_0.png treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510808_0.png treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510812_0.png treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510815_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510844_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510850_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510851_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510884_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510885_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510891_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510894_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510895_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510896_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510901_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510902_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510905_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510916_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510922_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510923_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510926_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510928_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510931_0.png treat image : temp/1747761629_3564198_1359841591_65b87c0e4d7f0cda7c067fc0ff9b5927_rle_crop_3806510785_0.png treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510796_0.png treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510804_0.png treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510807_0.png treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510811_0.png treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510816_0.png treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510817_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510826_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510827_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510828_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510831_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510835_0.png treat image : temp/1747761629_3564198_1359841548_100ac2731276156a840995d651b45023_rle_crop_3806510836_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510842_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510847_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510853_0.png treat image : temp/1747761629_3564198_1359841463_1a1c39f2cbdb3604dc8b3c9fd016cd69_rle_crop_3806510854_0.png treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510857_0.png treat image : temp/1747761629_3564198_1359841454_ead25326bc6564e128c300360ab502c0_rle_crop_3806510866_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510869_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510878_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510882_0.png treat image : temp/1747761629_3564198_1359841303_760f3288bbad94c00afb3447d813381e_rle_crop_3806510889_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510913_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510915_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510918_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510929_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510930_0.png treat image : temp/1747761629_3564198_1359841551_4559ff7d55d48d93f8f65ee4456ffdde_rle_crop_3806510813_0.png treat image : temp/1747761629_3564198_1359841451_01d30a5a390c2f464a8a3076844ddae6_rle_crop_3806510871_0.png treat image : temp/1747761629_3564198_1359841301_e3d153a6717e0980e078578a546acb9c_rle_crop_3806510924_0.png treat image : temp/1747761629_3564198_1359841554_4542421d09ab192731a000cc31343718_rle_crop_3806510803_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 161 time used for this insertion : 0.019429683685302734 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 161 time used for this insertion : 0.031664371490478516 save missing photos in datou_result : time spend for datou_step_exec : 9.201451778411865 time spend to save output : 0.05607867240905762 total time spend for step 7 : 9.257530450820923 step8:velours_tree Tue May 20 19:25:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.17624855041503906 time spend to save output : 0.00019049644470214844 total time spend for step 8 : 0.1764390468597412 step9:send_mail_cod Tue May 20 19:25:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23177165_20-05-2025_19_25_12.pdf 23178020 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231780201747761912 23178021 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231780211747761913 23178022 change filename to text .change filename to text .change filename to text .imagette231780221747761915 23178023 imagette231780231747761915 23178024 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231780241747761915 23178026 imagette231780261747761916 23178027 imagette231780271747761916 23178028 imagette231780281747761916 23178029 change filename to text .imagette231780291747761916 23178030 imagette231780301747761916 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23177165 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23178020,23178021,23178022,23178023,23178024,23178025,23178026,23178027,23178028,23178029,23178030?tags=papier,pet_clair,autre,mal_croppe,carton,environnement,pehd,background,flou,pet_fonce,metal args[1359841591] : ((1359841591, -2.9628517581707166, 492609224), (1359841591, 0.29182901107285064, 2107752395), '0.10680072987271037') We are sending mail with results at report@fotonower.com args[1359841554] : ((1359841554, -3.633805493855504, 492609224), (1359841554, 0.279181866066643, 2107752395), '0.10680072987271037') We are sending mail with results at report@fotonower.com args[1359841551] : ((1359841551, -2.149081704523931, 492609224), (1359841551, 0.1823492625805821, 2107752395), '0.10680072987271037') We are sending mail with results at report@fotonower.com args[1359841548] : ((1359841548, -2.9525824340266977, 492609224), (1359841548, 0.1355002474579631, 2107752395), '0.10680072987271037') We are sending mail with results at report@fotonower.com args[1359841463] : ((1359841463, -0.8253437658676595, 492688767), (1359841463, 0.17061774135650848, 2107752395), '0.10680072987271037') We are sending mail with results at report@fotonower.com args[1359841454] : ((1359841454, -2.2559075316841075, 492609224), (1359841454, 0.22521146678787668, 2107752395), '0.10680072987271037') We are sending mail with results at report@fotonower.com args[1359841451] : ((1359841451, 0.27129084950191656, 492688767), (1359841451, 0.23342241620323118, 2107752395), '0.10680072987271037') We are sending mail with results at report@fotonower.com args[1359841303] : ((1359841303, -1.8971838605966038, 492688767), (1359841303, 0.14810168183810402, 2107752395), '0.10680072987271037') We are sending mail with results at report@fotonower.com args[1359841301] : ((1359841301, -2.46657823577026, 492609224), (1359841301, 0.27561376361726114, 2107752395), '0.10680072987271037') We are sending mail with results at report@fotonower.com refus_total : 0.10680072987271037 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23177165 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177165_20-05-2025_19_25_12.pdf results_Auto_P23177165_20-05-2025_19_25_12.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177165_20-05-2025_19_25_12.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23177165','results_Auto_P23177165_20-05-2025_19_25_12.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177165_20-05-2025_19_25_12.pdf','pdf','','0.63','0.10680072987271037') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23177165

https://www.fotonower.com/image?json=false&list_photos_id=1359841591
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359841554
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359841551
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359841548
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359841463
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359841454
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359841451
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359841303
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359841301
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.68%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/23178020?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23178021?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23178022?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23178024?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23178029?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177165_20-05-2025_19_25_12.pdf.

Lien vers velours :https://www.fotonower.com/velours/23178020,23178021,23178022,23178023,23178024,23178025,23178026,23178027,23178028,23178029,23178030?tags=papier,pet_clair,autre,mal_croppe,carton,environnement,pehd,background,flou,pet_fonce,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 20 May 2025 17:25:23 GMT Content-Length: 0 Connection: close X-Message-Id: SEZ7N-MCSXqeuXR7nU_M0g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1359841591, 1359841554, 1359841551, 1359841548, 1359841463, 1359841454, 1359841451, 1359841303, 1359841301] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841591', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841554', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841551', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841548', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841463', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841454', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841451', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841303', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841301', None, None, None, None, None, '2911949') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.017966747283935547 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.783152103424072 time spend to save output : 0.018215417861938477 total time spend for step 9 : 10.80136752128601 step10:split_time_score Tue May 20 19:25:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20052025 23177165 Nombre de photos uploadées : 9 / 23040 (0%) 20052025 23177165 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 20052025 23177165 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.00052642822265625 elapsed_time : insert_dashboard_record_day_entry 0.023282766342163086 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.0462500658941438 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23159907_20-05-2025_09_13_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23159907 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23159907 AND mptpi.`type`=3726 To do Qualite : 0.12732645980846047 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23167061_20-05-2025_13_36_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23167061 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23167061 AND mptpi.`type`=3594 To do Qualite : 0.11592767054738566 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23172605_20-05-2025_16_44_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23172605 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23172605 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23175553 order by id desc limit 1 Qualite : 0.14202566153776322 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23175554_20-05-2025_18_16_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23175554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23175554 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23175556 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177157 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177158 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177162 order by id desc limit 1 Qualite : 0.10680072987271037 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177165_20-05-2025_19_25_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177165 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23177165 AND mptpi.`type`=3594 To do Qualite : 0.10174944399055919 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177171_20-05-2025_19_15_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177171 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23177171 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20052025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1359841591, 1359841554, 1359841551, 1359841548, 1359841463, 1359841454, 1359841451, 1359841303, 1359841301] Looping around the photos to save general results len do output : 1 /23177165Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841591', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841554', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841551', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841548', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841463', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841454', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841451', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841303', None, None, None, None, None, '2911949') ('3318', None, None, None, None, None, None, None, '2911949') ('3318', '23177165', '1359841301', None, None, None, None, None, '2911949') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01345968246459961 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.090637445449829 time spend to save output : 0.013724327087402344 total time spend for step 10 : 5.1043617725372314 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 126.44user 120.74system 5:03.16elapsed 81%CPU (0avgtext+0avgdata 5683060maxresident)k 589064inputs+80240outputs (7651major+13805398minor)pagefaults 0swaps