python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2226781 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2722703'] with mtr_portfolio_ids : ['22047458'] and first list_photo_ids : [] new path : /proc/2226781/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.1543467044830322 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Apr 4 03:50:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10151 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-04 03:50:34.521745: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-04 03:50:34.547114: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-04 03:50:34.549286: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ff70c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-04 03:50:34.549340: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-04 03:50:34.553454: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-04 03:50:34.812992: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2e71c2f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-04 03:50:34.813121: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-04 03:50:34.815454: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-04 03:50:34.816382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-04 03:50:34.821695: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-04 03:50:34.826208: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-04 03:50:34.826823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-04 03:50:34.829699: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-04 03:50:34.831388: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-04 03:50:34.837487: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-04 03:50:34.839135: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-04 03:50:34.839224: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-04 03:50:34.840024: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-04 03:50:34.840040: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-04 03:50:34.840049: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-04 03:50:34.841882: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9256 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-04 03:50:35.235786: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-04 03:50:35.235918: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-04 03:50:35.235938: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-04 03:50:35.235956: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-04 03:50:35.235972: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-04 03:50:35.235989: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-04 03:50:35.236004: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-04 03:50:35.236021: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-04 03:50:35.237229: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-04 03:50:35.238524: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-04 03:50:35.238560: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-04 03:50:35.238576: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-04 03:50:35.238590: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-04 03:50:35.238604: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-04 03:50:35.238618: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-04 03:50:35.238632: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-04 03:50:35.238646: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-04 03:50:35.239881: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-04 03:50:35.239926: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-04 03:50:35.239935: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-04 03:50:35.239943: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-04 03:50:35.241187: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9256 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-04 03:50:46.394182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-04 03:50:46.556815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 64 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 62 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 Detection mask done ! Trying to reset tf kernel 2227365 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3694 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8983 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0021638870239257812 nb_pixel_total : 45678 time to create 1 rle with old method : 0.06452345848083496 length of segment : 403 time for calcul the mask position with numpy : 0.002488374710083008 nb_pixel_total : 93881 time to create 1 rle with old method : 0.1232144832611084 length of segment : 411 time for calcul the mask position with numpy : 0.002015829086303711 nb_pixel_total : 72821 time to create 1 rle with old method : 0.09718894958496094 length of segment : 357 time for calcul the mask position with numpy : 0.0004284381866455078 nb_pixel_total : 17883 time to create 1 rle with old method : 0.030530929565429688 length of segment : 138 time for calcul the mask position with numpy : 0.0008196830749511719 nb_pixel_total : 30258 time to create 1 rle with old method : 0.0420231819152832 length of segment : 197 time for calcul the mask position with numpy : 0.00044226646423339844 nb_pixel_total : 23254 time to create 1 rle with old method : 0.028346538543701172 length of segment : 212 time for calcul the mask position with numpy : 0.000354766845703125 nb_pixel_total : 14424 time to create 1 rle with old method : 0.017373323440551758 length of segment : 155 time for calcul the mask position with numpy : 0.0060672760009765625 nb_pixel_total : 242061 time to create 1 rle with new method : 0.016721248626708984 length of segment : 731 time for calcul the mask position with numpy : 0.0020296573638916016 nb_pixel_total : 96590 time to create 1 rle with old method : 0.11522173881530762 length of segment : 394 time for calcul the mask position with numpy : 0.0008118152618408203 nb_pixel_total : 39998 time to create 1 rle with old method : 0.05051112174987793 length of segment : 362 time for calcul the mask position with numpy : 0.0006668567657470703 nb_pixel_total : 34656 time to create 1 rle with old method : 0.04169464111328125 length of segment : 358 time for calcul the mask position with numpy : 0.002133607864379883 nb_pixel_total : 112135 time to create 1 rle with old method : 0.13303399085998535 length of segment : 305 time for calcul the mask position with numpy : 0.003834962844848633 nb_pixel_total : 170071 time to create 1 rle with new method : 0.014931678771972656 length of segment : 674 time for calcul the mask position with numpy : 0.002734661102294922 nb_pixel_total : 109789 time to create 1 rle with old method : 0.13671135902404785 length of segment : 481 time for calcul the mask position with numpy : 0.0017299652099609375 nb_pixel_total : 82592 time to create 1 rle with old method : 0.09885954856872559 length of segment : 407 time for calcul the mask position with numpy : 0.0019533634185791016 nb_pixel_total : 91300 time to create 1 rle with old method : 0.10674476623535156 length of segment : 473 time for calcul the mask position with numpy : 0.0013625621795654297 nb_pixel_total : 74436 time to create 1 rle with old method : 0.0908365249633789 length of segment : 249 time for calcul the mask position with numpy : 0.0006158351898193359 nb_pixel_total : 25702 time to create 1 rle with old method : 0.03119039535522461 length of segment : 221 time for calcul the mask position with numpy : 0.0033559799194335938 nb_pixel_total : 114634 time to create 1 rle with old method : 0.1399986743927002 length of segment : 401 time for calcul the mask position with numpy : 0.0006356239318847656 nb_pixel_total : 31057 time to create 1 rle with old method : 0.03883075714111328 length of segment : 271 time for calcul the mask position with numpy : 0.0007760524749755859 nb_pixel_total : 40714 time to create 1 rle with old method : 0.06193900108337402 length of segment : 342 time for calcul the mask position with numpy : 0.0016994476318359375 nb_pixel_total : 39923 time to create 1 rle with old method : 0.055892229080200195 length of segment : 440 time for calcul the mask position with numpy : 0.007661581039428711 nb_pixel_total : 139918 time to create 1 rle with old method : 0.18732404708862305 length of segment : 455 time for calcul the mask position with numpy : 0.002850055694580078 nb_pixel_total : 91914 time to create 1 rle with old method : 0.10885429382324219 length of segment : 234 time for calcul the mask position with numpy : 0.005408525466918945 nb_pixel_total : 107714 time to create 1 rle with old method : 0.13780689239501953 length of segment : 503 time for calcul the mask position with numpy : 0.0031135082244873047 nb_pixel_total : 60228 time to create 1 rle with old method : 0.06998085975646973 length of segment : 437 time for calcul the mask position with numpy : 0.0047299861907958984 nb_pixel_total : 119050 time to create 1 rle with old method : 0.1555318832397461 length of segment : 643 time for calcul the mask position with numpy : 0.005936145782470703 nb_pixel_total : 108138 time to create 1 rle with old method : 0.1259291172027588 length of segment : 739 time for calcul the mask position with numpy : 0.014292716979980469 nb_pixel_total : 128795 time to create 1 rle with old method : 0.17452716827392578 length of segment : 912 time for calcul the mask position with numpy : 0.0011870861053466797 nb_pixel_total : 33478 time to create 1 rle with old method : 0.0402834415435791 length of segment : 220 time for calcul the mask position with numpy : 0.0007374286651611328 nb_pixel_total : 18637 time to create 1 rle with old method : 0.02305769920349121 length of segment : 96 time for calcul the mask position with numpy : 0.0011250972747802734 nb_pixel_total : 29446 time to create 1 rle with old method : 0.035067081451416016 length of segment : 357 time for calcul the mask position with numpy : 0.002539396286010742 nb_pixel_total : 56556 time to create 1 rle with old method : 0.06624889373779297 length of segment : 341 time for calcul the mask position with numpy : 0.002033233642578125 nb_pixel_total : 94365 time to create 1 rle with old method : 0.11421465873718262 length of segment : 417 time for calcul the mask position with numpy : 0.0036394596099853516 nb_pixel_total : 104583 time to create 1 rle with old method : 0.12639069557189941 length of segment : 456 time for calcul the mask position with numpy : 0.0007233619689941406 nb_pixel_total : 12245 time to create 1 rle with old method : 0.014884710311889648 length of segment : 136 time for calcul the mask position with numpy : 0.0014634132385253906 nb_pixel_total : 42419 time to create 1 rle with old method : 0.050812721252441406 length of segment : 266 time for calcul the mask position with numpy : 0.002860546112060547 nb_pixel_total : 67067 time to create 1 rle with old method : 0.0796811580657959 length of segment : 437 time for calcul the mask position with numpy : 0.004407167434692383 nb_pixel_total : 96185 time to create 1 rle with old method : 0.1166527271270752 length of segment : 438 time for calcul the mask position with numpy : 0.0011615753173828125 nb_pixel_total : 19504 time to create 1 rle with old method : 0.023798227310180664 length of segment : 203 time for calcul the mask position with numpy : 0.0005249977111816406 nb_pixel_total : 16182 time to create 1 rle with old method : 0.019772052764892578 length of segment : 168 time for calcul the mask position with numpy : 0.005017280578613281 nb_pixel_total : 92766 time to create 1 rle with old method : 0.1107785701751709 length of segment : 920 time for calcul the mask position with numpy : 0.0022270679473876953 nb_pixel_total : 66778 time to create 1 rle with old method : 0.08149242401123047 length of segment : 324 time for calcul the mask position with numpy : 0.00477147102355957 nb_pixel_total : 132721 time to create 1 rle with old method : 0.15821003913879395 length of segment : 529 time for calcul the mask position with numpy : 0.0013823509216308594 nb_pixel_total : 36798 time to create 1 rle with old method : 0.044055938720703125 length of segment : 213 time for calcul the mask position with numpy : 0.0013186931610107422 nb_pixel_total : 34538 time to create 1 rle with old method : 0.04242372512817383 length of segment : 153 time for calcul the mask position with numpy : 0.0021483898162841797 nb_pixel_total : 44328 time to create 1 rle with old method : 0.0527338981628418 length of segment : 400 time for calcul the mask position with numpy : 0.0015463829040527344 nb_pixel_total : 48781 time to create 1 rle with old method : 0.05907559394836426 length of segment : 208 time for calcul the mask position with numpy : 0.005997657775878906 nb_pixel_total : 168172 time to create 1 rle with new method : 0.013816356658935547 length of segment : 585 time for calcul the mask position with numpy : 0.0018916130065917969 nb_pixel_total : 58637 time to create 1 rle with old method : 0.06913948059082031 length of segment : 338 time for calcul the mask position with numpy : 0.00048160552978515625 nb_pixel_total : 25835 time to create 1 rle with old method : 0.031653642654418945 length of segment : 152 time for calcul the mask position with numpy : 0.00042057037353515625 nb_pixel_total : 14094 time to create 1 rle with old method : 0.017046451568603516 length of segment : 167 time for calcul the mask position with numpy : 0.0004107952117919922 nb_pixel_total : 17340 time to create 1 rle with old method : 0.020858287811279297 length of segment : 222 time for calcul the mask position with numpy : 0.003996849060058594 nb_pixel_total : 159244 time to create 1 rle with new method : 0.0076656341552734375 length of segment : 502 time for calcul the mask position with numpy : 0.0003113746643066406 nb_pixel_total : 10186 time to create 1 rle with old method : 0.012465238571166992 length of segment : 126 time for calcul the mask position with numpy : 0.0006680488586425781 nb_pixel_total : 20083 time to create 1 rle with old method : 0.024277687072753906 length of segment : 147 time for calcul the mask position with numpy : 0.0013935565948486328 nb_pixel_total : 17078 time to create 1 rle with old method : 0.020461082458496094 length of segment : 239 time for calcul the mask position with numpy : 0.004174947738647461 nb_pixel_total : 93616 time to create 1 rle with old method : 0.11214876174926758 length of segment : 440 time for calcul the mask position with numpy : 0.002986431121826172 nb_pixel_total : 78459 time to create 1 rle with old method : 0.09409642219543457 length of segment : 327 time for calcul the mask position with numpy : 0.0019440650939941406 nb_pixel_total : 42372 time to create 1 rle with old method : 0.050930023193359375 length of segment : 219 time for calcul the mask position with numpy : 0.002344846725463867 nb_pixel_total : 49369 time to create 1 rle with old method : 0.05877995491027832 length of segment : 295 time for calcul the mask position with numpy : 0.008373737335205078 nb_pixel_total : 190825 time to create 1 rle with new method : 0.010024070739746094 length of segment : 604 time for calcul the mask position with numpy : 0.00478672981262207 nb_pixel_total : 92145 time to create 1 rle with old method : 0.1075441837310791 length of segment : 448 time for calcul the mask position with numpy : 0.0031108856201171875 nb_pixel_total : 69836 time to create 1 rle with old method : 0.08335661888122559 length of segment : 452 time for calcul the mask position with numpy : 0.0035817623138427734 nb_pixel_total : 72165 time to create 1 rle with old method : 0.08910322189331055 length of segment : 377 time for calcul the mask position with numpy : 0.00717473030090332 nb_pixel_total : 131621 time to create 1 rle with old method : 0.15441036224365234 length of segment : 553 time for calcul the mask position with numpy : 0.003459930419921875 nb_pixel_total : 85112 time to create 1 rle with old method : 0.09975671768188477 length of segment : 429 time for calcul the mask position with numpy : 0.0055561065673828125 nb_pixel_total : 116851 time to create 1 rle with old method : 0.139052152633667 length of segment : 534 time for calcul the mask position with numpy : 0.009722232818603516 nb_pixel_total : 167855 time to create 1 rle with new method : 0.009466886520385742 length of segment : 571 time for calcul the mask position with numpy : 0.001964092254638672 nb_pixel_total : 34258 time to create 1 rle with old method : 0.041733503341674805 length of segment : 250 time for calcul the mask position with numpy : 0.001149892807006836 nb_pixel_total : 24283 time to create 1 rle with old method : 0.030674219131469727 length of segment : 189 time for calcul the mask position with numpy : 0.0006160736083984375 nb_pixel_total : 8950 time to create 1 rle with old method : 0.010995626449584961 length of segment : 201 time for calcul the mask position with numpy : 0.001965761184692383 nb_pixel_total : 42333 time to create 1 rle with old method : 0.05069565773010254 length of segment : 383 time for calcul the mask position with numpy : 0.001627206802368164 nb_pixel_total : 27872 time to create 1 rle with old method : 0.04432511329650879 length of segment : 249 time for calcul the mask position with numpy : 0.002941608428955078 nb_pixel_total : 69920 time to create 1 rle with old method : 0.08970880508422852 length of segment : 314 time for calcul the mask position with numpy : 0.002337932586669922 nb_pixel_total : 80089 time to create 1 rle with old method : 0.09544754028320312 length of segment : 402 time for calcul the mask position with numpy : 0.002882719039916992 nb_pixel_total : 57812 time to create 1 rle with old method : 0.06953954696655273 length of segment : 265 time for calcul the mask position with numpy : 0.0015330314636230469 nb_pixel_total : 18498 time to create 1 rle with old method : 0.02249932289123535 length of segment : 206 time for calcul the mask position with numpy : 0.0006356239318847656 nb_pixel_total : 15511 time to create 1 rle with old method : 0.018701791763305664 length of segment : 225 time for calcul the mask position with numpy : 0.0016884803771972656 nb_pixel_total : 35538 time to create 1 rle with old method : 0.043703556060791016 length of segment : 194 time for calcul the mask position with numpy : 0.0018606185913085938 nb_pixel_total : 40085 time to create 1 rle with old method : 0.04779505729675293 length of segment : 236 time for calcul the mask position with numpy : 0.002002716064453125 nb_pixel_total : 58365 time to create 1 rle with old method : 0.07026481628417969 length of segment : 299 time for calcul the mask position with numpy : 0.0015611648559570312 nb_pixel_total : 22127 time to create 1 rle with old method : 0.027045011520385742 length of segment : 183 time for calcul the mask position with numpy : 0.001298666000366211 nb_pixel_total : 26761 time to create 1 rle with old method : 0.032801151275634766 length of segment : 199 time for calcul the mask position with numpy : 0.0009071826934814453 nb_pixel_total : 14150 time to create 1 rle with old method : 0.01840829849243164 length of segment : 197 time for calcul the mask position with numpy : 0.0008752346038818359 nb_pixel_total : 28608 time to create 1 rle with old method : 0.034226417541503906 length of segment : 230 time for calcul the mask position with numpy : 0.0001766681671142578 nb_pixel_total : 3293 time to create 1 rle with old method : 0.004084348678588867 length of segment : 69 time for calcul the mask position with numpy : 0.00042700767517089844 nb_pixel_total : 10138 time to create 1 rle with old method : 0.012604951858520508 length of segment : 88 time for calcul the mask position with numpy : 0.003765106201171875 nb_pixel_total : 70661 time to create 1 rle with old method : 0.0841059684753418 length of segment : 321 time for calcul the mask position with numpy : 0.00044345855712890625 nb_pixel_total : 7664 time to create 1 rle with old method : 0.00952768325805664 length of segment : 116 time for calcul the mask position with numpy : 0.0018763542175292969 nb_pixel_total : 68032 time to create 1 rle with old method : 0.08088946342468262 length of segment : 319 time for calcul the mask position with numpy : 0.0010809898376464844 nb_pixel_total : 17047 time to create 1 rle with old method : 0.021028757095336914 length of segment : 169 time for calcul the mask position with numpy : 0.004174947738647461 nb_pixel_total : 99892 time to create 1 rle with old method : 0.12028217315673828 length of segment : 323 time for calcul the mask position with numpy : 0.0029888153076171875 nb_pixel_total : 70614 time to create 1 rle with old method : 0.0848548412322998 length of segment : 258 time for calcul the mask position with numpy : 0.004828929901123047 nb_pixel_total : 90841 time to create 1 rle with old method : 0.10998868942260742 length of segment : 467 time for calcul the mask position with numpy : 0.0007276535034179688 nb_pixel_total : 14170 time to create 1 rle with old method : 0.01730203628540039 length of segment : 140 time for calcul the mask position with numpy : 0.00275421142578125 nb_pixel_total : 72303 time to create 1 rle with old method : 0.08748745918273926 length of segment : 199 time for calcul the mask position with numpy : 0.0019028186798095703 nb_pixel_total : 73301 time to create 1 rle with old method : 0.08882284164428711 length of segment : 382 time for calcul the mask position with numpy : 0.0020990371704101562 nb_pixel_total : 55441 time to create 1 rle with old method : 0.06841516494750977 length of segment : 254 time for calcul the mask position with numpy : 0.0013949871063232422 nb_pixel_total : 26340 time to create 1 rle with old method : 0.032848358154296875 length of segment : 242 time for calcul the mask position with numpy : 0.001188516616821289 nb_pixel_total : 38962 time to create 1 rle with old method : 0.04882001876831055 length of segment : 453 time for calcul the mask position with numpy : 0.0007498264312744141 nb_pixel_total : 17629 time to create 1 rle with old method : 0.02173757553100586 length of segment : 265 time for calcul the mask position with numpy : 0.00057220458984375 nb_pixel_total : 11787 time to create 1 rle with old method : 0.015041589736938477 length of segment : 291 time for calcul the mask position with numpy : 0.00036025047302246094 nb_pixel_total : 12866 time to create 1 rle with old method : 0.017423391342163086 length of segment : 163 time for calcul the mask position with numpy : 0.0014801025390625 nb_pixel_total : 42189 time to create 1 rle with old method : 0.05068087577819824 length of segment : 345 time for calcul the mask position with numpy : 0.00046062469482421875 nb_pixel_total : 15080 time to create 1 rle with old method : 0.018514633178710938 length of segment : 138 time for calcul the mask position with numpy : 0.0002086162567138672 nb_pixel_total : 6892 time to create 1 rle with old method : 0.008685588836669922 length of segment : 86 time for calcul the mask position with numpy : 0.0011835098266601562 nb_pixel_total : 42501 time to create 1 rle with old method : 0.051569461822509766 length of segment : 237 time for calcul the mask position with numpy : 0.0011119842529296875 nb_pixel_total : 28432 time to create 1 rle with old method : 0.03462052345275879 length of segment : 349 time for calcul the mask position with numpy : 0.0010743141174316406 nb_pixel_total : 25403 time to create 1 rle with old method : 0.030494213104248047 length of segment : 170 time for calcul the mask position with numpy : 0.004360675811767578 nb_pixel_total : 86581 time to create 1 rle with old method : 0.1033785343170166 length of segment : 554 time for calcul the mask position with numpy : 0.0017616748809814453 nb_pixel_total : 54240 time to create 1 rle with old method : 0.06429815292358398 length of segment : 241 time for calcul the mask position with numpy : 0.00283050537109375 nb_pixel_total : 67423 time to create 1 rle with old method : 0.08067154884338379 length of segment : 261 time for calcul the mask position with numpy : 0.001998424530029297 nb_pixel_total : 42373 time to create 1 rle with old method : 0.05026817321777344 length of segment : 299 time for calcul the mask position with numpy : 0.0012028217315673828 nb_pixel_total : 32894 time to create 1 rle with old method : 0.03902769088745117 length of segment : 326 time for calcul the mask position with numpy : 0.002287626266479492 nb_pixel_total : 52162 time to create 1 rle with old method : 0.06580209732055664 length of segment : 233 time for calcul the mask position with numpy : 0.016010284423828125 nb_pixel_total : 443705 time to create 1 rle with new method : 0.10925626754760742 length of segment : 1152 time for calcul the mask position with numpy : 0.001035928726196289 nb_pixel_total : 27113 time to create 1 rle with old method : 0.034049272537231445 length of segment : 212 time for calcul the mask position with numpy : 0.0011758804321289062 nb_pixel_total : 26437 time to create 1 rle with old method : 0.03248286247253418 length of segment : 213 time for calcul the mask position with numpy : 0.0023241043090820312 nb_pixel_total : 51379 time to create 1 rle with old method : 0.061040401458740234 length of segment : 233 time for calcul the mask position with numpy : 0.0014736652374267578 nb_pixel_total : 29545 time to create 1 rle with old method : 0.03628683090209961 length of segment : 192 time for calcul the mask position with numpy : 0.0009529590606689453 nb_pixel_total : 20489 time to create 1 rle with old method : 0.024883270263671875 length of segment : 177 time for calcul the mask position with numpy : 0.0030202865600585938 nb_pixel_total : 109708 time to create 1 rle with old method : 0.1335599422454834 length of segment : 393 time for calcul the mask position with numpy : 0.0008165836334228516 nb_pixel_total : 15974 time to create 1 rle with old method : 0.019155025482177734 length of segment : 250 time for calcul the mask position with numpy : 0.003703594207763672 nb_pixel_total : 83165 time to create 1 rle with old method : 0.12071084976196289 length of segment : 501 time for calcul the mask position with numpy : 0.0011713504791259766 nb_pixel_total : 46910 time to create 1 rle with old method : 0.0553741455078125 length of segment : 334 time for calcul the mask position with numpy : 0.003941535949707031 nb_pixel_total : 82194 time to create 1 rle with old method : 0.10748505592346191 length of segment : 280 time for calcul the mask position with numpy : 0.0014941692352294922 nb_pixel_total : 41313 time to create 1 rle with old method : 0.050049781799316406 length of segment : 163 time for calcul the mask position with numpy : 0.004109621047973633 nb_pixel_total : 111508 time to create 1 rle with old method : 0.13204193115234375 length of segment : 399 time for calcul the mask position with numpy : 0.0007090568542480469 nb_pixel_total : 25019 time to create 1 rle with old method : 0.030140161514282227 length of segment : 230 time for calcul the mask position with numpy : 0.0013501644134521484 nb_pixel_total : 24269 time to create 1 rle with old method : 0.029886960983276367 length of segment : 273 time for calcul the mask position with numpy : 0.0005278587341308594 nb_pixel_total : 15899 time to create 1 rle with old method : 0.01986551284790039 length of segment : 125 time for calcul the mask position with numpy : 0.0007135868072509766 nb_pixel_total : 21919 time to create 1 rle with old method : 0.031203746795654297 length of segment : 237 time for calcul the mask position with numpy : 0.0018129348754882812 nb_pixel_total : 56955 time to create 1 rle with old method : 0.06961488723754883 length of segment : 216 time for calcul the mask position with numpy : 0.0007531642913818359 nb_pixel_total : 23014 time to create 1 rle with old method : 0.02808356285095215 length of segment : 278 time for calcul the mask position with numpy : 0.0056803226470947266 nb_pixel_total : 95676 time to create 1 rle with old method : 0.1126248836517334 length of segment : 975 time for calcul the mask position with numpy : 0.0018351078033447266 nb_pixel_total : 81987 time to create 1 rle with old method : 0.09631681442260742 length of segment : 268 time for calcul the mask position with numpy : 0.004727363586425781 nb_pixel_total : 141519 time to create 1 rle with old method : 0.16829419136047363 length of segment : 436 time for calcul the mask position with numpy : 0.0018825531005859375 nb_pixel_total : 57512 time to create 1 rle with old method : 0.06860542297363281 length of segment : 266 time for calcul the mask position with numpy : 0.0013566017150878906 nb_pixel_total : 26859 time to create 1 rle with old method : 0.03253793716430664 length of segment : 232 time for calcul the mask position with numpy : 0.00177001953125 nb_pixel_total : 22477 time to create 1 rle with old method : 0.02744436264038086 length of segment : 212 time for calcul the mask position with numpy : 0.0007092952728271484 nb_pixel_total : 13199 time to create 1 rle with old method : 0.01623249053955078 length of segment : 142 time for calcul the mask position with numpy : 0.0022728443145751953 nb_pixel_total : 44446 time to create 1 rle with old method : 0.05372762680053711 length of segment : 286 time for calcul the mask position with numpy : 0.0016803741455078125 nb_pixel_total : 33619 time to create 1 rle with old method : 0.03929734230041504 length of segment : 225 time for calcul the mask position with numpy : 0.0002269744873046875 nb_pixel_total : 3286 time to create 1 rle with old method : 0.004027128219604492 length of segment : 70 time for calcul the mask position with numpy : 0.0021331310272216797 nb_pixel_total : 65519 time to create 1 rle with old method : 0.07645082473754883 length of segment : 333 time for calcul the mask position with numpy : 0.00037288665771484375 nb_pixel_total : 8479 time to create 1 rle with old method : 0.010163545608520508 length of segment : 85 time for calcul the mask position with numpy : 0.0018205642700195312 nb_pixel_total : 38693 time to create 1 rle with old method : 0.04455304145812988 length of segment : 306 time for calcul the mask position with numpy : 0.0016181468963623047 nb_pixel_total : 33708 time to create 1 rle with old method : 0.03943634033203125 length of segment : 206 time for calcul the mask position with numpy : 0.004414558410644531 nb_pixel_total : 71023 time to create 1 rle with old method : 0.08494257926940918 length of segment : 340 time for calcul the mask position with numpy : 0.00130462646484375 nb_pixel_total : 33264 time to create 1 rle with old method : 0.03942251205444336 length of segment : 232 time for calcul the mask position with numpy : 0.0006372928619384766 nb_pixel_total : 13851 time to create 1 rle with old method : 0.01667046546936035 length of segment : 152 time for calcul the mask position with numpy : 0.0028429031372070312 nb_pixel_total : 99949 time to create 1 rle with old method : 0.11905312538146973 length of segment : 291 time for calcul the mask position with numpy : 0.00013756752014160156 nb_pixel_total : 2894 time to create 1 rle with old method : 0.003790140151977539 length of segment : 46 time for calcul the mask position with numpy : 0.0018460750579833984 nb_pixel_total : 58382 time to create 1 rle with old method : 0.0816500186920166 length of segment : 451 time for calcul the mask position with numpy : 0.00048613548278808594 nb_pixel_total : 7531 time to create 1 rle with old method : 0.009225606918334961 length of segment : 96 time for calcul the mask position with numpy : 0.00109100341796875 nb_pixel_total : 19572 time to create 1 rle with old method : 0.023931264877319336 length of segment : 238 time for calcul the mask position with numpy : 0.00704193115234375 nb_pixel_total : 175132 time to create 1 rle with new method : 0.01097416877746582 length of segment : 443 time for calcul the mask position with numpy : 0.0003666877746582031 nb_pixel_total : 6049 time to create 1 rle with old method : 0.007341623306274414 length of segment : 148 time for calcul the mask position with numpy : 0.017411231994628906 nb_pixel_total : 531422 time to create 1 rle with new method : 0.022170305252075195 length of segment : 688 time for calcul the mask position with numpy : 0.0007140636444091797 nb_pixel_total : 20812 time to create 1 rle with old method : 0.03362274169921875 length of segment : 189 time for calcul the mask position with numpy : 0.003055572509765625 nb_pixel_total : 61220 time to create 1 rle with old method : 0.07734394073486328 length of segment : 328 time for calcul the mask position with numpy : 0.0006706714630126953 nb_pixel_total : 14924 time to create 1 rle with old method : 0.018513917922973633 length of segment : 125 time for calcul the mask position with numpy : 0.0008218288421630859 nb_pixel_total : 39173 time to create 1 rle with old method : 0.04670453071594238 length of segment : 264 time for calcul the mask position with numpy : 0.0009763240814208984 nb_pixel_total : 19859 time to create 1 rle with old method : 0.026240110397338867 length of segment : 213 time for calcul the mask position with numpy : 0.0030601024627685547 nb_pixel_total : 114602 time to create 1 rle with old method : 0.1358928680419922 length of segment : 588 time for calcul the mask position with numpy : 0.004046916961669922 nb_pixel_total : 156647 time to create 1 rle with new method : 0.00839090347290039 length of segment : 714 time for calcul the mask position with numpy : 0.0009365081787109375 nb_pixel_total : 29257 time to create 1 rle with old method : 0.03540158271789551 length of segment : 192 time for calcul the mask position with numpy : 0.00041794776916503906 nb_pixel_total : 9838 time to create 1 rle with old method : 0.012131452560424805 length of segment : 107 time for calcul the mask position with numpy : 0.0013651847839355469 nb_pixel_total : 53563 time to create 1 rle with old method : 0.06347274780273438 length of segment : 474 time for calcul the mask position with numpy : 0.0009794235229492188 nb_pixel_total : 29023 time to create 1 rle with old method : 0.034488677978515625 length of segment : 173 time for calcul the mask position with numpy : 0.0012362003326416016 nb_pixel_total : 57218 time to create 1 rle with old method : 0.06848716735839844 length of segment : 324 time for calcul the mask position with numpy : 0.0003552436828613281 nb_pixel_total : 6488 time to create 1 rle with old method : 0.008118391036987305 length of segment : 99 time for calcul the mask position with numpy : 0.002141714096069336 nb_pixel_total : 73212 time to create 1 rle with old method : 0.08858871459960938 length of segment : 570 time for calcul the mask position with numpy : 0.0012907981872558594 nb_pixel_total : 54482 time to create 1 rle with old method : 0.06543111801147461 length of segment : 335 time for calcul the mask position with numpy : 0.0011260509490966797 nb_pixel_total : 68454 time to create 1 rle with old method : 0.08161163330078125 length of segment : 479 time for calcul the mask position with numpy : 0.00030303001403808594 nb_pixel_total : 7941 time to create 1 rle with old method : 0.009864330291748047 length of segment : 111 time spent for convertir_results : 19.46578860282898 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 177 chid ids of type : 3594 Number RLEs to save : 56204 save missing photos in datou_result : time spend for datou_step_exec : 86.28181910514832 time spend to save output : 4.620337963104248 total time spend for step 1 : 90.90215706825256 step2:crop_condition Fri Apr 4 03:52:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 177 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 124 About to insert : list_path_to_insert length 124 new photo from crops ! About to upload 124 photos upload in portfolio : 3736932 init cache_photo without model_param we have 124 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743731555_2226781 we have uploaded 124 photos in the portfolio 3736932 time of upload the photos Elapsed time : 43.741076946258545 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743731603_2226781 we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.440103530883789 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743731616_2226781 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8776431083679199 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 31 About to insert : list_path_to_insert length 31 new photo from crops ! About to upload 31 photos upload in portfolio : 3736932 init cache_photo without model_param we have 31 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743731630_2226781 we have uploaded 31 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.474263668060303 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743731645_2226781 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2243428230285645 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1743731648_2226781 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0927784442901611 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1349921824, 1349921807, 1349921803, 1349921760, 1349921754, 1349921741, 1349921684, 1349921681] Looping around the photos to save general results len do output : 177 /1349962097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1349962315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921824', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921807', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921803', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921760', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921754', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921741', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921684', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921681', None, None, None, None, None, '2722703') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 539 time used for this insertion : 0.2625412940979004 save_final save missing photos in datou_result : time spend for datou_step_exec : 126.96022057533264 time spend to save output : 0.2687344551086426 total time spend for step 2 : 127.22895503044128 step3:rle_unique_nms_with_priority Fri Apr 4 03:54:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 177 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 5.411768436431885 time for calcul the mask position with numpy : 0.776862621307373 nb_pixel_total : 6340322 time to create 1 rle with new method : 0.8409390449523926 time for calcul the mask position with numpy : 0.022869110107421875 nb_pixel_total : 34656 time to create 1 rle with old method : 0.04107165336608887 time for calcul the mask position with numpy : 0.03023076057434082 nb_pixel_total : 39998 time to create 1 rle with old method : 0.047214508056640625 time for calcul the mask position with numpy : 0.040139198303222656 nb_pixel_total : 95004 time to create 1 rle with old method : 0.11519551277160645 time for calcul the mask position with numpy : 0.04379773139953613 nb_pixel_total : 242061 time to create 1 rle with new method : 0.9221115112304688 time for calcul the mask position with numpy : 0.03659701347351074 nb_pixel_total : 14424 time to create 1 rle with old method : 0.016950130462646484 time for calcul the mask position with numpy : 0.035613059997558594 nb_pixel_total : 23254 time to create 1 rle with old method : 0.029729127883911133 time for calcul the mask position with numpy : 0.031250953674316406 nb_pixel_total : 30258 time to create 1 rle with old method : 0.03589653968811035 time for calcul the mask position with numpy : 0.022036075592041016 nb_pixel_total : 17883 time to create 1 rle with old method : 0.0218350887298584 time for calcul the mask position with numpy : 0.023865222930908203 nb_pixel_total : 72821 time to create 1 rle with old method : 0.09046626091003418 time for calcul the mask position with numpy : 0.02179718017578125 nb_pixel_total : 93881 time to create 1 rle with old method : 0.10947799682617188 time for calcul the mask position with numpy : 0.021488189697265625 nb_pixel_total : 45678 time to create 1 rle with old method : 0.05323386192321777 create new chi : 3.5006420612335205 time to delete rle : 0.018938541412353516 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 9511 TO DO : save crop sub photo not yet done ! save time : 1.0140817165374756 nb_obj : 25 nb_hashtags : 3 time to prepare the origin masks : 9.300357818603516 time for calcul the mask position with numpy : 0.5040380954742432 nb_pixel_total : 5117632 time to create 1 rle with new method : 0.8619956970214844 time for calcul the mask position with numpy : 0.03966116905212402 nb_pixel_total : 12224 time to create 1 rle with old method : 0.014426946640014648 time for calcul the mask position with numpy : 0.03706216812133789 nb_pixel_total : 97613 time to create 1 rle with old method : 0.11153316497802734 time for calcul the mask position with numpy : 0.02910757064819336 nb_pixel_total : 91488 time to create 1 rle with old method : 0.10641312599182129 time for calcul the mask position with numpy : 0.03367328643798828 nb_pixel_total : 56556 time to create 1 rle with old method : 0.06543231010437012 time for calcul the mask position with numpy : 0.030951499938964844 nb_pixel_total : 29446 time to create 1 rle with old method : 0.03452920913696289 time for calcul the mask position with numpy : 0.023520231246948242 nb_pixel_total : 18637 time to create 1 rle with old method : 0.021835803985595703 time for calcul the mask position with numpy : 0.023128747940063477 nb_pixel_total : 33478 time to create 1 rle with old method : 0.04048776626586914 time for calcul the mask position with numpy : 0.02210235595703125 nb_pixel_total : 74069 time to create 1 rle with old method : 0.08739089965820312 time for calcul the mask position with numpy : 0.022791624069213867 nb_pixel_total : 108138 time to create 1 rle with old method : 0.12474703788757324 time for calcul the mask position with numpy : 0.024127960205078125 nb_pixel_total : 119049 time to create 1 rle with old method : 0.15099883079528809 time for calcul the mask position with numpy : 0.02312755584716797 nb_pixel_total : 60228 time to create 1 rle with old method : 0.06909990310668945 time for calcul the mask position with numpy : 0.021329879760742188 nb_pixel_total : 107714 time to create 1 rle with old method : 0.12189221382141113 time for calcul the mask position with numpy : 0.02299952507019043 nb_pixel_total : 91914 time to create 1 rle with old method : 0.10501670837402344 time for calcul the mask position with numpy : 0.02282428741455078 nb_pixel_total : 139918 time to create 1 rle with old method : 0.1572885513305664 time for calcul the mask position with numpy : 0.021675825119018555 nb_pixel_total : 39923 time to create 1 rle with old method : 0.04873538017272949 time for calcul the mask position with numpy : 0.034171342849731445 nb_pixel_total : 40563 time to create 1 rle with old method : 0.04552793502807617 time for calcul the mask position with numpy : 0.03444504737854004 nb_pixel_total : 31057 time to create 1 rle with old method : 0.03455615043640137 time for calcul the mask position with numpy : 0.03430533409118652 nb_pixel_total : 114634 time to create 1 rle with old method : 0.13036561012268066 time for calcul the mask position with numpy : 0.03424334526062012 nb_pixel_total : 25636 time to create 1 rle with old method : 0.028470754623413086 time for calcul the mask position with numpy : 0.03407430648803711 nb_pixel_total : 74436 time to create 1 rle with old method : 0.0835721492767334 time for calcul the mask position with numpy : 0.03422355651855469 nb_pixel_total : 91300 time to create 1 rle with old method : 0.09941434860229492 time for calcul the mask position with numpy : 0.02967357635498047 nb_pixel_total : 82592 time to create 1 rle with old method : 0.09726810455322266 time for calcul the mask position with numpy : 0.03197598457336426 nb_pixel_total : 109789 time to create 1 rle with old method : 0.12692809104919434 time for calcul the mask position with numpy : 0.021584272384643555 nb_pixel_total : 170071 time to create 1 rle with new method : 0.5302164554595947 time for calcul the mask position with numpy : 0.02276611328125 nb_pixel_total : 112135 time to create 1 rle with old method : 0.14761567115783691 create new chi : 4.724172592163086 time to delete rle : 0.003654003143310547 batch 1 Loaded 51 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 21996 TO DO : save crop sub photo not yet done ! save time : 1.9275546073913574 nb_obj : 20 nb_hashtags : 4 time to prepare the origin masks : 7.2875683307647705 time for calcul the mask position with numpy : 0.45844411849975586 nb_pixel_total : 5921583 time to create 1 rle with new method : 1.168036699295044 time for calcul the mask position with numpy : 0.04247093200683594 nb_pixel_total : 20083 time to create 1 rle with old method : 0.02787160873413086 time for calcul the mask position with numpy : 0.03957986831665039 nb_pixel_total : 10186 time to create 1 rle with old method : 0.01195526123046875 time for calcul the mask position with numpy : 0.03851628303527832 nb_pixel_total : 159244 time to create 1 rle with new method : 0.9822087287902832 time for calcul the mask position with numpy : 0.03533148765563965 nb_pixel_total : 17340 time to create 1 rle with old method : 0.020031213760375977 time for calcul the mask position with numpy : 0.03368520736694336 nb_pixel_total : 14094 time to create 1 rle with old method : 0.01643061637878418 time for calcul the mask position with numpy : 0.0364382266998291 nb_pixel_total : 3931 time to create 1 rle with old method : 0.0048177242279052734 time for calcul the mask position with numpy : 0.03692960739135742 nb_pixel_total : 58637 time to create 1 rle with old method : 0.06898736953735352 time for calcul the mask position with numpy : 0.03523731231689453 nb_pixel_total : 168172 time to create 1 rle with new method : 0.961754560470581 time for calcul the mask position with numpy : 0.03420901298522949 nb_pixel_total : 48781 time to create 1 rle with old method : 0.05894207954406738 time for calcul the mask position with numpy : 0.03956723213195801 nb_pixel_total : 44328 time to create 1 rle with old method : 0.060779571533203125 time for calcul the mask position with numpy : 0.034476518630981445 nb_pixel_total : 34538 time to create 1 rle with old method : 0.039127349853515625 time for calcul the mask position with numpy : 0.033057451248168945 nb_pixel_total : 36798 time to create 1 rle with old method : 0.04073810577392578 time for calcul the mask position with numpy : 0.03405261039733887 nb_pixel_total : 132721 time to create 1 rle with old method : 0.14949488639831543 time for calcul the mask position with numpy : 0.0353546142578125 nb_pixel_total : 66778 time to create 1 rle with old method : 0.10198426246643066 time for calcul the mask position with numpy : 0.03556632995605469 nb_pixel_total : 71669 time to create 1 rle with old method : 0.08286142349243164 time for calcul the mask position with numpy : 0.03364205360412598 nb_pixel_total : 16182 time to create 1 rle with old method : 0.018465042114257812 time for calcul the mask position with numpy : 0.0335536003112793 nb_pixel_total : 19504 time to create 1 rle with old method : 0.022945880889892578 time for calcul the mask position with numpy : 0.03294181823730469 nb_pixel_total : 96185 time to create 1 rle with old method : 0.10999274253845215 time for calcul the mask position with numpy : 0.03346991539001465 nb_pixel_total : 67067 time to create 1 rle with old method : 0.07677412033081055 time for calcul the mask position with numpy : 0.03280520439147949 nb_pixel_total : 42419 time to create 1 rle with old method : 0.04824233055114746 create new chi : 5.332201957702637 time to delete rle : 0.003238677978515625 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 14386 TO DO : save crop sub photo not yet done ! save time : 1.056168794631958 nb_obj : 44 nb_hashtags : 3 time to prepare the origin masks : 4.983909606933594 time for calcul the mask position with numpy : 0.5423521995544434 nb_pixel_total : 4629857 time to create 1 rle with new method : 0.7196762561798096 time for calcul the mask position with numpy : 0.028804540634155273 nb_pixel_total : 24283 time to create 1 rle with old method : 0.02800607681274414 time for calcul the mask position with numpy : 0.028525829315185547 nb_pixel_total : 72303 time to create 1 rle with old method : 0.08150053024291992 time for calcul the mask position with numpy : 0.027980804443359375 nb_pixel_total : 70661 time to create 1 rle with old method : 0.07956743240356445 time for calcul the mask position with numpy : 0.029469966888427734 nb_pixel_total : 68032 time to create 1 rle with old method : 0.0779259204864502 time for calcul the mask position with numpy : 0.028362512588500977 nb_pixel_total : 85112 time to create 1 rle with old method : 0.10006856918334961 time for calcul the mask position with numpy : 0.029387712478637695 nb_pixel_total : 14150 time to create 1 rle with old method : 0.016496896743774414 time for calcul the mask position with numpy : 0.029761314392089844 nb_pixel_total : 90841 time to create 1 rle with old method : 0.10435056686401367 time for calcul the mask position with numpy : 0.029036998748779297 nb_pixel_total : 7664 time to create 1 rle with old method : 0.009049654006958008 time for calcul the mask position with numpy : 0.029317617416381836 nb_pixel_total : 57812 time to create 1 rle with old method : 0.06822919845581055 time for calcul the mask position with numpy : 0.03372764587402344 nb_pixel_total : 92145 time to create 1 rle with old method : 0.12100410461425781 time for calcul the mask position with numpy : 0.029094457626342773 nb_pixel_total : 26340 time to create 1 rle with old method : 0.03128647804260254 time for calcul the mask position with numpy : 0.030252456665039062 nb_pixel_total : 69920 time to create 1 rle with old method : 0.08216547966003418 time for calcul the mask position with numpy : 0.02875065803527832 nb_pixel_total : 14170 time to create 1 rle with old method : 0.01660919189453125 time for calcul the mask position with numpy : 0.0283048152923584 nb_pixel_total : 42333 time to create 1 rle with old method : 0.051116228103637695 time for calcul the mask position with numpy : 0.028769254684448242 nb_pixel_total : 17047 time to create 1 rle with old method : 0.02007579803466797 time for calcul the mask position with numpy : 0.028420448303222656 nb_pixel_total : 35538 time to create 1 rle with old method : 0.04116249084472656 time for calcul the mask position with numpy : 0.02810215950012207 nb_pixel_total : 40085 time to create 1 rle with old method : 0.04591178894042969 time for calcul the mask position with numpy : 0.03328561782836914 nb_pixel_total : 131621 time to create 1 rle with old method : 0.1664588451385498 time for calcul the mask position with numpy : 0.03055095672607422 nb_pixel_total : 99892 time to create 1 rle with old method : 0.11301469802856445 time for calcul the mask position with numpy : 0.028213977813720703 nb_pixel_total : 27872 time to create 1 rle with old method : 0.03181195259094238 time for calcul the mask position with numpy : 0.029084444046020508 nb_pixel_total : 58365 time to create 1 rle with old method : 0.06693673133850098 time for calcul the mask position with numpy : 0.028248071670532227 nb_pixel_total : 26761 time to create 1 rle with old method : 0.03036189079284668 time for calcul the mask position with numpy : 0.027698040008544922 nb_pixel_total : 55441 time to create 1 rle with old method : 0.06356406211853027 time for calcul the mask position with numpy : 0.028998851776123047 nb_pixel_total : 78371 time to create 1 rle with old method : 0.08916544914245605 time for calcul the mask position with numpy : 0.02910900115966797 nb_pixel_total : 22127 time to create 1 rle with old method : 0.025798559188842773 time for calcul the mask position with numpy : 0.033271074295043945 nb_pixel_total : 167855 time to create 1 rle with new method : 0.542034387588501 time for calcul the mask position with numpy : 0.02872610092163086 nb_pixel_total : 93616 time to create 1 rle with old method : 0.10631775856018066 time for calcul the mask position with numpy : 0.02860713005065918 nb_pixel_total : 79877 time to create 1 rle with old method : 0.09536218643188477 time for calcul the mask position with numpy : 0.029314756393432617 nb_pixel_total : 69836 time to create 1 rle with old method : 0.08021211624145508 time for calcul the mask position with numpy : 0.028978347778320312 nb_pixel_total : 190825 time to create 1 rle with new method : 0.48871922492980957 time for calcul the mask position with numpy : 0.03269195556640625 nb_pixel_total : 42372 time to create 1 rle with old method : 0.048493146896362305 time for calcul the mask position with numpy : 0.028491497039794922 nb_pixel_total : 72165 time to create 1 rle with old method : 0.08304929733276367 time for calcul the mask position with numpy : 0.02924370765686035 nb_pixel_total : 1783 time to create 1 rle with old method : 0.002410888671875 time for calcul the mask position with numpy : 0.02846217155456543 nb_pixel_total : 3293 time to create 1 rle with old method : 0.0038187503814697266 time for calcul the mask position with numpy : 0.02912616729736328 nb_pixel_total : 28608 time to create 1 rle with old method : 0.050137996673583984 time for calcul the mask position with numpy : 0.03839683532714844 nb_pixel_total : 18498 time to create 1 rle with old method : 0.033997297286987305 time for calcul the mask position with numpy : 0.032820701599121094 nb_pixel_total : 116851 time to create 1 rle with old method : 0.14578914642333984 time for calcul the mask position with numpy : 0.03309226036071777 nb_pixel_total : 17078 time to create 1 rle with old method : 0.022760391235351562 time for calcul the mask position with numpy : 0.028942346572875977 nb_pixel_total : 10138 time to create 1 rle with old method : 0.011812448501586914 time for calcul the mask position with numpy : 0.02903437614440918 nb_pixel_total : 34258 time to create 1 rle with old method : 0.03972053527832031 time for calcul the mask position with numpy : 0.029587984085083008 nb_pixel_total : 49369 time to create 1 rle with old method : 0.05699920654296875 time for calcul the mask position with numpy : 0.029097318649291992 nb_pixel_total : 8950 time to create 1 rle with old method : 0.010304450988769531 time for calcul the mask position with numpy : 0.029015541076660156 nb_pixel_total : 70614 time to create 1 rle with old method : 0.08031845092773438 time for calcul the mask position with numpy : 0.02962493896484375 nb_pixel_total : 15511 time to create 1 rle with old method : 0.017597198486328125 create new chi : 6.13016676902771 time to delete rle : 0.0036478042602539062 batch 1 Loaded 89 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 27759 TO DO : save crop sub photo not yet done ! save time : 2.1201765537261963 nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 4.24932074546814 time for calcul the mask position with numpy : 0.5112383365631104 nb_pixel_total : 6844140 time to create 1 rle with new method : 0.8661434650421143 time for calcul the mask position with numpy : 0.03055572509765625 nb_pixel_total : 28432 time to create 1 rle with old method : 0.03268885612487793 time for calcul the mask position with numpy : 0.021481752395629883 nb_pixel_total : 42501 time to create 1 rle with old method : 0.049001455307006836 time for calcul the mask position with numpy : 0.021788358688354492 nb_pixel_total : 6892 time to create 1 rle with old method : 0.008161544799804688 time for calcul the mask position with numpy : 0.024644851684570312 nb_pixel_total : 15080 time to create 1 rle with old method : 0.019677162170410156 time for calcul the mask position with numpy : 0.022077083587646484 nb_pixel_total : 42189 time to create 1 rle with old method : 0.04927682876586914 time for calcul the mask position with numpy : 0.02378702163696289 nb_pixel_total : 2628 time to create 1 rle with old method : 0.004570960998535156 time for calcul the mask position with numpy : 0.024780750274658203 nb_pixel_total : 11787 time to create 1 rle with old method : 0.019201040267944336 time for calcul the mask position with numpy : 0.02371811866760254 nb_pixel_total : 17629 time to create 1 rle with old method : 0.020778417587280273 time for calcul the mask position with numpy : 0.021914958953857422 nb_pixel_total : 38962 time to create 1 rle with old method : 0.04572296142578125 create new chi : 1.8770184516906738 time to delete rle : 0.0010628700256347656 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 6689 TO DO : save crop sub photo not yet done ! save time : 0.5589785575866699 nb_obj : 30 nb_hashtags : 5 time to prepare the origin masks : 4.684438467025757 time for calcul the mask position with numpy : 0.2841987609863281 nb_pixel_total : 5057739 time to create 1 rle with new method : 0.5880639553070068 time for calcul the mask position with numpy : 0.028182268142700195 nb_pixel_total : 15899 time to create 1 rle with old method : 0.018219709396362305 time for calcul the mask position with numpy : 0.028041601181030273 nb_pixel_total : 81987 time to create 1 rle with old method : 0.09452295303344727 time for calcul the mask position with numpy : 0.027944326400756836 nb_pixel_total : 46910 time to create 1 rle with old method : 0.0535578727722168 time for calcul the mask position with numpy : 0.028194665908813477 nb_pixel_total : 109708 time to create 1 rle with old method : 0.1264662742614746 time for calcul the mask position with numpy : 0.029553890228271484 nb_pixel_total : 95676 time to create 1 rle with old method : 0.13270950317382812 time for calcul the mask position with numpy : 0.032408952713012695 nb_pixel_total : 443705 time to create 1 rle with new method : 0.551337480545044 time for calcul the mask position with numpy : 0.030837535858154297 nb_pixel_total : 26437 time to create 1 rle with old method : 0.030446529388427734 time for calcul the mask position with numpy : 0.028744220733642578 nb_pixel_total : 57512 time to create 1 rle with old method : 0.06691217422485352 time for calcul the mask position with numpy : 0.027865171432495117 nb_pixel_total : 32894 time to create 1 rle with old method : 0.03730010986328125 time for calcul the mask position with numpy : 0.030368328094482422 nb_pixel_total : 24269 time to create 1 rle with old method : 0.0439600944519043 time for calcul the mask position with numpy : 0.0414276123046875 nb_pixel_total : 25019 time to create 1 rle with old method : 0.043587446212768555 time for calcul the mask position with numpy : 0.03273773193359375 nb_pixel_total : 23014 time to create 1 rle with old method : 0.03351593017578125 time for calcul the mask position with numpy : 0.029036998748779297 nb_pixel_total : 67423 time to create 1 rle with old method : 0.07883477210998535 time for calcul the mask position with numpy : 0.0283815860748291 nb_pixel_total : 21919 time to create 1 rle with old method : 0.025475263595581055 time for calcul the mask position with numpy : 0.029148578643798828 nb_pixel_total : 54240 time to create 1 rle with old method : 0.062438249588012695 time for calcul the mask position with numpy : 0.028519153594970703 nb_pixel_total : 111508 time to create 1 rle with old method : 0.13762927055358887 time for calcul the mask position with numpy : 0.0329892635345459 nb_pixel_total : 56955 time to create 1 rle with old method : 0.07203364372253418 time for calcul the mask position with numpy : 0.028926372528076172 nb_pixel_total : 139735 time to create 1 rle with old method : 0.1588449478149414 time for calcul the mask position with numpy : 0.02774786949157715 nb_pixel_total : 42373 time to create 1 rle with old method : 0.04770660400390625 time for calcul the mask position with numpy : 0.034055233001708984 nb_pixel_total : 51379 time to create 1 rle with old method : 0.06647157669067383 time for calcul the mask position with numpy : 0.03189539909362793 nb_pixel_total : 52162 time to create 1 rle with old method : 0.05946946144104004 time for calcul the mask position with numpy : 0.02889561653137207 nb_pixel_total : 83165 time to create 1 rle with old method : 0.10180807113647461 time for calcul the mask position with numpy : 0.02935624122619629 nb_pixel_total : 82194 time to create 1 rle with old method : 0.10033249855041504 time for calcul the mask position with numpy : 0.031394004821777344 nb_pixel_total : 15974 time to create 1 rle with old method : 0.018917322158813477 time for calcul the mask position with numpy : 0.029137849807739258 nb_pixel_total : 86581 time to create 1 rle with old method : 0.10109782218933105 time for calcul the mask position with numpy : 0.028861045837402344 nb_pixel_total : 29545 time to create 1 rle with old method : 0.035260677337646484 time for calcul the mask position with numpy : 0.02917790412902832 nb_pixel_total : 20489 time to create 1 rle with old method : 0.02391195297241211 time for calcul the mask position with numpy : 0.030581235885620117 nb_pixel_total : 27113 time to create 1 rle with old method : 0.036051034927368164 time for calcul the mask position with numpy : 0.028902530670166016 nb_pixel_total : 25403 time to create 1 rle with old method : 0.029277801513671875 time for calcul the mask position with numpy : 0.03076791763305664 nb_pixel_total : 41313 time to create 1 rle with old method : 0.04848122596740723 create new chi : 4.273284435272217 time to delete rle : 0.003247976303100586 batch 1 Loaded 61 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 21882 TO DO : save crop sub photo not yet done ! save time : 2.817476272583008 nb_obj : 25 nb_hashtags : 4 time to prepare the origin masks : 9.687309980392456 time for calcul the mask position with numpy : 0.4077932834625244 nb_pixel_total : 5717149 time to create 1 rle with new method : 0.53009033203125 time for calcul the mask position with numpy : 0.027531147003173828 nb_pixel_total : 5961 time to create 1 rle with old method : 0.007120847702026367 time for calcul the mask position with numpy : 0.03511619567871094 nb_pixel_total : 14924 time to create 1 rle with old method : 0.01838374137878418 time for calcul the mask position with numpy : 0.03549838066101074 nb_pixel_total : 61220 time to create 1 rle with old method : 0.07145905494689941 time for calcul the mask position with numpy : 0.03521299362182617 nb_pixel_total : 20812 time to create 1 rle with old method : 0.023423433303833008 time for calcul the mask position with numpy : 0.03775525093078613 nb_pixel_total : 455938 time to create 1 rle with new method : 0.6644575595855713 time for calcul the mask position with numpy : 0.03516197204589844 nb_pixel_total : 6049 time to create 1 rle with old method : 0.007120847702026367 time for calcul the mask position with numpy : 0.035230398178100586 nb_pixel_total : 175117 time to create 1 rle with new method : 0.7197704315185547 time for calcul the mask position with numpy : 0.03100419044494629 nb_pixel_total : 19572 time to create 1 rle with old method : 0.021981000900268555 time for calcul the mask position with numpy : 0.03151202201843262 nb_pixel_total : 7531 time to create 1 rle with old method : 0.00864863395690918 time for calcul the mask position with numpy : 0.033493995666503906 nb_pixel_total : 55921 time to create 1 rle with old method : 0.06413650512695312 time for calcul the mask position with numpy : 0.025104999542236328 nb_pixel_total : 1674 time to create 1 rle with old method : 0.0031516551971435547 time for calcul the mask position with numpy : 0.024018526077270508 nb_pixel_total : 99949 time to create 1 rle with old method : 0.1303410530090332 time for calcul the mask position with numpy : 0.02815866470336914 nb_pixel_total : 13851 time to create 1 rle with old method : 0.018947601318359375 time for calcul the mask position with numpy : 0.02416539192199707 nb_pixel_total : 33264 time to create 1 rle with old method : 0.04172921180725098 time for calcul the mask position with numpy : 0.02440500259399414 nb_pixel_total : 71023 time to create 1 rle with old method : 0.08252906799316406 time for calcul the mask position with numpy : 0.026669025421142578 nb_pixel_total : 33708 time to create 1 rle with old method : 0.03916287422180176 time for calcul the mask position with numpy : 0.024361848831176758 nb_pixel_total : 38693 time to create 1 rle with old method : 0.05424833297729492 time for calcul the mask position with numpy : 0.027884483337402344 nb_pixel_total : 8479 time to create 1 rle with old method : 0.013722419738769531 time for calcul the mask position with numpy : 0.022720813751220703 nb_pixel_total : 65519 time to create 1 rle with old method : 0.07644939422607422 time for calcul the mask position with numpy : 0.02204275131225586 nb_pixel_total : 3286 time to create 1 rle with old method : 0.003960132598876953 time for calcul the mask position with numpy : 0.02185821533203125 nb_pixel_total : 33619 time to create 1 rle with old method : 0.03956723213195801 time for calcul the mask position with numpy : 0.023547887802124023 nb_pixel_total : 44446 time to create 1 rle with old method : 0.05208110809326172 time for calcul the mask position with numpy : 0.026023149490356445 nb_pixel_total : 13199 time to create 1 rle with old method : 0.015542030334472656 time for calcul the mask position with numpy : 0.035574913024902344 nb_pixel_total : 22477 time to create 1 rle with old method : 0.026304244995117188 time for calcul the mask position with numpy : 0.03965568542480469 nb_pixel_total : 26859 time to create 1 rle with old method : 0.04381394386291504 create new chi : 3.9996399879455566 time to delete rle : 0.0038230419158935547 batch 1 Loaded 51 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 13593 TO DO : save crop sub photo not yet done ! save time : 1.4665124416351318 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 6.924627780914307 time for calcul the mask position with numpy : 1.3860609531402588 nb_pixel_total : 6436474 time to create 1 rle with new method : 1.2442035675048828 time for calcul the mask position with numpy : 0.043703556060791016 nb_pixel_total : 7941 time to create 1 rle with old method : 0.01467442512512207 time for calcul the mask position with numpy : 0.037702322006225586 nb_pixel_total : 27625 time to create 1 rle with old method : 0.03261923789978027 time for calcul the mask position with numpy : 0.03610801696777344 nb_pixel_total : 54482 time to create 1 rle with old method : 0.06349873542785645 time for calcul the mask position with numpy : 0.03453326225280762 nb_pixel_total : 47223 time to create 1 rle with old method : 0.055171966552734375 time for calcul the mask position with numpy : 0.034450531005859375 nb_pixel_total : 6488 time to create 1 rle with old method : 0.007603168487548828 time for calcul the mask position with numpy : 0.03483748435974121 nb_pixel_total : 57218 time to create 1 rle with old method : 0.06659150123596191 time for calcul the mask position with numpy : 0.03554487228393555 nb_pixel_total : 29023 time to create 1 rle with old method : 0.03626728057861328 time for calcul the mask position with numpy : 0.03680062294006348 nb_pixel_total : 53563 time to create 1 rle with old method : 0.06257462501525879 time for calcul the mask position with numpy : 0.03700518608093262 nb_pixel_total : 9838 time to create 1 rle with old method : 0.011565685272216797 time for calcul the mask position with numpy : 0.03807425498962402 nb_pixel_total : 29257 time to create 1 rle with old method : 0.03425145149230957 time for calcul the mask position with numpy : 0.03815650939941406 nb_pixel_total : 156647 time to create 1 rle with new method : 1.2399044036865234 time for calcul the mask position with numpy : 0.04119300842285156 nb_pixel_total : 114602 time to create 1 rle with old method : 0.1422886848449707 time for calcul the mask position with numpy : 0.04406905174255371 nb_pixel_total : 19859 time to create 1 rle with old method : 0.023007869720458984 create new chi : 4.985396385192871 time to delete rle : 0.002437591552734375 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 10368 TO DO : save crop sub photo not yet done ! save time : 1.8677494525909424 map_output_result : {1349921824: (0.0, 'Should be the crop_list due to order', 0), 1349921807: (0.0, 'Should be the crop_list due to order', 0), 1349921803: (0.0, 'Should be the crop_list due to order', 0), 1349921760: (0.0, 'Should be the crop_list due to order', 0), 1349921754: (0.0, 'Should be the crop_list due to order', 0), 1349921741: (0.0, 'Should be the crop_list due to order', 0), 1349921684: (0.0, 'Should be the crop_list due to order', 0), 1349921681: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1349921824, 1349921807, 1349921803, 1349921760, 1349921754, 1349921741, 1349921684, 1349921681] Looping around the photos to save general results len do output : 8 /1349921824.Didn't retrieve data . /1349921807.Didn't retrieve data . /1349921803.Didn't retrieve data . /1349921760.Didn't retrieve data . /1349921754.Didn't retrieve data . /1349921741.Didn't retrieve data . /1349921684.Didn't retrieve data . /1349921681.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921824', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921807', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921803', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921760', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921754', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921741', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921684', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921681', None, None, None, None, None, '2722703') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.015511274337768555 save_final save missing photos in datou_result : time spend for datou_step_exec : 101.53124976158142 time spend to save output : 0.016249895095825195 total time spend for step 3 : 101.54749965667725 step4:ventilate_hashtags_in_portfolio Fri Apr 4 03:55:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22047458 get user id for portfolio 22047458 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22047458 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','metal','pet_fonce','autre','mal_croppe','background','environnement','pehd','flou','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22047458 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','metal','pet_fonce','autre','mal_croppe','background','environnement','pehd','flou','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22047458 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','papier','metal','pet_fonce','autre','mal_croppe','background','environnement','pehd','flou','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22051810,22051811,22051812,22051813,22051814,22051815,22051816,22051817,22051818,22051819,22051820?tags=pet_clair,papier,metal,pet_fonce,autre,mal_croppe,background,environnement,pehd,flou,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1349921824, 1349921807, 1349921803, 1349921760, 1349921754, 1349921741, 1349921684, 1349921681] Looping around the photos to save general results len do output : 1 /22047458. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921824', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921807', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921803', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921760', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921754', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921741', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921684', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921681', None, None, None, None, None, '2722703') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01877307891845703 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7944040298461914 time spend to save output : 0.019112825393676758 total time spend for step 4 : 1.8135168552398682 step5:final Fri Apr 4 03:55:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1349921824: ('0.18327432824981849',), 1349921807: ('0.18327432824981849',), 1349921803: ('0.18327432824981849',), 1349921760: ('0.18327432824981849',), 1349921754: ('0.18327432824981849',), 1349921741: ('0.18327432824981849',), 1349921684: ('0.18327432824981849',), 1349921681: ('0.18327432824981849',)} new output for save of step final : {1349921824: ('0.18327432824981849',), 1349921807: ('0.18327432824981849',), 1349921803: ('0.18327432824981849',), 1349921760: ('0.18327432824981849',), 1349921754: ('0.18327432824981849',), 1349921741: ('0.18327432824981849',), 1349921684: ('0.18327432824981849',), 1349921681: ('0.18327432824981849',)} [1349921824, 1349921807, 1349921803, 1349921760, 1349921754, 1349921741, 1349921684, 1349921681] Looping around the photos to save general results len do output : 8 /1349921824.Didn't retrieve data . /1349921807.Didn't retrieve data . /1349921803.Didn't retrieve data . /1349921760.Didn't retrieve data . /1349921754.Didn't retrieve data . /1349921741.Didn't retrieve data . /1349921684.Didn't retrieve data . /1349921681.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921824', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921807', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921803', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921760', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921754', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921741', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921684', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921681', None, None, None, None, None, '2722703') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.016630172729492188 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10808181762695312 time spend to save output : 0.017100811004638672 total time spend for step 5 : 0.1251826286315918 step6:blur_detection Fri Apr 4 03:55:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf.jpg resize: (2160, 3264) 1349921824 2.9628734831969092 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7.jpg resize: (2160, 3264) 1349921807 -2.0158679540357634 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d.jpg resize: (2160, 3264) 1349921803 -3.221795500846833 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71.jpg resize: (2160, 3264) 1349921760 -2.869740981957227 treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd.jpg resize: (2160, 3264) 1349921754 1.0685762560805898 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32.jpg resize: (2160, 3264) 1349921741 -4.382158152093547 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773.jpg resize: (2160, 3264) 1349921684 -3.5146590071067165 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348.jpg resize: (2160, 3264) 1349921681 -2.799517221504331 treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248209_0.png resize: (403, 301) 1349962097 -0.9558311108766928 treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248211_0.png resize: (357, 368) 1349962098 -0.35609978071314125 treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248215_0.png resize: (155, 161) 1349962099 0.5766983898644664 treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248213_0.png resize: (166, 273) 1349962100 3.1899776499747183 treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248212_0.png resize: (138, 192) 1349962101 2.2906788089288104 treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248210_0.png resize: (405, 385) 1349962102 -0.3923968958675642 treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248214_0.png resize: (209, 133) 1349962104 0.9696464160912278 treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248218_0.png resize: (270, 220) 1349962105 1.5276970095057385 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248229_0.png resize: (342, 160) 1349962106 -1.4164214804407798 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248223_0.png resize: (402, 331) 1349962108 -1.4830279966669233 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248225_0.png resize: (248, 419) 1349962109 -0.5648714726531616 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248226_0.png resize: (221, 166) 1349962110 -1.4853585548147903 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248222_0.png resize: (481, 530) 1349962111 -1.1469586357737673 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248238_0.png resize: (217, 194) 1349962112 -1.1383992945460046 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248237_0.png resize: (688, 651) 1349962113 -1.7832723455937567 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248224_0.png resize: (471, 309) 1349962114 -2.777650298184066 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248220_0.png resize: (299, 641) 1349962115 0.2910935700862342 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248242_0.png resize: (363, 426) 1349962116 -4.0569499315665665 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248236_0.png resize: (488, 379) 1349962117 -1.7253906456418033 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248228_0.png resize: (271, 164) 1349962118 -2.319345512761888 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248243_0.png resize: (403, 425) 1349962119 -2.6250578229514456 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248239_0.png resize: (95, 269) 1349962120 -1.4834899002714865 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248244_0.png resize: (136, 122) 1349962121 -0.9021815751980253 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248240_0.png resize: (353, 139) 1349962122 -2.151433943756219 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248234_0.png resize: (416, 241) 1349962123 -2.1931316533792673 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248241_0.png resize: (286, 243) 1349962124 -0.3006205314344991 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248231_0.png resize: (455, 489) 1349962125 0.38719190607885223 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248235_0.png resize: (640, 241) 1349962126 -0.020208616507687672 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248261_0.png resize: (221, 113) 1349962127 -3.7506056556108485 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248260_0.png resize: (167, 114) 1349962128 -2.1056047189533125 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248247_0.png resize: (438, 337) 1349962130 -2.2187246234655777 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248257_0.png resize: (555, 572) 1349962131 -0.7323664351496132 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248256_0.png resize: (200, 298) 1349962132 1.2990495296660067 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248259_0.png resize: (152, 270) 1349962133 -2.332280459016589 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248263_0.png resize: (125, 117) 1349962134 -2.2876091358699897 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248255_0.png resize: (360, 294) 1349962135 -1.3437858786034473 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248250_0.png resize: (465, 410) 1349962136 -3.1269439766971696 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248246_0.png resize: (436, 329) 1349962137 -1.336246353000924 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248254_0.png resize: (137, 374) 1349962138 -3.877950915066953 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248248_0.png resize: (203, 201) 1349962139 -0.9714156908898246 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248249_0.png resize: (168, 136) 1349962140 0.5351550723311574 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248253_0.png resize: (197, 246) 1349962141 -2.264044184266535 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248245_0.png resize: (265, 238) 1349962142 -0.24051764469107537 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248304_0.png resize: (135, 142) 1349962143 -0.7499466034461174 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248289_0.png resize: (233, 231) 1349962144 -1.129892716502853 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248268_0.png resize: (206, 284) 1349962145 -1.2059216911608737 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248269_0.png resize: (292, 246) 1349962146 -1.6938598469780897 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248296_0.png resize: (87, 141) 1349962147 0.6536853422435615 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248291_0.png resize: (183, 239) 1349962148 -2.552302438898248 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248279_0.png resize: (189, 184) 1349962149 -2.5080060779717237 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248278_0.png resize: (250, 207) 1349962150 -1.810592431469805 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248266_0.png resize: (382, 336) 1349962151 -1.5072478052103169 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248267_0.png resize: (315, 395) 1349962152 -2.7515688635329587 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248265_0.png resize: (239, 155) 1349962153 -2.2475916673414313 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248301_0.png resize: (314, 419) 1349962154 -1.621447713479236 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248285_0.png resize: (237, 336) 1349962155 -2.016398638713865 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248276_0.png resize: (474, 367) 1349962156 -1.2964279580544822 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248300_0.png resize: (169, 155) 1349962157 -1.2953958455063228 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248292_0.png resize: (199, 176) 1349962158 -3.8295338145727684 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248288_0.png resize: (166, 341) 1349962159 -2.1373283863773915 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248293_0.png resize: (197, 118) 1349962160 -2.0567962065328413 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248298_0.png resize: (116, 92) 1349962161 -3.227136453978914 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248303_0.png resize: (452, 335) 1349962162 -0.08862930780213198 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248287_0.png resize: (225, 89) 1349962163 -0.27698616106248813 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248280_0.png resize: (153, 91) 1349962164 -2.041252378595105 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248307_0.png resize: (183, 412) 1349962165 -3.241165820155142 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248294_0.png resize: (230, 239) 1349962166 -3.252747457030151 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248308_0.png resize: (231, 230) 1349962167 -0.5498007135565878 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248273_0.png resize: (366, 331) 1349962168 -2.071732677169685 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248274_0.png resize: (461, 520) 1349962169 -0.7811507655283036 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248297_0.png resize: (313, 425) 1349962170 -1.4288724680032907 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248283_0.png resize: (311, 317) 1349962171 -3.2289772727504396 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248272_0.png resize: (440, 332) 1349962172 -2.3650754975956505 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248290_0.png resize: (294, 322) 1349962173 -1.1666427741927612 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248299_0.png resize: (295, 345) 1349962174 -2.3796869636655082 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248270_0.png resize: (603, 417) 1349962175 -2.5340033820197134 treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248310_0.png resize: (264, 129) 1349962176 -2.4038672952251035 treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248317_0.png resize: (349, 332) 1349962177 -1.2929876110069898 treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248312_0.png resize: (158, 154) 1349962178 0.7575329538535341 treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248309_0.png resize: (183, 450) 1349962179 2.2235403973956127 treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248316_0.png resize: (184, 421) 1349962180 -0.9830373753864382 treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248311_0.png resize: (192, 105) 1349962182 -0.2106406625364353 treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248315_0.png resize: (86, 108) 1349962183 -1.3294659713026524 treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248314_0.png resize: (121, 182) 1349962184 -0.4031391843984099 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248319_0.png resize: (343, 399) 1349962185 -2.70679569296458 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248322_0.png resize: (299, 205) 1349962186 -1.4653097575075227 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248334_0.png resize: (256, 350) 1349962188 -1.558321027179798 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248320_0.png resize: (231, 325) 1349962189 -1.6237046588969961 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248326_0.png resize: (212, 163) 1349962190 -2.315075037734906 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248338_0.png resize: (206, 216) 1349962191 -2.040816296911337 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248327_0.png resize: (208, 279) 1349962192 -2.6843208068063973 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248318_0.png resize: (168, 183) 1349962193 -2.5246863815159393 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248337_0.png resize: (395, 393) 1349962194 -2.9950448017323192 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248323_0.png resize: (326, 152) 1349962195 -4.049342223295293 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248345_0.png resize: (221, 465) 1349962196 -2.6835247185256113 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248339_0.png resize: (263, 234) 1349962197 -2.8957436304252386 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248332_0.png resize: (196, 120) 1349962198 -1.5464846031167991 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248353_0.png resize: (69, 54) 1349962199 20.0 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248369_0.png resize: (185, 160) 1349962200 -1.88781685961392 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248349_0.png resize: (212, 201) 1349962201 -1.1200905786852362 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248364_0.png resize: (96, 111) 1349962202 -1.964820310696349 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248362_0.png resize: (46, 82) 1349962203 1.156556345222126 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248355_0.png resize: (82, 140) 1349962204 -1.332628619007259 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248360_0.png resize: (142, 144) 1349962205 -3.2208160977454994 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248367_0.png resize: (147, 49) 1349962206 1.5820633533266546 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248350_0.png resize: (133, 147) 1349962207 -1.9106793374015796 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248368_0.png resize: (686, 932) 1349962208 -4.153533000735044 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248366_0.png resize: (376, 743) 1349962209 -3.8727216571422027 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248371_0.png resize: (125, 243) 1349962210 -0.1536916856958522 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248356_0.png resize: (255, 328) 1349962211 -1.8985361458733503 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248359_0.png resize: (220, 216) 1349962212 -2.7385554606476523 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248348_0.png resize: (209, 229) 1349962213 -3.1475725218847677 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248363_0.png resize: (357, 219) 1349962214 -1.5882463661985242 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248361_0.png resize: (288, 411) 1349962215 -3.713521716333266 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248374_0.png resize: (584, 239) 1349962216 -0.5693148854233635 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248384_0.png resize: (320, 346) 1349962217 -2.3269620962632804 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248375_0.png resize: (444, 570) 1349962218 -2.3838761078404995 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248378_0.png resize: (295, 285) 1349962219 -1.0629548531992925 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248373_0.png resize: (213, 169) 1349962220 -1.010612952959742 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248380_0.png resize: (324, 239) 1349962221 -4.0538040509904665 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248377_0.png resize: (107, 141) 1349962222 -0.9425351310323333 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248379_0.png resize: (165, 236) 1349962223 0.1919449004284544 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248382_0.png resize: (363, 394) 1349962224 0.45874244201048897 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248383_0.png resize: (316, 326) 1349962225 0.8415422430380789 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248230_0.png resize: (440, 138) 1349962240 -2.7115429390299792 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248221_0.png resize: (667, 489) 1349962241 -0.294643158878583 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248233_0.png resize: (421, 410) 1349962242 -1.7399585818839218 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248286_0.png resize: (158, 226) 1349962243 -2.778554691260325 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248295_0.png resize: (68, 66) 1349962244 -1.9147535344104922 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248306_0.png resize: (363, 349) 1349962245 -2.0075022057891454 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248321_0.png resize: (246, 531) 1349962246 -2.2591084997883084 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248336_0.png resize: (155, 361) 1349962247 -1.99010047077215 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248329_0.png resize: (156, 312) 1349962248 -3.4988520156160567 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248328_0.png resize: (233, 277) 1349962249 -4.714134049007053 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248352_0.png resize: (225, 258) 1349962250 -2.0495708284853915 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248370_0.png resize: (328, 284) 1349962251 -0.2283812997733812 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248351_0.png resize: (286, 228) 1349962252 -1.6440012540302318 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248365_0.png resize: (179, 242) 1349962253 -2.815147954165893 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248376_0.png resize: (177, 244) 1349962254 -4.617649936972313 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248381_0.png resize: (99, 96) 1349962255 -4.292012656058936 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248330_0.png resize: (167, 141) 1349962257 -2.760415451347577 treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248217_0.png resize: (389, 383) 1349962273 0.19097413132789876 treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248216_0.png resize: (665, 625) 1349962275 1.085950877467713 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248227_0.png resize: (401, 409) 1349962276 -1.615257250094245 treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248232_0.png resize: (223, 555) 1349962277 -2.1621911663649827 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248252_0.png resize: (529, 370) 1349962278 -0.06583794931465693 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248264_0.png resize: (147, 180) 1349962279 -4.034796127170688 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248251_0.png resize: (319, 273) 1349962280 -2.2851371125420354 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248271_0.png resize: (447, 294) 1349962282 -2.4321654323924897 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248305_0.png resize: (197, 489) 1349962283 -0.8471909750912813 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248302_0.png resize: (247, 333) 1349962284 -0.9603231319482166 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248277_0.png resize: (550, 429) 1349962285 -3.7638871235135203 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248282_0.png resize: (249, 136) 1349962286 -2.3985324956520313 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248284_0.png resize: (369, 324) 1349962287 -4.233719007149158 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248281_0.png resize: (350, 200) 1349962288 -2.7911424803187126 treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248275_0.png resize: (428, 228) 1349962289 -1.5102938945024995 treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248313_0.png resize: (342, 163) 1349962290 -1.864200033167053 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248325_0.png resize: (808, 1006) 1349962291 -3.489523141762171 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248342_0.png resize: (197, 424) 1349962292 -4.338396945260699 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248340_0.png resize: (124, 216) 1349962293 -0.5779438025679627 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248333_0.png resize: (375, 340) 1349962294 -2.491540616050044 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248343_0.png resize: (172, 255) 1349962295 -3.1679569068798936 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248347_0.png resize: (187, 397) 1349962296 -3.4456567439524823 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248341_0.png resize: (209, 148) 1349962297 -3.081503987510764 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248324_0.png resize: (233, 291) 1349962298 -2.030128307369155 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248344_0.png resize: (714, 447) 1349962299 -2.4495835489349465 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248335_0.png resize: (279, 406) 1349962300 -4.524797114132696 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248346_0.png resize: (399, 526) 1349962301 -3.1742505209476537 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248354_0.png resize: (330, 240) 1349962302 -2.8438698413029946 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248358_0.png resize: (270, 551) 1349962303 -2.1279462144597248 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248372_0.png resize: (264, 231) 1349962304 0.5738284858062935 treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248385_0.png resize: (88, 129) 1349962305 -1.770850593554819 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248262_0.png resize: (502, 409) 1349962308 -0.5143854953981587 treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248331_0.png resize: (369, 460) 1349962309 -1.8554464900394967 treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248357_0.png resize: (206, 269) 1349962310 -1.1985094996088927 treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248219_0.png resize: (221, 293) 1349962314 -0.9294049052850295 treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248258_0.png resize: (336, 208) 1349962315 -2.29848809919564 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 185 time used for this insertion : 1.9895646572113037 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 185 time used for this insertion : 1.1044952869415283 save missing photos in datou_result : time spend for datou_step_exec : 36.850241899490356 time spend to save output : 3.101835012435913 total time spend for step 6 : 39.95207691192627 step7:brightness Fri Apr 4 03:56:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf.jpg treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7.jpg treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d.jpg treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71.jpg treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd.jpg treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32.jpg treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773.jpg treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348.jpg treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248209_0.png treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248211_0.png treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248215_0.png treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248213_0.png treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248212_0.png treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248210_0.png treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248214_0.png treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248218_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248229_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248223_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248225_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248226_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248222_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248238_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248237_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248224_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248220_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248242_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248236_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248228_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248243_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248239_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248244_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248240_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248234_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248241_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248231_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248235_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248261_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248260_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248247_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248257_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248256_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248259_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248263_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248255_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248250_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248246_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248254_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248248_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248249_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248253_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248245_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248304_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248289_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248268_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248269_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248296_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248291_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248279_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248278_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248266_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248267_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248265_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248301_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248285_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248276_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248300_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248292_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248288_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248293_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248298_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248303_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248287_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248280_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248307_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248294_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248308_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248273_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248274_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248297_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248283_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248272_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248290_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248299_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248270_0.png treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248310_0.png treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248317_0.png treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248312_0.png treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248309_0.png treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248316_0.png treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248311_0.png treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248315_0.png treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248314_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248319_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248322_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248334_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248320_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248326_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248338_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248327_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248318_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248337_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248323_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248345_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248339_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248332_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248353_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248369_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248349_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248364_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248362_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248355_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248360_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248367_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248350_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248368_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248366_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248371_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248356_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248359_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248348_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248363_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248361_0.png treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248374_0.png treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248384_0.png treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248375_0.png treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248378_0.png treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248373_0.png treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248380_0.png treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248377_0.png treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248379_0.png treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248382_0.png treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248383_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248230_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248221_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248233_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248286_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248295_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248306_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248321_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248336_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248329_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248328_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248352_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248370_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248351_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248365_0.png treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248376_0.png treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248381_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248330_0.png treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248217_0.png treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248216_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248227_0.png treat image : temp/1743731430_2226781_1349921807_5220572c51b0d290de8c2165bc2db6f7_rle_crop_3747248232_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248252_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248264_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248251_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248271_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248305_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248302_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248277_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248282_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248284_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248281_0.png treat image : temp/1743731430_2226781_1349921760_bb50ab008d8884c8ec66191500ad3e71_rle_crop_3747248275_0.png treat image : temp/1743731430_2226781_1349921754_2f38869c01067e800121c98f1dd11fdd_rle_crop_3747248313_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248325_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248342_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248340_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248333_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248343_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248347_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248341_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248324_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248344_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248335_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248346_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248354_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248358_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248372_0.png treat image : temp/1743731430_2226781_1349921681_0a977a7beb485023945e51e919e8d348_rle_crop_3747248385_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248262_0.png treat image : temp/1743731430_2226781_1349921741_8536d6a385915a24544529440d7cdb32_rle_crop_3747248331_0.png treat image : temp/1743731430_2226781_1349921684_37d6ebd43f27aedbd666e0f465b07773_rle_crop_3747248357_0.png treat image : temp/1743731430_2226781_1349921824_354c1df79aec89e296246ab5c2f985bf_rle_crop_3747248219_0.png treat image : temp/1743731430_2226781_1349921803_4e8f3f550986d2d0975ae268219e0a7d_rle_crop_3747248258_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 185 time used for this insertion : 0.019328832626342773 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 185 time used for this insertion : 0.21908926963806152 save missing photos in datou_result : time spend for datou_step_exec : 9.453789472579956 time spend to save output : 0.2438673973083496 total time spend for step 7 : 9.697656869888306 step8:velours_tree Fri Apr 4 03:56:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.8779935836791992 time spend to save output : 5.91278076171875e-05 total time spend for step 8 : 0.8780527114868164 step9:send_mail_cod Fri Apr 4 03:56:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22047458_04-04-2025_03_56_43.pdf 22051810 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220518101743731803 22051811 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220518111743731805 22051812 change filename to text .imagette220518121743731806 22051813 imagette220518131743731806 22051814 change filename to text .change filename to text .change filename to text .imagette220518141743731806 22051815 imagette220518151743731807 22051816 imagette220518161743731807 22051818 change filename to text .change filename to text .imagette220518181743731807 22051819 imagette220518191743731807 22051820 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220518201743731807 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22047458 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22051810,22051811,22051812,22051813,22051814,22051815,22051816,22051817,22051818,22051819,22051820?tags=pet_clair,papier,metal,pet_fonce,autre,mal_croppe,background,environnement,pehd,flou,carton args[1349921824] : ((1349921824, 2.9628734831969092, 492688767), (1349921824, -0.09603732570416916, 496442774), '0.18327432824981849') We are sending mail with results at report@fotonower.com args[1349921807] : ((1349921807, -2.0158679540357634, 492609224), (1349921807, -0.09759262876061366, 496442774), '0.18327432824981849') We are sending mail with results at report@fotonower.com args[1349921803] : ((1349921803, -3.221795500846833, 492609224), (1349921803, -0.028200905479822222, 2107752395), '0.18327432824981849') We are sending mail with results at report@fotonower.com args[1349921760] : ((1349921760, -2.869740981957227, 492609224), (1349921760, -0.1301059091031984, 496442774), '0.18327432824981849') We are sending mail with results at report@fotonower.com args[1349921754] : ((1349921754, 1.0685762560805898, 492688767), (1349921754, 0.15825176772066435, 2107752395), '0.18327432824981849') We are sending mail with results at report@fotonower.com args[1349921741] : ((1349921741, -4.382158152093547, 492609224), (1349921741, -0.21744019958562105, 496442774), '0.18327432824981849') We are sending mail with results at report@fotonower.com args[1349921684] : ((1349921684, -3.5146590071067165, 492609224), (1349921684, -0.2841935430244043, 496442774), '0.18327432824981849') We are sending mail with results at report@fotonower.com args[1349921681] : ((1349921681, -2.799517221504331, 492609224), (1349921681, 0.09087579574095918, 2107752395), '0.18327432824981849') We are sending mail with results at report@fotonower.com refus_total : 0.18327432824981849 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22047458 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1349921684,1349921807,1349921681,1349921741,1349921754,1349921760,1349921803,1349921824) Found this number of photos: 8 begin to download photo : 1349921684 begin to download photo : 1349921681 begin to download photo : 1349921754 begin to download photo : 1349921803 download finish for photo 1349921754 begin to download photo : 1349921760 download finish for photo 1349921803 begin to download photo : 1349921824 download finish for photo 1349921681 begin to download photo : 1349921741 download finish for photo 1349921684 begin to download photo : 1349921807 download finish for photo 1349921824 download finish for photo 1349921741 download finish for photo 1349921807 download finish for photo 1349921760 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22047458_04-04-2025_03_56_43.pdf results_Auto_P22047458_04-04-2025_03_56_43.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22047458_04-04-2025_03_56_43.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22047458','results_Auto_P22047458_04-04-2025_03_56_43.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22047458_04-04-2025_03_56_43.pdf','pdf','','0.75','0.18327432824981849') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22047458

https://www.fotonower.com/image?json=false&list_photos_id=1349921824
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.9628734831969092)
https://www.fotonower.com/image?json=false&list_photos_id=1349921807
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1349921803
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1349921760
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1349921754
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0685762560805898)
https://www.fotonower.com/image?json=false&list_photos_id=1349921741
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1349921684
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1349921681
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 18.33%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/22051810?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22051811?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22051812?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22051814?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22051818?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22051820?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22047458_04-04-2025_03_56_43.pdf.

Lien vers velours :https://www.fotonower.com/velours/22051810,22051811,22051812,22051813,22051814,22051815,22051816,22051817,22051818,22051819,22051820?tags=pet_clair,papier,metal,pet_fonce,autre,mal_croppe,background,environnement,pehd,flou,carton.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 04 Apr 2025 01:56:54 GMT Content-Length: 0 Connection: close X-Message-Id: QyYNsxl7SOqYr2C9O-XHdw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1349921824, 1349921807, 1349921803, 1349921760, 1349921754, 1349921741, 1349921684, 1349921681] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921824', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921807', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921803', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921760', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921754', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921741', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921684', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921681', None, None, None, None, None, '2722703') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.016648292541503906 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.19188904762268 time spend to save output : 0.01690530776977539 total time spend for step 9 : 11.208794355392456 step10:split_time_score Fri Apr 4 03:56:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03042025 22047458 Nombre de photos uploadées : 8 / 23040 (0%) 03042025 22047458 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 03042025 22047458 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 4.0531158447265625e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.000423431396484375 elapsed_time : insert_dashboard_record_day_entry 0.02500176429748535 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.19034112532121109 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22040384 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22040384 AND mptpi.`type`=3594 To do Qualite : 0.21172410442765072 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22015444_03-04-2025_09_34_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22015444 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22015444 AND mptpi.`type`=3594 To do Qualite : 0.09005149663155876 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22047452_04-04-2025_02_45_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22047452 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22047452 AND mptpi.`type`=3726 To do Qualite : 0.25722014427877626 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22023268_03-04-2025_12_58_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22023268 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22023268 AND mptpi.`type`=3594 To do Qualite : 0.17086810971231933 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22049831_04-04-2025_03_24_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22049831 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22049831 AND mptpi.`type`=3594 To do Qualite : 0.18327432824981849 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22047458_04-04-2025_03_56_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22047458 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22047458 AND mptpi.`type`=3594 To do Qualite : 0.1660609801518647 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22047460_04-04-2025_02_41_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22047460 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22047460 AND mptpi.`type`=3594 To do Qualite : 0.08224778868842057 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22047465_04-04-2025_02_37_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22047465 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22047465 AND mptpi.`type`=3726 To do Qualite : 0.23727131984159403 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22045537_04-04-2025_02_51_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22045537 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22045537 AND mptpi.`type`=3594 To do Qualite : 0.20535954567976877 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22045539_04-04-2025_01_33_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22045539 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22045539 AND mptpi.`type`=3594 To do Qualite : 0.25616201245158554 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22045540_04-04-2025_01_26_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22045540 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22045540 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03042025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1349921824, 1349921807, 1349921803, 1349921760, 1349921754, 1349921741, 1349921684, 1349921681] Looping around the photos to save general results len do output : 1 /22047458Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921824', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921807', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921803', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921760', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921754', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921741', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921684', None, None, None, None, None, '2722703') ('3318', None, None, None, None, None, None, None, '2722703') ('3318', '22047458', '1349921681', None, None, None, None, None, '2722703') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01656937599182129 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.8318026065826416 time spend to save output : 0.016797780990600586 total time spend for step 10 : 1.8486003875732422 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 174.73user 118.01system 6:31.00elapsed 74%CPU (0avgtext+0avgdata 5287924maxresident)k 819224inputs+127608outputs (14872major+14433954minor)pagefaults 0swaps