python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3250526 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2849713'] with mtr_portfolio_ids : ['22967499'] and first list_photo_ids : [] new path : /proc/3250526/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.0916709899902344 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed May 14 15:40:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9400 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-14 15:40:32.412021: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-14 15:40:32.443156: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-14 15:40:32.445688: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fa568000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-14 15:40:32.445719: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-14 15:40:32.451501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-14 15:40:32.711240: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1c6c2fd0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-14 15:40:32.711307: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-14 15:40:32.713229: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 15:40:32.716185: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 15:40:32.747845: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 15:40:32.767810: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 15:40:32.940565: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 15:40:32.974093: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 15:40:32.979142: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 15:40:33.035781: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 15:40:33.037634: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 15:40:33.038119: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 15:40:33.039881: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-14 15:40:33.039903: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-14 15:40:33.039915: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-14 15:40:33.041884: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8693 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-14 15:40:33.461920: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 15:40:33.462052: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 15:40:33.462078: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 15:40:33.462099: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 15:40:33.462119: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 15:40:33.462139: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 15:40:33.462159: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 15:40:33.462179: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 15:40:33.463818: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 15:40:33.465198: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 15:40:33.465256: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 15:40:33.465276: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 15:40:33.465293: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 15:40:33.465310: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 15:40:33.465325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 15:40:33.465341: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 15:40:33.465356: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 15:40:33.466507: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 15:40:33.466549: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-14 15:40:33.466559: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-14 15:40:33.466566: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-14 15:40:33.467828: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8693 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-14 15:40:44.651190: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 15:40:45.472981: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 78 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 57 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 42 Detection mask done ! Trying to reset tf kernel 3252324 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3227 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8516 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0018584728240966797 nb_pixel_total : 59888 time to create 1 rle with old method : 0.07139277458190918 length of segment : 366 time for calcul the mask position with numpy : 0.0011172294616699219 nb_pixel_total : 64399 time to create 1 rle with old method : 0.09003782272338867 length of segment : 303 time for calcul the mask position with numpy : 0.00324249267578125 nb_pixel_total : 108161 time to create 1 rle with old method : 0.12233805656433105 length of segment : 459 time for calcul the mask position with numpy : 0.0015344619750976562 nb_pixel_total : 88900 time to create 1 rle with old method : 0.1040499210357666 length of segment : 281 time for calcul the mask position with numpy : 0.0004985332489013672 nb_pixel_total : 30809 time to create 1 rle with old method : 0.03794360160827637 length of segment : 130 time for calcul the mask position with numpy : 0.0008187294006347656 nb_pixel_total : 43999 time to create 1 rle with old method : 0.07174491882324219 length of segment : 263 time for calcul the mask position with numpy : 0.009058237075805664 nb_pixel_total : 207180 time to create 1 rle with new method : 0.7745587825775146 length of segment : 559 time for calcul the mask position with numpy : 0.0024917125701904297 nb_pixel_total : 103711 time to create 1 rle with old method : 0.11456060409545898 length of segment : 458 time for calcul the mask position with numpy : 0.0008094310760498047 nb_pixel_total : 49282 time to create 1 rle with old method : 0.05374503135681152 length of segment : 287 time for calcul the mask position with numpy : 0.0006883144378662109 nb_pixel_total : 39210 time to create 1 rle with old method : 0.04281497001647949 length of segment : 250 time for calcul the mask position with numpy : 0.0009288787841796875 nb_pixel_total : 41596 time to create 1 rle with old method : 0.04675173759460449 length of segment : 176 time for calcul the mask position with numpy : 0.5569751262664795 nb_pixel_total : 2720458 time to create 1 rle with new method : 1.3150653839111328 length of segment : 1622 time for calcul the mask position with numpy : 0.001621246337890625 nb_pixel_total : 85854 time to create 1 rle with old method : 0.09717297554016113 length of segment : 319 time for calcul the mask position with numpy : 0.0007894039154052734 nb_pixel_total : 35152 time to create 1 rle with old method : 0.04039406776428223 length of segment : 364 time for calcul the mask position with numpy : 0.0006883144378662109 nb_pixel_total : 36106 time to create 1 rle with old method : 0.042090415954589844 length of segment : 160 time for calcul the mask position with numpy : 0.000255584716796875 nb_pixel_total : 12982 time to create 1 rle with old method : 0.015172719955444336 length of segment : 93 time for calcul the mask position with numpy : 0.0014882087707519531 nb_pixel_total : 75597 time to create 1 rle with old method : 0.08641767501831055 length of segment : 396 time for calcul the mask position with numpy : 0.0006098747253417969 nb_pixel_total : 27545 time to create 1 rle with old method : 0.03269219398498535 length of segment : 222 time for calcul the mask position with numpy : 0.0006277561187744141 nb_pixel_total : 30096 time to create 1 rle with old method : 0.035436391830444336 length of segment : 319 time for calcul the mask position with numpy : 0.0005853176116943359 nb_pixel_total : 10170 time to create 1 rle with old method : 0.012566328048706055 length of segment : 80 time for calcul the mask position with numpy : 0.002191781997680664 nb_pixel_total : 78749 time to create 1 rle with old method : 0.09152531623840332 length of segment : 371 time for calcul the mask position with numpy : 0.00035572052001953125 nb_pixel_total : 17192 time to create 1 rle with old method : 0.019962787628173828 length of segment : 198 time for calcul the mask position with numpy : 0.0005335807800292969 nb_pixel_total : 27025 time to create 1 rle with old method : 0.031107425689697266 length of segment : 377 time for calcul the mask position with numpy : 0.018415451049804688 nb_pixel_total : 646775 time to create 1 rle with new method : 0.05083179473876953 length of segment : 932 time for calcul the mask position with numpy : 0.0008904933929443359 nb_pixel_total : 30583 time to create 1 rle with old method : 0.03582286834716797 length of segment : 291 time for calcul the mask position with numpy : 0.00028443336486816406 nb_pixel_total : 14942 time to create 1 rle with old method : 0.017499208450317383 length of segment : 140 time for calcul the mask position with numpy : 0.0006384849548339844 nb_pixel_total : 44440 time to create 1 rle with old method : 0.05655241012573242 length of segment : 207 time for calcul the mask position with numpy : 0.00039196014404296875 nb_pixel_total : 8399 time to create 1 rle with old method : 0.009953498840332031 length of segment : 172 time for calcul the mask position with numpy : 0.0005314350128173828 nb_pixel_total : 24776 time to create 1 rle with old method : 0.029577970504760742 length of segment : 143 time for calcul the mask position with numpy : 0.0018935203552246094 nb_pixel_total : 79182 time to create 1 rle with old method : 0.09226226806640625 length of segment : 483 time for calcul the mask position with numpy : 0.0013337135314941406 nb_pixel_total : 48753 time to create 1 rle with old method : 0.05820775032043457 length of segment : 295 time for calcul the mask position with numpy : 0.00040841102600097656 nb_pixel_total : 20391 time to create 1 rle with old method : 0.024379253387451172 length of segment : 176 time for calcul the mask position with numpy : 0.002187013626098633 nb_pixel_total : 137122 time to create 1 rle with old method : 0.15513134002685547 length of segment : 463 time for calcul the mask position with numpy : 0.0002446174621582031 nb_pixel_total : 8909 time to create 1 rle with old method : 0.014894962310791016 length of segment : 101 time for calcul the mask position with numpy : 0.0003345012664794922 nb_pixel_total : 11793 time to create 1 rle with old method : 0.014053821563720703 length of segment : 156 time for calcul the mask position with numpy : 0.004056453704833984 nb_pixel_total : 242437 time to create 1 rle with new method : 0.009921073913574219 length of segment : 688 time for calcul the mask position with numpy : 0.0011332035064697266 nb_pixel_total : 37256 time to create 1 rle with old method : 0.04753732681274414 length of segment : 554 time for calcul the mask position with numpy : 0.0019905567169189453 nb_pixel_total : 86465 time to create 1 rle with old method : 0.0993950366973877 length of segment : 337 time for calcul the mask position with numpy : 0.0004024505615234375 nb_pixel_total : 19379 time to create 1 rle with old method : 0.022886276245117188 length of segment : 132 time for calcul the mask position with numpy : 0.0008900165557861328 nb_pixel_total : 46699 time to create 1 rle with old method : 0.05510544776916504 length of segment : 244 time for calcul the mask position with numpy : 0.00036334991455078125 nb_pixel_total : 15312 time to create 1 rle with old method : 0.018182992935180664 length of segment : 200 time for calcul the mask position with numpy : 0.0006184577941894531 nb_pixel_total : 30494 time to create 1 rle with old method : 0.03548169136047363 length of segment : 217 time for calcul the mask position with numpy : 0.0008692741394042969 nb_pixel_total : 51807 time to create 1 rle with old method : 0.059627532958984375 length of segment : 272 time for calcul the mask position with numpy : 0.002178668975830078 nb_pixel_total : 119979 time to create 1 rle with old method : 0.14130735397338867 length of segment : 283 time for calcul the mask position with numpy : 0.0011394023895263672 nb_pixel_total : 43995 time to create 1 rle with old method : 0.051363229751586914 length of segment : 196 time for calcul the mask position with numpy : 0.0006890296936035156 nb_pixel_total : 28286 time to create 1 rle with old method : 0.03320908546447754 length of segment : 227 time for calcul the mask position with numpy : 0.0029058456420898438 nb_pixel_total : 122077 time to create 1 rle with old method : 0.13890814781188965 length of segment : 636 time for calcul the mask position with numpy : 0.0008921623229980469 nb_pixel_total : 50422 time to create 1 rle with old method : 0.058028221130371094 length of segment : 386 time for calcul the mask position with numpy : 0.0002799034118652344 nb_pixel_total : 9692 time to create 1 rle with old method : 0.011393547058105469 length of segment : 208 time for calcul the mask position with numpy : 0.0005292892456054688 nb_pixel_total : 26441 time to create 1 rle with old method : 0.03322911262512207 length of segment : 150 time for calcul the mask position with numpy : 0.0011453628540039062 nb_pixel_total : 61565 time to create 1 rle with old method : 0.06955122947692871 length of segment : 372 time for calcul the mask position with numpy : 0.0010797977447509766 nb_pixel_total : 48247 time to create 1 rle with old method : 0.056081295013427734 length of segment : 353 time for calcul the mask position with numpy : 0.002888202667236328 nb_pixel_total : 141855 time to create 1 rle with old method : 0.19170856475830078 length of segment : 505 time for calcul the mask position with numpy : 0.0007479190826416016 nb_pixel_total : 28905 time to create 1 rle with old method : 0.03343915939331055 length of segment : 275 time for calcul the mask position with numpy : 0.0016336441040039062 nb_pixel_total : 83131 time to create 1 rle with old method : 0.09451913833618164 length of segment : 506 time for calcul the mask position with numpy : 0.0009126663208007812 nb_pixel_total : 46891 time to create 1 rle with old method : 0.05447077751159668 length of segment : 310 time for calcul the mask position with numpy : 0.0008609294891357422 nb_pixel_total : 41958 time to create 1 rle with old method : 0.049265384674072266 length of segment : 263 time for calcul the mask position with numpy : 0.0010178089141845703 nb_pixel_total : 48743 time to create 1 rle with old method : 0.05647850036621094 length of segment : 290 time for calcul the mask position with numpy : 0.0010581016540527344 nb_pixel_total : 38119 time to create 1 rle with old method : 0.04743504524230957 length of segment : 295 time for calcul the mask position with numpy : 0.00028443336486816406 nb_pixel_total : 11473 time to create 1 rle with old method : 0.014048099517822266 length of segment : 154 time for calcul the mask position with numpy : 0.0012733936309814453 nb_pixel_total : 67427 time to create 1 rle with old method : 0.07657051086425781 length of segment : 432 time for calcul the mask position with numpy : 0.0004305839538574219 nb_pixel_total : 10841 time to create 1 rle with old method : 0.0177004337310791 length of segment : 166 time for calcul the mask position with numpy : 0.0006124973297119141 nb_pixel_total : 27466 time to create 1 rle with old method : 0.03673124313354492 length of segment : 227 time for calcul the mask position with numpy : 0.0010914802551269531 nb_pixel_total : 56688 time to create 1 rle with old method : 0.06601452827453613 length of segment : 536 time for calcul the mask position with numpy : 0.0013446807861328125 nb_pixel_total : 36923 time to create 1 rle with old method : 0.042917490005493164 length of segment : 495 time for calcul the mask position with numpy : 0.0012536048889160156 nb_pixel_total : 53647 time to create 1 rle with old method : 0.06388211250305176 length of segment : 311 time for calcul the mask position with numpy : 0.0006227493286132812 nb_pixel_total : 13904 time to create 1 rle with old method : 0.015880107879638672 length of segment : 362 time for calcul the mask position with numpy : 0.0011353492736816406 nb_pixel_total : 54929 time to create 1 rle with old method : 0.06337928771972656 length of segment : 456 time for calcul the mask position with numpy : 0.000293731689453125 nb_pixel_total : 12716 time to create 1 rle with old method : 0.014531850814819336 length of segment : 152 time for calcul the mask position with numpy : 0.00244903564453125 nb_pixel_total : 105978 time to create 1 rle with old method : 0.12364840507507324 length of segment : 669 time for calcul the mask position with numpy : 0.000957489013671875 nb_pixel_total : 43033 time to create 1 rle with old method : 0.05159878730773926 length of segment : 187 time for calcul the mask position with numpy : 0.0002548694610595703 nb_pixel_total : 8481 time to create 1 rle with old method : 0.01011204719543457 length of segment : 126 time for calcul the mask position with numpy : 0.002485036849975586 nb_pixel_total : 21150 time to create 1 rle with old method : 0.02548813819885254 length of segment : 472 time for calcul the mask position with numpy : 0.0036194324493408203 nb_pixel_total : 83863 time to create 1 rle with old method : 0.0951995849609375 length of segment : 274 time for calcul the mask position with numpy : 0.0008533000946044922 nb_pixel_total : 13545 time to create 1 rle with old method : 0.01592397689819336 length of segment : 150 time for calcul the mask position with numpy : 0.0019054412841796875 nb_pixel_total : 28421 time to create 1 rle with old method : 0.03280949592590332 length of segment : 226 time for calcul the mask position with numpy : 0.00342559814453125 nb_pixel_total : 57882 time to create 1 rle with old method : 0.06584024429321289 length of segment : 250 time for calcul the mask position with numpy : 0.0026459693908691406 nb_pixel_total : 54522 time to create 1 rle with old method : 0.06308531761169434 length of segment : 275 time for calcul the mask position with numpy : 0.0028591156005859375 nb_pixel_total : 46000 time to create 1 rle with old method : 0.05275678634643555 length of segment : 260 time for calcul the mask position with numpy : 0.0021262168884277344 nb_pixel_total : 37785 time to create 1 rle with old method : 0.04474472999572754 length of segment : 148 time for calcul the mask position with numpy : 0.001489877700805664 nb_pixel_total : 17999 time to create 1 rle with old method : 0.021059274673461914 length of segment : 257 time for calcul the mask position with numpy : 0.004166841506958008 nb_pixel_total : 44053 time to create 1 rle with old method : 0.08427000045776367 length of segment : 275 time for calcul the mask position with numpy : 0.012467384338378906 nb_pixel_total : 114580 time to create 1 rle with old method : 0.15293335914611816 length of segment : 363 time for calcul the mask position with numpy : 0.011194705963134766 nb_pixel_total : 147611 time to create 1 rle with old method : 0.16750431060791016 length of segment : 580 time for calcul the mask position with numpy : 0.002058744430541992 nb_pixel_total : 35153 time to create 1 rle with old method : 0.04227280616760254 length of segment : 178 time for calcul the mask position with numpy : 0.0003228187561035156 nb_pixel_total : 13885 time to create 1 rle with old method : 0.01915144920349121 length of segment : 109 time for calcul the mask position with numpy : 0.0017740726470947266 nb_pixel_total : 30296 time to create 1 rle with old method : 0.03544139862060547 length of segment : 314 time for calcul the mask position with numpy : 0.0010602474212646484 nb_pixel_total : 15818 time to create 1 rle with old method : 0.02672600746154785 length of segment : 133 time for calcul the mask position with numpy : 0.002785205841064453 nb_pixel_total : 42627 time to create 1 rle with old method : 0.04913687705993652 length of segment : 370 time for calcul the mask position with numpy : 0.002590656280517578 nb_pixel_total : 27096 time to create 1 rle with old method : 0.03131508827209473 length of segment : 450 time for calcul the mask position with numpy : 0.004489421844482422 nb_pixel_total : 80465 time to create 1 rle with old method : 0.09629178047180176 length of segment : 371 time for calcul the mask position with numpy : 0.0017673969268798828 nb_pixel_total : 27596 time to create 1 rle with old method : 0.0324244499206543 length of segment : 215 time for calcul the mask position with numpy : 0.0019390583038330078 nb_pixel_total : 30011 time to create 1 rle with old method : 0.04138493537902832 length of segment : 316 time for calcul the mask position with numpy : 0.0035164356231689453 nb_pixel_total : 49514 time to create 1 rle with old method : 0.06263995170593262 length of segment : 275 time for calcul the mask position with numpy : 0.0023229122161865234 nb_pixel_total : 37084 time to create 1 rle with old method : 0.04394102096557617 length of segment : 361 time for calcul the mask position with numpy : 0.0004124641418457031 nb_pixel_total : 9539 time to create 1 rle with old method : 0.011382102966308594 length of segment : 212 time for calcul the mask position with numpy : 0.0005457401275634766 nb_pixel_total : 11731 time to create 1 rle with old method : 0.013674736022949219 length of segment : 253 time for calcul the mask position with numpy : 0.0005636215209960938 nb_pixel_total : 11382 time to create 1 rle with old method : 0.013583898544311523 length of segment : 117 time for calcul the mask position with numpy : 0.00577855110168457 nb_pixel_total : 112482 time to create 1 rle with old method : 0.12885475158691406 length of segment : 452 time for calcul the mask position with numpy : 0.0007846355438232422 nb_pixel_total : 11693 time to create 1 rle with old method : 0.013763666152954102 length of segment : 185 time for calcul the mask position with numpy : 0.007736682891845703 nb_pixel_total : 96014 time to create 1 rle with old method : 0.11897826194763184 length of segment : 317 time for calcul the mask position with numpy : 0.013056039810180664 nb_pixel_total : 276009 time to create 1 rle with new method : 0.014619827270507812 length of segment : 888 time for calcul the mask position with numpy : 0.0037217140197753906 nb_pixel_total : 79345 time to create 1 rle with old method : 0.09004569053649902 length of segment : 402 time for calcul the mask position with numpy : 0.0005412101745605469 nb_pixel_total : 18968 time to create 1 rle with old method : 0.021933794021606445 length of segment : 188 time for calcul the mask position with numpy : 0.0008003711700439453 nb_pixel_total : 13009 time to create 1 rle with old method : 0.015307188034057617 length of segment : 126 time for calcul the mask position with numpy : 0.0010528564453125 nb_pixel_total : 19416 time to create 1 rle with old method : 0.023723125457763672 length of segment : 95 time for calcul the mask position with numpy : 0.004307270050048828 nb_pixel_total : 14628 time to create 1 rle with old method : 0.01818537712097168 length of segment : 237 time for calcul the mask position with numpy : 0.003365755081176758 nb_pixel_total : 48461 time to create 1 rle with old method : 0.059015512466430664 length of segment : 374 time for calcul the mask position with numpy : 0.003330230712890625 nb_pixel_total : 53791 time to create 1 rle with old method : 0.0713963508605957 length of segment : 347 time for calcul the mask position with numpy : 0.001766204833984375 nb_pixel_total : 49589 time to create 1 rle with old method : 0.060964107513427734 length of segment : 277 time for calcul the mask position with numpy : 0.0015337467193603516 nb_pixel_total : 24105 time to create 1 rle with old method : 0.03023529052734375 length of segment : 210 time for calcul the mask position with numpy : 0.005866289138793945 nb_pixel_total : 53085 time to create 1 rle with old method : 0.07839035987854004 length of segment : 260 time for calcul the mask position with numpy : 0.001634359359741211 nb_pixel_total : 26292 time to create 1 rle with old method : 0.03178000450134277 length of segment : 208 time for calcul the mask position with numpy : 0.0016489028930664062 nb_pixel_total : 26941 time to create 1 rle with old method : 0.0314173698425293 length of segment : 198 time for calcul the mask position with numpy : 0.0011742115020751953 nb_pixel_total : 25151 time to create 1 rle with old method : 0.029459238052368164 length of segment : 157 time for calcul the mask position with numpy : 0.0011208057403564453 nb_pixel_total : 21667 time to create 1 rle with old method : 0.02840447425842285 length of segment : 213 time for calcul the mask position with numpy : 0.0019495487213134766 nb_pixel_total : 37997 time to create 1 rle with old method : 0.0479736328125 length of segment : 286 time for calcul the mask position with numpy : 0.001018524169921875 nb_pixel_total : 12349 time to create 1 rle with old method : 0.014635801315307617 length of segment : 229 time for calcul the mask position with numpy : 0.0007832050323486328 nb_pixel_total : 16679 time to create 1 rle with old method : 0.019910335540771484 length of segment : 184 time for calcul the mask position with numpy : 0.0022842884063720703 nb_pixel_total : 47869 time to create 1 rle with old method : 0.054564476013183594 length of segment : 281 time for calcul the mask position with numpy : 0.0018415451049804688 nb_pixel_total : 37338 time to create 1 rle with old method : 0.046427011489868164 length of segment : 190 time for calcul the mask position with numpy : 0.0016198158264160156 nb_pixel_total : 26888 time to create 1 rle with old method : 0.031781911849975586 length of segment : 320 time for calcul the mask position with numpy : 0.00821375846862793 nb_pixel_total : 191067 time to create 1 rle with new method : 0.012707233428955078 length of segment : 583 time for calcul the mask position with numpy : 0.0007109642028808594 nb_pixel_total : 16572 time to create 1 rle with old method : 0.02467823028564453 length of segment : 199 time for calcul the mask position with numpy : 0.0006029605865478516 nb_pixel_total : 9213 time to create 1 rle with old method : 0.011301517486572266 length of segment : 97 time for calcul the mask position with numpy : 0.002351522445678711 nb_pixel_total : 64234 time to create 1 rle with old method : 0.07609677314758301 length of segment : 178 time for calcul the mask position with numpy : 0.003767728805541992 nb_pixel_total : 68485 time to create 1 rle with old method : 0.07848238945007324 length of segment : 347 time for calcul the mask position with numpy : 0.002213001251220703 nb_pixel_total : 61800 time to create 1 rle with old method : 0.07155895233154297 length of segment : 211 time for calcul the mask position with numpy : 0.0013473033905029297 nb_pixel_total : 24574 time to create 1 rle with old method : 0.0285491943359375 length of segment : 269 time for calcul the mask position with numpy : 0.00267791748046875 nb_pixel_total : 60508 time to create 1 rle with old method : 0.06962800025939941 length of segment : 536 time for calcul the mask position with numpy : 0.001657247543334961 nb_pixel_total : 35967 time to create 1 rle with old method : 0.07884979248046875 length of segment : 130 time for calcul the mask position with numpy : 0.0015826225280761719 nb_pixel_total : 20199 time to create 1 rle with old method : 0.023877620697021484 length of segment : 144 time for calcul the mask position with numpy : 0.00038504600524902344 nb_pixel_total : 8161 time to create 1 rle with old method : 0.009773969650268555 length of segment : 81 time for calcul the mask position with numpy : 0.0006411075592041016 nb_pixel_total : 21725 time to create 1 rle with old method : 0.025866031646728516 length of segment : 197 time for calcul the mask position with numpy : 0.0012853145599365234 nb_pixel_total : 10565 time to create 1 rle with old method : 0.01239323616027832 length of segment : 176 time for calcul the mask position with numpy : 0.0027163028717041016 nb_pixel_total : 51090 time to create 1 rle with old method : 0.059850454330444336 length of segment : 234 time for calcul the mask position with numpy : 0.0027055740356445312 nb_pixel_total : 53176 time to create 1 rle with old method : 0.06140756607055664 length of segment : 251 time for calcul the mask position with numpy : 0.004519462585449219 nb_pixel_total : 96036 time to create 1 rle with old method : 0.10973000526428223 length of segment : 620 time for calcul the mask position with numpy : 0.0025489330291748047 nb_pixel_total : 35560 time to create 1 rle with old method : 0.04077339172363281 length of segment : 188 time for calcul the mask position with numpy : 0.0028679370880126953 nb_pixel_total : 36566 time to create 1 rle with old method : 0.043428897857666016 length of segment : 435 time for calcul the mask position with numpy : 0.0042307376861572266 nb_pixel_total : 67669 time to create 1 rle with old method : 0.07915186882019043 length of segment : 318 time for calcul the mask position with numpy : 0.0019516944885253906 nb_pixel_total : 27828 time to create 1 rle with old method : 0.046668052673339844 length of segment : 212 time for calcul the mask position with numpy : 0.0007293224334716797 nb_pixel_total : 10938 time to create 1 rle with old method : 0.013344287872314453 length of segment : 94 time for calcul the mask position with numpy : 0.0060045719146728516 nb_pixel_total : 130573 time to create 1 rle with old method : 0.15015077590942383 length of segment : 476 time for calcul the mask position with numpy : 0.0007789134979248047 nb_pixel_total : 10016 time to create 1 rle with old method : 0.011904716491699219 length of segment : 166 time for calcul the mask position with numpy : 0.0007357597351074219 nb_pixel_total : 14036 time to create 1 rle with old method : 0.01723003387451172 length of segment : 100 time for calcul the mask position with numpy : 0.00033473968505859375 nb_pixel_total : 4660 time to create 1 rle with old method : 0.006188392639160156 length of segment : 67 time for calcul the mask position with numpy : 0.0015113353729248047 nb_pixel_total : 28907 time to create 1 rle with old method : 0.037343502044677734 length of segment : 215 time for calcul the mask position with numpy : 0.0011546611785888672 nb_pixel_total : 24430 time to create 1 rle with old method : 0.02808547019958496 length of segment : 208 time for calcul the mask position with numpy : 0.003232717514038086 nb_pixel_total : 81772 time to create 1 rle with old method : 0.09459185600280762 length of segment : 496 time for calcul the mask position with numpy : 0.010771989822387695 nb_pixel_total : 340469 time to create 1 rle with new method : 0.01679205894470215 length of segment : 547 time for calcul the mask position with numpy : 0.0013265609741210938 nb_pixel_total : 25661 time to create 1 rle with old method : 0.029793977737426758 length of segment : 197 time for calcul the mask position with numpy : 0.001004934310913086 nb_pixel_total : 25489 time to create 1 rle with old method : 0.029929637908935547 length of segment : 262 time for calcul the mask position with numpy : 0.004195213317871094 nb_pixel_total : 83836 time to create 1 rle with old method : 0.09842300415039062 length of segment : 670 time for calcul the mask position with numpy : 0.003369569778442383 nb_pixel_total : 58471 time to create 1 rle with old method : 0.0943608283996582 length of segment : 333 time for calcul the mask position with numpy : 0.0013427734375 nb_pixel_total : 23594 time to create 1 rle with old method : 0.02761077880859375 length of segment : 198 time for calcul the mask position with numpy : 0.024712562561035156 nb_pixel_total : 509224 time to create 1 rle with new method : 0.036581993103027344 length of segment : 795 time for calcul the mask position with numpy : 0.0016205310821533203 nb_pixel_total : 25334 time to create 1 rle with old method : 0.02903437614440918 length of segment : 431 time for calcul the mask position with numpy : 0.0027463436126708984 nb_pixel_total : 104136 time to create 1 rle with old method : 0.11965298652648926 length of segment : 341 time for calcul the mask position with numpy : 0.0021424293518066406 nb_pixel_total : 34139 time to create 1 rle with old method : 0.04162001609802246 length of segment : 316 time for calcul the mask position with numpy : 0.0023992061614990234 nb_pixel_total : 50953 time to create 1 rle with old method : 0.059339284896850586 length of segment : 406 time for calcul the mask position with numpy : 0.003021717071533203 nb_pixel_total : 41919 time to create 1 rle with old method : 0.07467389106750488 length of segment : 343 time for calcul the mask position with numpy : 0.00757908821105957 nb_pixel_total : 158337 time to create 1 rle with new method : 0.011148691177368164 length of segment : 731 time for calcul the mask position with numpy : 0.0009357929229736328 nb_pixel_total : 17968 time to create 1 rle with old method : 0.020946979522705078 length of segment : 156 time for calcul the mask position with numpy : 0.00186920166015625 nb_pixel_total : 32481 time to create 1 rle with old method : 0.03730487823486328 length of segment : 309 time for calcul the mask position with numpy : 0.0017709732055664062 nb_pixel_total : 40942 time to create 1 rle with old method : 0.04759335517883301 length of segment : 280 time for calcul the mask position with numpy : 0.0017964839935302734 nb_pixel_total : 26851 time to create 1 rle with old method : 0.0391082763671875 length of segment : 205 time for calcul the mask position with numpy : 0.0012166500091552734 nb_pixel_total : 17336 time to create 1 rle with old method : 0.020898818969726562 length of segment : 184 time for calcul the mask position with numpy : 0.0027008056640625 nb_pixel_total : 53073 time to create 1 rle with old method : 0.06079697608947754 length of segment : 591 time for calcul the mask position with numpy : 0.0011162757873535156 nb_pixel_total : 22795 time to create 1 rle with old method : 0.029855012893676758 length of segment : 189 time for calcul the mask position with numpy : 0.0007941722869873047 nb_pixel_total : 18510 time to create 1 rle with old method : 0.02265453338623047 length of segment : 142 time for calcul the mask position with numpy : 0.004095315933227539 nb_pixel_total : 72990 time to create 1 rle with old method : 0.10778427124023438 length of segment : 378 time for calcul the mask position with numpy : 0.0025453567504882812 nb_pixel_total : 48079 time to create 1 rle with old method : 0.05599617958068848 length of segment : 307 time for calcul the mask position with numpy : 0.0021119117736816406 nb_pixel_total : 29980 time to create 1 rle with old method : 0.03562593460083008 length of segment : 636 time for calcul the mask position with numpy : 0.0008943080902099609 nb_pixel_total : 15053 time to create 1 rle with old method : 0.018514156341552734 length of segment : 152 time for calcul the mask position with numpy : 0.0012066364288330078 nb_pixel_total : 20802 time to create 1 rle with old method : 0.024983882904052734 length of segment : 167 time spent for convertir_results : 22.0608229637146 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 176 chid ids of type : 3594 Number RLEs to save : 54106 save missing photos in datou_result : time spend for datou_step_exec : 102.77026176452637 time spend to save output : 3.3516595363616943 total time spend for step 1 : 106.12192130088806 step2:crop_condition Wed May 14 15:42:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 176 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 154 About to insert : list_path_to_insert length 154 new photo from crops ! About to upload 154 photos upload in portfolio : 3736932 init cache_photo without model_param we have 154 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747230175_3250526 we have uploaded 154 photos in the portfolio 3736932 time of upload the photos Elapsed time : 36.82894039154053 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747230218_3250526 we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.0238354206085205 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747230237_3250526 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.432999610900879 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747230240_3250526 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6609044075012207 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747230243_3250526 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5865201950073242 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1358230013, 1358230008, 1358230000, 1358229962, 1358229957, 1358229952, 1358229949] Looping around the photos to save general results len do output : 176 /1358245446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358245953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358246321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358246322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358246326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358246328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358246330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358246389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358246392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358246457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230013', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230008', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230000', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229962', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229957', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229952', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229949', None, None, None, None, None, '2849713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 535 time used for this insertion : 0.03441023826599121 save_final save missing photos in datou_result : time spend for datou_step_exec : 109.19688940048218 time spend to save output : 0.039310455322265625 total time spend for step 2 : 109.23619985580444 step3:rle_unique_nms_with_priority Wed May 14 15:44:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 176 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 5.557689666748047 time for calcul the mask position with numpy : 0.5759820938110352 nb_pixel_total : 4960982 time to create 1 rle with new method : 0.64058518409729 time for calcul the mask position with numpy : 0.15215468406677246 nb_pixel_total : 2526852 time to create 1 rle with new method : 0.8285007476806641 time for calcul the mask position with numpy : 0.028391599655151367 nb_pixel_total : 41596 time to create 1 rle with old method : 0.04971671104431152 time for calcul the mask position with numpy : 0.030526399612426758 nb_pixel_total : 8845 time to create 1 rle with old method : 0.014686107635498047 time for calcul the mask position with numpy : 0.03242945671081543 nb_pixel_total : 49078 time to create 1 rle with old method : 0.06573915481567383 time for calcul the mask position with numpy : 0.03099799156188965 nb_pixel_total : 103711 time to create 1 rle with old method : 0.1264653205871582 time for calcul the mask position with numpy : 0.03148841857910156 nb_pixel_total : 207180 time to create 1 rle with new method : 1.006178379058838 time for calcul the mask position with numpy : 0.02782726287841797 nb_pixel_total : 43999 time to create 1 rle with old method : 0.0547327995300293 time for calcul the mask position with numpy : 0.027185678482055664 nb_pixel_total : 30809 time to create 1 rle with old method : 0.03877878189086914 time for calcul the mask position with numpy : 0.028473854064941406 nb_pixel_total : 88900 time to create 1 rle with old method : 0.10816335678100586 time for calcul the mask position with numpy : 0.030097484588623047 nb_pixel_total : 108161 time to create 1 rle with old method : 0.12435793876647949 time for calcul the mask position with numpy : 0.026962757110595703 nb_pixel_total : 64399 time to create 1 rle with old method : 0.07409477233886719 time for calcul the mask position with numpy : 0.027857065200805664 nb_pixel_total : 59888 time to create 1 rle with old method : 0.07252693176269531 create new chi : 4.355614185333252 time to delete rle : 0.02303171157836914 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 11917 TO DO : save crop sub photo not yet done ! save time : 0.7420899868011475 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 7.046581029891968 time for calcul the mask position with numpy : 0.7593464851379395 nb_pixel_total : 7117909 time to create 1 rle with new method : 1.426313877105713 time for calcul the mask position with numpy : 0.027062177658081055 nb_pixel_total : 8399 time to create 1 rle with old method : 0.00980520248413086 time for calcul the mask position with numpy : 0.029159069061279297 nb_pixel_total : 44440 time to create 1 rle with old method : 0.05414915084838867 time for calcul the mask position with numpy : 0.027051687240600586 nb_pixel_total : 9826 time to create 1 rle with old method : 0.011220455169677734 time for calcul the mask position with numpy : 0.026160717010498047 nb_pixel_total : 30583 time to create 1 rle with old method : 0.039626121520996094 time for calcul the mask position with numpy : 0.03548121452331543 nb_pixel_total : 646775 time to create 1 rle with new method : 1.1865928173065186 time for calcul the mask position with numpy : 0.03194880485534668 nb_pixel_total : 27025 time to create 1 rle with old method : 0.0484156608581543 time for calcul the mask position with numpy : 0.03898811340332031 nb_pixel_total : 17192 time to create 1 rle with old method : 0.03215837478637695 time for calcul the mask position with numpy : 0.037499427795410156 nb_pixel_total : 78749 time to create 1 rle with old method : 0.14255619049072266 time for calcul the mask position with numpy : 0.04476594924926758 nb_pixel_total : 10170 time to create 1 rle with old method : 0.024669170379638672 time for calcul the mask position with numpy : 0.03571820259094238 nb_pixel_total : 30096 time to create 1 rle with old method : 0.05483722686767578 time for calcul the mask position with numpy : 0.03330087661743164 nb_pixel_total : 27545 time to create 1 rle with old method : 0.050987958908081055 time for calcul the mask position with numpy : 0.03724312782287598 nb_pixel_total : 75597 time to create 1 rle with old method : 0.13547182083129883 time for calcul the mask position with numpy : 0.036590576171875 nb_pixel_total : 12982 time to create 1 rle with old method : 0.0217287540435791 time for calcul the mask position with numpy : 0.03080582618713379 nb_pixel_total : 36106 time to create 1 rle with old method : 0.04123330116271973 time for calcul the mask position with numpy : 0.029468059539794922 nb_pixel_total : 35152 time to create 1 rle with old method : 0.040613412857055664 time for calcul the mask position with numpy : 0.0288088321685791 nb_pixel_total : 85854 time to create 1 rle with old method : 0.09937191009521484 create new chi : 4.802564859390259 time to delete rle : 0.0016286373138427734 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 11353 TO DO : save crop sub photo not yet done ! save time : 0.6994016170501709 nb_obj : 27 nb_hashtags : 4 time to prepare the origin masks : 4.996994495391846 time for calcul the mask position with numpy : 0.5669183731079102 nb_pixel_total : 6705297 time to create 1 rle with new method : 0.9716362953186035 time for calcul the mask position with numpy : 0.03557944297790527 nb_pixel_total : 24776 time to create 1 rle with old method : 0.030580759048461914 time for calcul the mask position with numpy : 0.03558468818664551 nb_pixel_total : 26441 time to create 1 rle with old method : 0.030228853225708008 time for calcul the mask position with numpy : 0.034746408462524414 nb_pixel_total : 43995 time to create 1 rle with old method : 0.049855947494506836 time for calcul the mask position with numpy : 0.0355989933013916 nb_pixel_total : 121371 time to create 1 rle with old method : 0.14157319068908691 time for calcul the mask position with numpy : 0.03955221176147461 nb_pixel_total : 19379 time to create 1 rle with old method : 0.026991605758666992 time for calcul the mask position with numpy : 0.04033207893371582 nb_pixel_total : 50422 time to create 1 rle with old method : 0.05966782569885254 time for calcul the mask position with numpy : 0.03546500205993652 nb_pixel_total : 8909 time to create 1 rle with old method : 0.010149478912353516 time for calcul the mask position with numpy : 0.03447532653808594 nb_pixel_total : 51807 time to create 1 rle with old method : 0.060616254806518555 time for calcul the mask position with numpy : 0.035941123962402344 nb_pixel_total : 28286 time to create 1 rle with old method : 0.03205418586730957 time for calcul the mask position with numpy : 0.0381474494934082 nb_pixel_total : 79182 time to create 1 rle with old method : 0.08951759338378906 time for calcul the mask position with numpy : 0.034380197525024414 nb_pixel_total : 48753 time to create 1 rle with old method : 0.05487799644470215 time for calcul the mask position with numpy : 0.03427290916442871 nb_pixel_total : 61565 time to create 1 rle with old method : 0.06966996192932129 time for calcul the mask position with numpy : 0.03483271598815918 nb_pixel_total : 119979 time to create 1 rle with old method : 0.13821935653686523 time for calcul the mask position with numpy : 0.03405642509460449 nb_pixel_total : 15312 time to create 1 rle with old method : 0.017307043075561523 time for calcul the mask position with numpy : 0.0339970588684082 nb_pixel_total : 37256 time to create 1 rle with old method : 0.042616844177246094 time for calcul the mask position with numpy : 0.03406929969787598 nb_pixel_total : 9692 time to create 1 rle with old method : 0.011031866073608398 time for calcul the mask position with numpy : 0.03443551063537598 nb_pixel_total : 106301 time to create 1 rle with old method : 0.12044906616210938 time for calcul the mask position with numpy : 0.03634285926818848 nb_pixel_total : 83131 time to create 1 rle with old method : 0.09574460983276367 time for calcul the mask position with numpy : 0.03521442413330078 nb_pixel_total : 46699 time to create 1 rle with old method : 0.0532383918762207 time for calcul the mask position with numpy : 0.034836530685424805 nb_pixel_total : 20391 time to create 1 rle with old method : 0.023487091064453125 time for calcul the mask position with numpy : 0.03727245330810547 nb_pixel_total : 242437 time to create 1 rle with new method : 0.8282814025878906 time for calcul the mask position with numpy : 0.034487247467041016 nb_pixel_total : 48247 time to create 1 rle with old method : 0.05540180206298828 time for calcul the mask position with numpy : 0.034259796142578125 nb_pixel_total : 11793 time to create 1 rle with old method : 0.013289928436279297 time for calcul the mask position with numpy : 0.03449058532714844 nb_pixel_total : 28905 time to create 1 rle with old method : 0.03294706344604492 time for calcul the mask position with numpy : 0.035083770751953125 nb_pixel_total : 137122 time to create 1 rle with old method : 0.15338444709777832 time for calcul the mask position with numpy : 0.03433942794799805 nb_pixel_total : 30487 time to create 1 rle with old method : 0.03438067436218262 time for calcul the mask position with numpy : 0.03467106819152832 nb_pixel_total : 86465 time to create 1 rle with old method : 0.09750127792358398 create new chi : 4.939077615737915 time to delete rle : 0.004091739654541016 batch 1 Loaded 55 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 19016 TO DO : save crop sub photo not yet done ! save time : 1.3921420574188232 nb_obj : 18 nb_hashtags : 2 time to prepare the origin masks : 8.558029890060425 time for calcul the mask position with numpy : 0.47348594665527344 nb_pixel_total : 7607437 time to create 1 rle with new method : 1.0710699558258057 time for calcul the mask position with numpy : 0.04201030731201172 nb_pixel_total : 10193 time to create 1 rle with old method : 0.017221689224243164 time for calcul the mask position with numpy : 0.045577287673950195 nb_pixel_total : 8481 time to create 1 rle with old method : 0.012879133224487305 time for calcul the mask position with numpy : 0.041072845458984375 nb_pixel_total : 43033 time to create 1 rle with old method : 0.04880499839782715 time for calcul the mask position with numpy : 0.041471004486083984 nb_pixel_total : 105978 time to create 1 rle with old method : 0.12668895721435547 time for calcul the mask position with numpy : 0.05616140365600586 nb_pixel_total : 12716 time to create 1 rle with old method : 0.02054738998413086 time for calcul the mask position with numpy : 0.043662071228027344 nb_pixel_total : 54529 time to create 1 rle with old method : 0.06669974327087402 time for calcul the mask position with numpy : 0.0481562614440918 nb_pixel_total : 11857 time to create 1 rle with old method : 0.013476848602294922 time for calcul the mask position with numpy : 0.04035592079162598 nb_pixel_total : 53647 time to create 1 rle with old method : 0.060259342193603516 time for calcul the mask position with numpy : 0.04122138023376465 nb_pixel_total : 36923 time to create 1 rle with old method : 0.0419306755065918 time for calcul the mask position with numpy : 0.0321047306060791 nb_pixel_total : 56688 time to create 1 rle with old method : 0.06592345237731934 time for calcul the mask position with numpy : 0.026702165603637695 nb_pixel_total : 27466 time to create 1 rle with old method : 0.03216958045959473 time for calcul the mask position with numpy : 0.026822566986083984 nb_pixel_total : 10841 time to create 1 rle with old method : 0.012689352035522461 time for calcul the mask position with numpy : 0.02641773223876953 nb_pixel_total : 67427 time to create 1 rle with old method : 0.09452486038208008 time for calcul the mask position with numpy : 0.02881908416748047 nb_pixel_total : 11473 time to create 1 rle with old method : 0.013566970825195312 time for calcul the mask position with numpy : 0.030355453491210938 nb_pixel_total : 38119 time to create 1 rle with old method : 0.04657626152038574 time for calcul the mask position with numpy : 0.02700328826904297 nb_pixel_total : 48743 time to create 1 rle with old method : 0.055264949798583984 time for calcul the mask position with numpy : 0.028152942657470703 nb_pixel_total : 41958 time to create 1 rle with old method : 0.04985499382019043 time for calcul the mask position with numpy : 0.028566837310791016 nb_pixel_total : 46891 time to create 1 rle with old method : 0.05315566062927246 create new chi : 3.072328805923462 time to delete rle : 0.0021233558654785156 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++Number RLEs to save : 13310 TO DO : save crop sub photo not yet done ! save time : 0.8301606178283691 nb_obj : 42 nb_hashtags : 3 time to prepare the origin masks : 5.150968790054321 time for calcul the mask position with numpy : 0.4226388931274414 nb_pixel_total : 6291393 time to create 1 rle with new method : 1.2828993797302246 time for calcul the mask position with numpy : 0.03418779373168945 nb_pixel_total : 49514 time to create 1 rle with old method : 0.055121421813964844 time for calcul the mask position with numpy : 0.03360724449157715 nb_pixel_total : 54522 time to create 1 rle with old method : 0.06064176559448242 time for calcul the mask position with numpy : 0.03432726860046387 nb_pixel_total : 276009 time to create 1 rle with new method : 0.7147543430328369 time for calcul the mask position with numpy : 0.037084102630615234 nb_pixel_total : 28421 time to create 1 rle with old method : 0.03200554847717285 time for calcul the mask position with numpy : 0.03428220748901367 nb_pixel_total : 26292 time to create 1 rle with old method : 0.028900861740112305 time for calcul the mask position with numpy : 0.03304123878479004 nb_pixel_total : 18767 time to create 1 rle with old method : 0.020632028579711914 time for calcul the mask position with numpy : 0.03399085998535156 nb_pixel_total : 17999 time to create 1 rle with old method : 0.019681215286254883 time for calcul the mask position with numpy : 0.032817840576171875 nb_pixel_total : 15818 time to create 1 rle with old method : 0.01737499237060547 time for calcul the mask position with numpy : 0.033262014389038086 nb_pixel_total : 27596 time to create 1 rle with old method : 0.02999138832092285 time for calcul the mask position with numpy : 0.03256416320800781 nb_pixel_total : 11128 time to create 1 rle with old method : 0.012261152267456055 time for calcul the mask position with numpy : 0.03332686424255371 nb_pixel_total : 25151 time to create 1 rle with old method : 0.028359174728393555 time for calcul the mask position with numpy : 0.034975290298461914 nb_pixel_total : 13009 time to create 1 rle with old method : 0.01929450035095215 time for calcul the mask position with numpy : 0.03659653663635254 nb_pixel_total : 49589 time to create 1 rle with old method : 0.0555417537689209 time for calcul the mask position with numpy : 0.03488445281982422 nb_pixel_total : 147611 time to create 1 rle with old method : 0.17200040817260742 time for calcul the mask position with numpy : 0.03539729118347168 nb_pixel_total : 83863 time to create 1 rle with old method : 0.09261226654052734 time for calcul the mask position with numpy : 0.0341181755065918 nb_pixel_total : 57882 time to create 1 rle with old method : 0.06792593002319336 time for calcul the mask position with numpy : 0.03461432456970215 nb_pixel_total : 79345 time to create 1 rle with old method : 0.09528970718383789 time for calcul the mask position with numpy : 0.04068183898925781 nb_pixel_total : 53791 time to create 1 rle with old method : 0.07530832290649414 time for calcul the mask position with numpy : 0.03606581687927246 nb_pixel_total : 26941 time to create 1 rle with old method : 0.030776262283325195 time for calcul the mask position with numpy : 0.03639483451843262 nb_pixel_total : 48461 time to create 1 rle with old method : 0.05660414695739746 time for calcul the mask position with numpy : 0.03593277931213379 nb_pixel_total : 96014 time to create 1 rle with old method : 0.1111605167388916 time for calcul the mask position with numpy : 0.03398895263671875 nb_pixel_total : 46000 time to create 1 rle with old method : 0.05211687088012695 time for calcul the mask position with numpy : 0.034056901931762695 nb_pixel_total : 30011 time to create 1 rle with old method : 0.033865928649902344 time for calcul the mask position with numpy : 0.036743879318237305 nb_pixel_total : 35153 time to create 1 rle with old method : 0.03913760185241699 time for calcul the mask position with numpy : 0.03397393226623535 nb_pixel_total : 44053 time to create 1 rle with old method : 0.049430131912231445 time for calcul the mask position with numpy : 0.03348374366760254 nb_pixel_total : 27096 time to create 1 rle with old method : 0.03011178970336914 time for calcul the mask position with numpy : 0.03332948684692383 nb_pixel_total : 11693 time to create 1 rle with old method : 0.01304173469543457 time for calcul the mask position with numpy : 0.0334012508392334 nb_pixel_total : 14628 time to create 1 rle with old method : 0.01670360565185547 time for calcul the mask position with numpy : 0.033796072006225586 nb_pixel_total : 37084 time to create 1 rle with old method : 0.041083335876464844 time for calcul the mask position with numpy : 0.03415346145629883 nb_pixel_total : 112482 time to create 1 rle with old method : 0.12261509895324707 time for calcul the mask position with numpy : 0.03309464454650879 nb_pixel_total : 30296 time to create 1 rle with old method : 0.03261303901672363 time for calcul the mask position with numpy : 0.03317451477050781 nb_pixel_total : 80465 time to create 1 rle with old method : 0.0887751579284668 time for calcul the mask position with numpy : 0.03800082206726074 nb_pixel_total : 114580 time to create 1 rle with old method : 0.13614201545715332 time for calcul the mask position with numpy : 0.03492021560668945 nb_pixel_total : 42627 time to create 1 rle with old method : 0.06787633895874023 time for calcul the mask position with numpy : 0.03527712821960449 nb_pixel_total : 9539 time to create 1 rle with old method : 0.010871171951293945 time for calcul the mask position with numpy : 0.03407168388366699 nb_pixel_total : 11382 time to create 1 rle with old method : 0.012886285781860352 time for calcul the mask position with numpy : 0.03409314155578613 nb_pixel_total : 259 time to create 1 rle with old method : 0.00032901763916015625 time for calcul the mask position with numpy : 0.03410530090332031 nb_pixel_total : 19416 time to create 1 rle with old method : 0.02190399169921875 time for calcul the mask position with numpy : 0.03415799140930176 nb_pixel_total : 24105 time to create 1 rle with old method : 0.027457237243652344 time for calcul the mask position with numpy : 0.03438544273376465 nb_pixel_total : 53085 time to create 1 rle with old method : 0.060010433197021484 time for calcul the mask position with numpy : 0.03436994552612305 nb_pixel_total : 13545 time to create 1 rle with old method : 0.01727747917175293 time for calcul the mask position with numpy : 0.0346531867980957 nb_pixel_total : 37785 time to create 1 rle with old method : 0.04427695274353027 create new chi : 5.940292596817017 time to delete rle : 0.003511667251586914 batch 1 Loaded 85 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 25132 TO DO : save crop sub photo not yet done ! save time : 1.6235027313232422 nb_obj : 34 nb_hashtags : 3 time to prepare the origin masks : 4.62454628944397 time for calcul the mask position with numpy : 0.9624574184417725 nb_pixel_total : 6909246 time to create 1 rle with new method : 1.2486572265625 time for calcul the mask position with numpy : 0.03615593910217285 nb_pixel_total : 20199 time to create 1 rle with old method : 0.02292633056640625 time for calcul the mask position with numpy : 0.03440380096435547 nb_pixel_total : 26888 time to create 1 rle with old method : 0.03400421142578125 time for calcul the mask position with numpy : 0.03486967086791992 nb_pixel_total : 37997 time to create 1 rle with old method : 0.043031930923461914 time for calcul the mask position with numpy : 0.03476452827453613 nb_pixel_total : 47869 time to create 1 rle with old method : 0.05429434776306152 time for calcul the mask position with numpy : 0.03687572479248047 nb_pixel_total : 24574 time to create 1 rle with old method : 0.0280153751373291 time for calcul the mask position with numpy : 0.03804802894592285 nb_pixel_total : 36560 time to create 1 rle with old method : 0.043395042419433594 time for calcul the mask position with numpy : 0.0386509895324707 nb_pixel_total : 35560 time to create 1 rle with old method : 0.040192365646362305 time for calcul the mask position with numpy : 0.034390926361083984 nb_pixel_total : 21667 time to create 1 rle with old method : 0.025517940521240234 time for calcul the mask position with numpy : 0.035744667053222656 nb_pixel_total : 96036 time to create 1 rle with old method : 0.11467838287353516 time for calcul the mask position with numpy : 0.03483152389526367 nb_pixel_total : 10565 time to create 1 rle with old method : 0.012240409851074219 time for calcul the mask position with numpy : 0.034848928451538086 nb_pixel_total : 67669 time to create 1 rle with old method : 0.0766751766204834 time for calcul the mask position with numpy : 0.03482651710510254 nb_pixel_total : 51090 time to create 1 rle with old method : 0.05800604820251465 time for calcul the mask position with numpy : 0.03451895713806152 nb_pixel_total : 37338 time to create 1 rle with old method : 0.04260611534118652 time for calcul the mask position with numpy : 0.034380197525024414 nb_pixel_total : 12349 time to create 1 rle with old method : 0.01421976089477539 time for calcul the mask position with numpy : 0.0350642204284668 nb_pixel_total : 24430 time to create 1 rle with old method : 0.02779364585876465 time for calcul the mask position with numpy : 0.0341181755065918 nb_pixel_total : 60508 time to create 1 rle with old method : 0.07870841026306152 time for calcul the mask position with numpy : 0.04059767723083496 nb_pixel_total : 190910 time to create 1 rle with new method : 0.8884987831115723 time for calcul the mask position with numpy : 0.034453630447387695 nb_pixel_total : 28907 time to create 1 rle with old method : 0.034581899642944336 time for calcul the mask position with numpy : 0.03510475158691406 nb_pixel_total : 68485 time to create 1 rle with old method : 0.07763671875 time for calcul the mask position with numpy : 0.03519129753112793 nb_pixel_total : 130573 time to create 1 rle with old method : 0.14680910110473633 time for calcul the mask position with numpy : 0.04952192306518555 nb_pixel_total : 53176 time to create 1 rle with old method : 0.06188511848449707 time for calcul the mask position with numpy : 0.03643321990966797 nb_pixel_total : 16572 time to create 1 rle with old method : 0.021866559982299805 time for calcul the mask position with numpy : 0.03533458709716797 nb_pixel_total : 4657 time to create 1 rle with old method : 0.005330324172973633 time for calcul the mask position with numpy : 0.034811973571777344 nb_pixel_total : 10938 time to create 1 rle with old method : 0.012857675552368164 time for calcul the mask position with numpy : 0.03501582145690918 nb_pixel_total : 21725 time to create 1 rle with old method : 0.027138471603393555 time for calcul the mask position with numpy : 0.03510904312133789 nb_pixel_total : 16679 time to create 1 rle with old method : 0.029999732971191406 time for calcul the mask position with numpy : 0.060787200927734375 nb_pixel_total : 10016 time to create 1 rle with old method : 0.019189119338989258 time for calcul the mask position with numpy : 0.03515768051147461 nb_pixel_total : 27828 time to create 1 rle with old method : 0.03437995910644531 time for calcul the mask position with numpy : 0.03478288650512695 nb_pixel_total : 61800 time to create 1 rle with old method : 0.07032227516174316 time for calcul the mask position with numpy : 0.0345919132232666 nb_pixel_total : 9213 time to create 1 rle with old method : 0.010548830032348633 time for calcul the mask position with numpy : 0.03752017021179199 nb_pixel_total : 64234 time to create 1 rle with old method : 0.0822911262512207 time for calcul the mask position with numpy : 0.034651994705200195 nb_pixel_total : 35967 time to create 1 rle with old method : 0.04086756706237793 time for calcul the mask position with numpy : 0.03442978858947754 nb_pixel_total : 8139 time to create 1 rle with old method : 0.009271860122680664 time for calcul the mask position with numpy : 0.034424781799316406 nb_pixel_total : 14036 time to create 1 rle with old method : 0.016011953353881836 create new chi : 5.828500747680664 time to delete rle : 0.0031952857971191406 batch 1 Loaded 69 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 18969 TO DO : save crop sub photo not yet done ! save time : 1.3737475872039795 nb_obj : 27 nb_hashtags : 2 time to prepare the origin masks : 4.933391094207764 time for calcul the mask position with numpy : 1.2866430282592773 nb_pixel_total : 6322636 time to create 1 rle with new method : 1.207118034362793 time for calcul the mask position with numpy : 0.03363323211669922 nb_pixel_total : 15053 time to create 1 rle with old method : 0.01694178581237793 time for calcul the mask position with numpy : 0.03361034393310547 nb_pixel_total : 34139 time to create 1 rle with old method : 0.0379643440246582 time for calcul the mask position with numpy : 0.03565192222595215 nb_pixel_total : 81772 time to create 1 rle with old method : 0.11533164978027344 time for calcul the mask position with numpy : 0.03617286682128906 nb_pixel_total : 29980 time to create 1 rle with old method : 0.03432607650756836 time for calcul the mask position with numpy : 0.03580117225646973 nb_pixel_total : 26851 time to create 1 rle with old method : 0.04329228401184082 time for calcul the mask position with numpy : 0.03863930702209473 nb_pixel_total : 23594 time to create 1 rle with old method : 0.02693319320678711 time for calcul the mask position with numpy : 0.03479957580566406 nb_pixel_total : 72990 time to create 1 rle with old method : 0.08441352844238281 time for calcul the mask position with numpy : 0.034448862075805664 nb_pixel_total : 58471 time to create 1 rle with old method : 0.06618118286132812 time for calcul the mask position with numpy : 0.03440403938293457 nb_pixel_total : 25661 time to create 1 rle with old method : 0.029168128967285156 time for calcul the mask position with numpy : 0.03451871871948242 nb_pixel_total : 41919 time to create 1 rle with old method : 0.047612667083740234 time for calcul the mask position with numpy : 0.034264564514160156 nb_pixel_total : 17968 time to create 1 rle with old method : 0.020482778549194336 time for calcul the mask position with numpy : 0.03436708450317383 nb_pixel_total : 40942 time to create 1 rle with old method : 0.046659231185913086 time for calcul the mask position with numpy : 0.039438724517822266 nb_pixel_total : 50953 time to create 1 rle with old method : 0.05698132514953613 time for calcul the mask position with numpy : 0.034752607345581055 nb_pixel_total : 48079 time to create 1 rle with old method : 0.05631422996520996 time for calcul the mask position with numpy : 0.034813880920410156 nb_pixel_total : 158337 time to create 1 rle with new method : 1.9317913055419922 time for calcul the mask position with numpy : 0.03534746170043945 nb_pixel_total : 104136 time to create 1 rle with old method : 0.12209820747375488 time for calcul the mask position with numpy : 0.0343623161315918 nb_pixel_total : 22795 time to create 1 rle with old method : 0.02842116355895996 time for calcul the mask position with numpy : 0.04205203056335449 nb_pixel_total : 509224 time to create 1 rle with new method : 1.2680346965789795 time for calcul the mask position with numpy : 0.03748154640197754 nb_pixel_total : 17336 time to create 1 rle with old method : 0.021044254302978516 time for calcul the mask position with numpy : 0.03484654426574707 nb_pixel_total : 20802 time to create 1 rle with old method : 0.023669719696044922 time for calcul the mask position with numpy : 0.037529945373535156 nb_pixel_total : 340469 time to create 1 rle with new method : 0.5341939926147461 time for calcul the mask position with numpy : 0.03605246543884277 nb_pixel_total : 83836 time to create 1 rle with old method : 0.09471726417541504 time for calcul the mask position with numpy : 0.03388476371765137 nb_pixel_total : 53073 time to create 1 rle with old method : 0.08384919166564941 time for calcul the mask position with numpy : 0.03432798385620117 nb_pixel_total : 25334 time to create 1 rle with old method : 0.028595924377441406 time for calcul the mask position with numpy : 0.03565716743469238 nb_pixel_total : 24051 time to create 1 rle with old method : 0.02766275405883789 time for calcul the mask position with numpy : 0.0354917049407959 nb_pixel_total : 25489 time to create 1 rle with old method : 0.034563302993774414 time for calcul the mask position with numpy : 0.045929908752441406 nb_pixel_total : 18510 time to create 1 rle with old method : 0.020967721939086914 create new chi : 8.5019690990448 time to delete rle : 0.00420069694519043 batch 1 Loaded 55 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++Number RLEs to save : 21494 TO DO : save crop sub photo not yet done ! save time : 1.5066876411437988 map_output_result : {1358230013: (0.0, 'Should be the crop_list due to order', 0), 1358230008: (0.0, 'Should be the crop_list due to order', 0), 1358230000: (0.0, 'Should be the crop_list due to order', 0), 1358229962: (0.0, 'Should be the crop_list due to order', 0), 1358229957: (0.0, 'Should be the crop_list due to order', 0), 1358229952: (0.0, 'Should be the crop_list due to order', 0), 1358229949: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1358230013, 1358230008, 1358230000, 1358229962, 1358229957, 1358229952, 1358229949] Looping around the photos to save general results len do output : 7 /1358230013.Didn't retrieve data . /1358230008.Didn't retrieve data . /1358230000.Didn't retrieve data . /1358229962.Didn't retrieve data . /1358229957.Didn't retrieve data . /1358229952.Didn't retrieve data . /1358229949.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230013', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230008', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230000', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229962', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229957', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229952', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229949', None, None, None, None, None, '2849713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.01192164421081543 save_final save missing photos in datou_result : time spend for datou_step_exec : 87.64509963989258 time spend to save output : 0.012386798858642578 total time spend for step 3 : 87.65748643875122 step4:ventilate_hashtags_in_portfolio Wed May 14 15:45:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22967499 get user id for portfolio 22967499 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22967499 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','metal','pehd','pet_clair','autre','background','pet_fonce','carton','environnement','papier','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22967499 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','metal','pehd','pet_clair','autre','background','pet_fonce','carton','environnement','papier','flou')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22967499 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','metal','pehd','pet_clair','autre','background','pet_fonce','carton','environnement','papier','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22968181,22968182,22968183,22968184,22968185,22968186,22968187,22968188,22968189,22968190,22968191?tags=mal_croppe,metal,pehd,pet_clair,autre,background,pet_fonce,carton,environnement,papier,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1358230013, 1358230008, 1358230000, 1358229962, 1358229957, 1358229952, 1358229949] Looping around the photos to save general results len do output : 1 /22967499. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230013', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230008', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230000', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229962', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229957', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229952', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229949', None, None, None, None, None, '2849713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014971494674682617 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7577993869781494 time spend to save output : 0.015358924865722656 total time spend for step 4 : 0.7731583118438721 step5:final Wed May 14 15:45:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1358230013: ('0.20919277722663138',), 1358230008: ('0.20919277722663138',), 1358230000: ('0.20919277722663138',), 1358229962: ('0.20919277722663138',), 1358229957: ('0.20919277722663138',), 1358229952: ('0.20919277722663138',), 1358229949: ('0.20919277722663138',)} new output for save of step final : {1358230013: ('0.20919277722663138',), 1358230008: ('0.20919277722663138',), 1358230000: ('0.20919277722663138',), 1358229962: ('0.20919277722663138',), 1358229957: ('0.20919277722663138',), 1358229952: ('0.20919277722663138',), 1358229949: ('0.20919277722663138',)} [1358230013, 1358230008, 1358230000, 1358229962, 1358229957, 1358229952, 1358229949] Looping around the photos to save general results len do output : 7 /1358230013.Didn't retrieve data . /1358230008.Didn't retrieve data . /1358230000.Didn't retrieve data . /1358229962.Didn't retrieve data . /1358229957.Didn't retrieve data . /1358229952.Didn't retrieve data . /1358229949.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230013', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230008', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230000', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229962', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229957', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229952', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229949', None, None, None, None, None, '2849713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.013680219650268555 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14447355270385742 time spend to save output : 0.014151573181152344 total time spend for step 5 : 0.15862512588500977 step6:blur_detection Wed May 14 15:45:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd.jpg resize: (2160, 3840) 1358230013 -5.703144233681357 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f.jpg resize: (2160, 3840) 1358230008 -5.634693716894509 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd.jpg resize: (2160, 3840) 1358230000 -5.983833055277924 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe.jpg resize: (2160, 3840) 1358229962 -6.027672264324065 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9.jpg resize: (2160, 3840) 1358229957 -6.700758265412159 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83.jpg resize: (2160, 3840) 1358229952 -5.894280956995328 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626.jpg resize: (2160, 3840) 1358229949 -6.4629848806183645 treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419016_0.png resize: (316, 294) 1358245446 -4.710847649882978 treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419019_0.png resize: (279, 504) 1358245447 -3.8340877983101125 treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419018_0.png resize: (428, 410) 1358245450 -4.930782166325159 treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419022_0.png resize: (481, 832) 1358245452 -4.231174983347006 treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419026_0.png resize: (172, 307) 1358245453 -2.450473704201466 treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419023_0.png resize: (290, 498) 1358245455 -4.916440787324504 treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419025_0.png resize: (246, 208) 1358245458 -4.958699518035264 treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419017_0.png resize: (298, 289) 1358245459 -5.279074694292399 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419028_0.png resize: (319, 445) 1358245461 -0.4614921748754938 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419042_0.png resize: (207, 275) 1358245463 -2.284643876548389 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419035_0.png resize: (78, 286) 1358245465 -4.047394349515659 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419037_0.png resize: (198, 134) 1358245467 0.11978962362418391 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419034_0.png resize: (317, 190) 1358245470 -2.9245731122663416 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419036_0.png resize: (340, 372) 1358245472 -5.128217761201381 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419032_0.png resize: (395, 314) 1358245473 -0.5920062758219495 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419030_0.png resize: (150, 341) 1358245475 1.988542650965427 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419043_0.png resize: (170, 113) 1358245478 -2.84728705267741 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419033_0.png resize: (221, 237) 1358245480 -3.326710099996712 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419040_0.png resize: (251, 323) 1358245481 -2.5839971988040857 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419038_0.png resize: (370, 99) 1358245484 -3.7723128598671534 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419029_0.png resize: (312, 191) 1358245486 -2.552647094041476 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419061_0.png resize: (217, 191) 1358245487 -2.3772953925621274 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419056_0.png resize: (195, 103) 1358245490 -4.065106590779857 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419052_0.png resize: (449, 144) 1358245491 -1.6964822517150915 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419069_0.png resize: (208, 250) 1358245493 -3.5413293847474825 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419049_0.png resize: (94, 139) 1358245494 -1.353433073991387 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419050_0.png resize: (155, 145) 1358245497 -1.133963668533633 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419058_0.png resize: (272, 270) 1358245499 -3.3953160691708586 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419060_0.png resize: (196, 357) 1358245500 -0.21422672017030614 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419051_0.png resize: (457, 759) 1358245503 -2.9805921555795 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419055_0.png resize: (244, 306) 1358245505 -2.1919270084171076 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419068_0.png resize: (419, 586) 1358245506 -3.0476778754394016 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419063_0.png resize: (298, 257) 1358245509 -1.0279316427960659 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419057_0.png resize: (215, 221) 1358245510 1.2460357188039812 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419045_0.png resize: (391, 402) 1358245512 -1.6060131910646416 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419062_0.png resize: (584, 364) 1358245513 -3.506068092514943 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419064_0.png resize: (208, 71) 1358245516 -3.5070970494819806 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419070_0.png resize: (358, 394) 1358245518 -3.4387073188664905 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419046_0.png resize: (287, 275) 1358245519 -0.5457949721359736 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419067_0.png resize: (267, 276) 1358245522 -3.4230787319873586 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419065_0.png resize: (143, 268) 1358245523 -1.2543623800800956 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419053_0.png resize: (317, 462) 1358245525 -2.7928457146382604 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419085_0.png resize: (618, 293) 1358245527 -1.7040003006051105 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419083_0.png resize: (342, 323) 1358245529 -3.5116866074816766 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419079_0.png resize: (333, 318) 1358245531 -3.3353074996727363 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419073_0.png resize: (261, 282) 1358245532 -2.8436056629915174 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419086_0.png resize: (169, 371) 1358245535 -1.3460010609677613 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419077_0.png resize: (162, 128) 1358245537 -2.7117396032945527 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419071_0.png resize: (310, 267) 1358245539 -3.9072081818406295 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419076_0.png resize: (397, 240) 1358245541 -0.2036150516115725 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419082_0.png resize: (359, 64) 1358245542 -2.7743994448309266 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419088_0.png resize: (564, 404) 1358245544 0.1839138523286368 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419072_0.png resize: (227, 300) 1358245547 -1.9922823233326703 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419084_0.png resize: (146, 110) 1358245548 -3.9484809841839903 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419074_0.png resize: (281, 284) 1358245550 0.9364149189357462 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419087_0.png resize: (126, 98) 1358245552 -1.502366847585774 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419075_0.png resize: (131, 127) 1358245554 -0.29604953286253416 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419078_0.png resize: (226, 195) 1358245555 -3.0941830370519057 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419080_0.png resize: (364, 254) 1358245557 -3.818485826005543 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419129_0.png resize: (192, 221) 1358245560 -0.6794739482356175 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419123_0.png resize: (363, 214) 1358245561 -2.850190994554548 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419097_0.png resize: (268, 233) 1358245564 -0.4421688549108491 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419102_0.png resize: (221, 209) 1358245567 -2.7534410256306394 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419106_0.png resize: (359, 321) 1358245568 -4.182132619916762 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419122_0.png resize: (180, 444) 1358245569 -3.0138029416172514 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419125_0.png resize: (277, 226) 1358245571 -3.065833486073951 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419098_0.png resize: (331, 492) 1358245574 -2.1280987528905873 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419091_0.png resize: (226, 207) 1358245575 -0.24862299243792021 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419099_0.png resize: (538, 439) 1358245577 -0.7481666248854424 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419109_0.png resize: (263, 282) 1358245580 -2.6027548685719597 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419119_0.png resize: (181, 156) 1358245581 -3.6596102673572983 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419094_0.png resize: (249, 292) 1358245582 0.37118478152728174 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419101_0.png resize: (105, 160) 1358245584 -0.7210584691684028 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419110_0.png resize: (339, 156) 1358245587 -3.2949387261795615 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419093_0.png resize: (275, 246) 1358245588 -2.9334624281703428 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419089_0.png resize: (267, 356) 1358245590 1.936372252526651 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419111_0.png resize: (189, 89) 1358245593 -4.220552565559353 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419104_0.png resize: (269, 214) 1358245594 -3.640822352544495 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419113_0.png resize: (116, 124) 1358245595 -0.9185172781788365 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419092_0.png resize: (244, 365) 1358245598 -0.9930733116504004 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419090_0.png resize: (147, 111) 1358245600 -2.6092289433213907 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419116_0.png resize: (243, 693) 1358245601 -0.8719731543757882 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419103_0.png resize: (127, 184) 1358245603 -1.2589114003115744 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419114_0.png resize: (422, 457) 1358245606 -2.410314496106874 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419124_0.png resize: (300, 285) 1358245607 -2.3414286909642117 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419105_0.png resize: (293, 191) 1358245609 -1.8132452411428592 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419096_0.png resize: (257, 93) 1358245611 -0.017535167439352666 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419120_0.png resize: (126, 130) 1358245613 -0.18167430923715136 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419127_0.png resize: (160, 457) 1358245614 -4.718676022341283 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419108_0.png resize: (313, 138) 1358245616 -2.223539040932449 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419121_0.png resize: (92, 308) 1358245619 -1.6129857821350289 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419115_0.png resize: (184, 93) 1358245620 -4.46874009002853 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419095_0.png resize: (139, 359) 1358245622 -3.0051527825898554 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419128_0.png resize: (205, 206) 1358245625 -2.7617077416480695 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419100_0.png resize: (178, 288) 1358245626 -1.9345595001457323 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419107_0.png resize: (213, 182) 1358245628 -2.9628784234241605 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419118_0.png resize: (402, 266) 1358245630 -4.626015223685093 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419112_0.png resize: (252, 71) 1358245632 -3.5820825613836407 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419117_0.png resize: (744, 543) 1358245634 -4.133772196396009 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419142_0.png resize: (314, 416) 1358245636 -1.6459052004270642 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419135_0.png resize: (277, 255) 1358245639 -0.056950692771161625 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419154_0.png resize: (187, 327) 1358245640 -2.8721909385934294 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419143_0.png resize: (203, 425) 1358245642 -3.08384092425497 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419159_0.png resize: (388, 458) 1358245645 -3.8749986869764417 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419137_0.png resize: (320, 139) 1358245646 -2.8460634575589068 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419136_0.png resize: (162, 329) 1358245647 -2.3224574158700233 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419148_0.png resize: (76, 130) 1358245649 -3.880531279390919 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419131_0.png resize: (212, 143) 1358245653 1.2181798428980726 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419155_0.png resize: (306, 219) 1358245654 -2.8852698160276464 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419146_0.png resize: (127, 321) 1358245656 2.355161056376578 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419151_0.png resize: (214, 381) 1358245659 -3.4733821269768734 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419149_0.png resize: (115, 267) 1358245661 -1.5702602568797572 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419141_0.png resize: (171, 563) 1358245663 -3.6021476641778936 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419152_0.png resize: (249, 357) 1358245666 -2.8960354743183276 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419164_0.png resize: (189, 169) 1358245667 0.19372307243270942 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419158_0.png resize: (83, 198) 1358245668 -2.691642918812152 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419162_0.png resize: (48, 179) 1358245670 -0.2925995407107901 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419163_0.png resize: (215, 185) 1358245673 -3.2567260677306713 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419139_0.png resize: (199, 117) 1358245674 -0.8444275333393487 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419140_0.png resize: (97, 122) 1358245676 1.7046864536277064 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419145_0.png resize: (405, 301) 1358245679 -3.3015364692402325 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419144_0.png resize: (266, 122) 1358245680 -2.410088595127128 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419161_0.png resize: (95, 234) 1358245682 -2.7165993095227177 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419156_0.png resize: (294, 361) 1358245684 -2.4648734036422204 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419138_0.png resize: (562, 506) 1358245685 -3.9120282698059383 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419157_0.png resize: (174, 220) 1358245686 -4.728205415102641 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419134_0.png resize: (173, 155) 1358245689 -2.0605122877567754 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419160_0.png resize: (165, 105) 1358245690 -3.5292251695949384 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419150_0.png resize: (176, 158) 1358245691 -4.023583889951306 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419178_0.png resize: (552, 457) 1358245693 -1.887276231438647 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419190_0.png resize: (150, 166) 1358245695 -2.5419503797727256 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419181_0.png resize: (247, 272) 1358245696 -2.7216132596291875 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419184_0.png resize: (399, 210) 1358245698 -3.4247977133306478 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419191_0.png resize: (166, 223) 1358245700 -0.3961245821133731 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419173_0.png resize: (365, 134) 1358245701 -3.5754205926848086 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419180_0.png resize: (309, 165) 1358245702 -1.41521584067261 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419171_0.png resize: (209, 202) 1358245705 -1.5786895342627902 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419166_0.png resize: (527, 803) 1358245706 -4.084388030096762 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419188_0.png resize: (304, 330) 1358245707 0.5085802809163462 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419183_0.png resize: (184, 165) 1358245709 -2.000530494901932 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419165_0.png resize: (327, 373) 1358245711 -0.9402620524835538 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419185_0.png resize: (183, 206) 1358245712 -1.8808251792361796 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419170_0.png resize: (299, 302) 1358245714 -0.9817202309245359 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419168_0.png resize: (262, 135) 1358245716 -1.402889347425097 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419172_0.png resize: (741, 1039) 1358245717 -2.939229454320949 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419174_0.png resize: (341, 475) 1358245718 -3.5796956186732225 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419186_0.png resize: (107, 245) 1358245721 -3.713669698227475 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419177_0.png resize: (285, 232) 1358245722 -2.4666624552382515 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419179_0.png resize: (142, 199) 1358245723 -4.134792213591497 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419187_0.png resize: (316, 464) 1358245725 -3.4545008558698878 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419169_0.png resize: (387, 373) 1358245727 -2.737357740402507 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419182_0.png resize: (205, 178) 1358245728 -3.0289038370803945 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419175_0.png resize: (316, 170) 1358245729 -3.8906630957913713 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419176_0.png resize: (356, 239) 1358245732 -0.8546108268835025 treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419020_0.png resize: (130, 330) 1358245928 -4.306891372604731 treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419021_0.png resize: (263, 222) 1358245929 -4.67253784007746 treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419024_0.png resize: (262, 265) 1358245931 -3.8990538042831155 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419031_0.png resize: (93, 159) 1358245934 -3.573228077707814 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419039_0.png resize: (780, 1061) 1358245935 -5.199629327105436 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419054_0.png resize: (131, 206) 1358245937 -0.1232291750154614 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419044_0.png resize: (143, 222) 1358245940 -1.4081681319002637 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419066_0.png resize: (372, 255) 1358245941 -3.982821185392484 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419126_0.png resize: (160, 229) 1358245943 -4.610675991716414 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419147_0.png resize: (144, 196) 1358245945 -4.033522515662747 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419132_0.png resize: (236, 227) 1358245947 -3.0843475998432694 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419133_0.png resize: (197, 96) 1358245948 -3.512200790847872 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419167_0.png resize: (196, 178) 1358245950 -3.652276946523716 treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419189_0.png resize: (339, 166) 1358245953 -3.351776115139585 treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419027_0.png resize: (1862, 2416) 1358246321 -4.3541902354347215 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419059_0.png resize: (259, 646) 1358246322 -3.6798399014214094 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419048_0.png resize: (461, 360) 1358246326 -4.951308489706274 treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419081_0.png resize: (278, 291) 1358246328 -3.663103978747685 treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419153_0.png resize: (554, 260) 1358246330 -3.478048096358911 treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419041_0.png resize: (137, 163) 1358246389 -4.122209098169839 treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419047_0.png resize: (176, 142) 1358246392 -0.8281684846186994 treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419130_0.png resize: (157, 209) 1358246457 -4.564764274513253 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 183 time used for this insertion : 0.019962549209594727 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 183 time used for this insertion : 0.032768964767456055 save missing photos in datou_result : time spend for datou_step_exec : 37.71178364753723 time spend to save output : 0.05937457084655762 total time spend for step 6 : 37.77115821838379 step7:brightness Wed May 14 15:46:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd.jpg treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f.jpg treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd.jpg treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe.jpg treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9.jpg treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83.jpg treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626.jpg treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419016_0.png treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419019_0.png treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419018_0.png treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419022_0.png treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419026_0.png treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419023_0.png treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419025_0.png treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419017_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419028_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419042_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419035_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419037_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419034_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419036_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419032_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419030_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419043_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419033_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419040_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419038_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419029_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419061_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419056_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419052_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419069_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419049_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419050_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419058_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419060_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419051_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419055_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419068_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419063_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419057_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419045_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419062_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419064_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419070_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419046_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419067_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419065_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419053_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419085_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419083_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419079_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419073_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419086_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419077_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419071_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419076_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419082_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419088_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419072_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419084_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419074_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419087_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419075_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419078_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419080_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419129_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419123_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419097_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419102_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419106_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419122_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419125_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419098_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419091_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419099_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419109_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419119_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419094_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419101_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419110_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419093_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419089_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419111_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419104_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419113_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419092_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419090_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419116_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419103_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419114_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419124_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419105_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419096_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419120_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419127_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419108_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419121_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419115_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419095_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419128_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419100_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419107_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419118_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419112_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419117_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419142_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419135_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419154_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419143_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419159_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419137_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419136_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419148_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419131_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419155_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419146_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419151_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419149_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419141_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419152_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419164_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419158_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419162_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419163_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419139_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419140_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419145_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419144_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419161_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419156_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419138_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419157_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419134_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419160_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419150_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419178_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419190_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419181_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419184_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419191_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419173_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419180_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419171_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419166_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419188_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419183_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419165_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419185_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419170_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419168_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419172_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419174_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419186_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419177_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419179_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419187_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419169_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419182_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419175_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419176_0.png treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419020_0.png treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419021_0.png treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419024_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419031_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419039_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419054_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419044_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419066_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419126_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419147_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419132_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419133_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419167_0.png treat image : temp/1747230027_3250526_1358229949_7e874eea6673251ccdad22ff477ae626_rle_crop_3797419189_0.png treat image : temp/1747230027_3250526_1358230013_60419d0a633031db6d577365ddbcb7dd_rle_crop_3797419027_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419059_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419048_0.png treat image : temp/1747230027_3250526_1358229962_0aa00f5ed1ac96f74e21af0cb03e09fe_rle_crop_3797419081_0.png treat image : temp/1747230027_3250526_1358229952_6665a1725fd0229755b77c0a39dfad83_rle_crop_3797419153_0.png treat image : temp/1747230027_3250526_1358230008_1becea821baab378701d400ccb5e294f_rle_crop_3797419041_0.png treat image : temp/1747230027_3250526_1358230000_9363513448a65f6b8929b4eb723341dd_rle_crop_3797419047_0.png treat image : temp/1747230027_3250526_1358229957_64a9bab29854bb09eca278a20dee67c9_rle_crop_3797419130_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 183 time used for this insertion : 0.025571823120117188 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 183 time used for this insertion : 0.03961777687072754 save missing photos in datou_result : time spend for datou_step_exec : 9.688933849334717 time spend to save output : 0.0726618766784668 total time spend for step 7 : 9.761595726013184 step8:velours_tree Wed May 14 15:46:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.5442044734954834 time spend to save output : 5.173683166503906e-05 total time spend for step 8 : 0.5442562103271484 step9:send_mail_cod Wed May 14 15:46:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22967499_14-05-2025_15_46_20.pdf 22968181 imagette229681811747230380 22968182 imagette229681821747230380 22968183 imagette229681831747230380 22968184 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229681841747230380 22968185 change filename to text .change filename to text .imagette229681851747230380 22968186 imagette229681861747230380 22968187 change filename to text .imagette229681871747230380 22968188 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229681881747230381 22968190 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229681901747230382 22968191 imagette229681911747230383 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22967499 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22968181,22968182,22968183,22968184,22968185,22968186,22968187,22968188,22968189,22968190,22968191?tags=mal_croppe,metal,pehd,pet_clair,autre,background,pet_fonce,carton,environnement,papier,flou args[1358230013] : ((1358230013, -5.703144233681357, 492609224), (1358230013, -0.02996438515582042, 2107752395), '0.20919277722663138') We are sending mail with results at report@fotonower.com args[1358230008] : ((1358230008, -5.634693716894509, 492609224), (1358230008, 0.2926028185529179, 2107752395), '0.20919277722663138') We are sending mail with results at report@fotonower.com args[1358230000] : ((1358230000, -5.983833055277924, 492609224), (1358230000, 0.8416284898419579, 2107752395), '0.20919277722663138') We are sending mail with results at report@fotonower.com args[1358229962] : ((1358229962, -6.027672264324065, 492609224), (1358229962, 1.2797317796392993, 2107752395), '0.20919277722663138') We are sending mail with results at report@fotonower.com args[1358229957] : ((1358229957, -6.700758265412159, 492609224), (1358229957, 1.3689494436917304, 2107752395), '0.20919277722663138') We are sending mail with results at report@fotonower.com args[1358229952] : ((1358229952, -5.894280956995328, 492609224), (1358229952, 0.9158780344338958, 2107752395), '0.20919277722663138') We are sending mail with results at report@fotonower.com args[1358229949] : ((1358229949, -6.4629848806183645, 492609224), (1358229949, 1.6130856804341398, 2107752395), '0.20919277722663138') We are sending mail with results at report@fotonower.com refus_total : 0.20919277722663138 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22967499 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967499_14-05-2025_15_46_20.pdf results_Auto_P22967499_14-05-2025_15_46_20.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967499_14-05-2025_15_46_20.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22967499','results_Auto_P22967499_14-05-2025_15_46_20.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967499_14-05-2025_15_46_20.pdf','pdf','','0.91','0.20919277722663138') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22967499

https://www.fotonower.com/image?json=false&list_photos_id=1358230013
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358230008
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358230000
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358229962
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358229957
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358229952
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358229949
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 20.92%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/22968184?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22968185?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22968187?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22968188?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22968190?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967499_14-05-2025_15_46_20.pdf.

Lien vers velours :https://www.fotonower.com/velours/22968181,22968182,22968183,22968184,22968185,22968186,22968187,22968188,22968189,22968190,22968191?tags=mal_croppe,metal,pehd,pet_clair,autre,background,pet_fonce,carton,environnement,papier,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 14 May 2025 13:46:27 GMT Content-Length: 0 Connection: close X-Message-Id: xf32d3BLT0C-QAwvY61gew Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1358230013, 1358230008, 1358230000, 1358229962, 1358229957, 1358229952, 1358229949] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230013', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230008', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230000', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229962', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229957', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229952', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229949', None, None, None, None, None, '2849713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.021209001541137695 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.771119594573975 time spend to save output : 0.021390199661254883 total time spend for step 9 : 7.7925097942352295 step10:split_time_score Wed May 14 15:46:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14052025 22967499 Nombre de photos uploadées : 7 / 23040 (0%) 14052025 22967499 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 14052025 22967499 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 5.245208740234375e-06 elapsed_time : order_list_meta_photo_and_scores 1.4543533325195312e-05 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0004811286926269531 elapsed_time : insert_dashboard_record_day_entry 0.026721477508544922 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.15093270158179015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22948162_14-05-2025_07_47_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22948162 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22948162 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22948165 order by id desc limit 1 Qualite : 0.09967562451774692 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22949538_14-05-2025_08_24_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22949538 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22949538 AND mptpi.`type`=3594 To do Qualite : 0.19506076388888893 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22953035_14-05-2025_10_24_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22953035 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22953035 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22955733 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22958945 order by id desc limit 1 Qualite : 0.16447810169110086 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22960477_14-05-2025_13_05_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22960477 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22960477 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22967472 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22967479 order by id desc limit 1 Qualite : 0.20919277722663138 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967499_14-05-2025_15_46_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22967499 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22967499 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14052025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1358230013, 1358230008, 1358230000, 1358229962, 1358229957, 1358229952, 1358229949] Looping around the photos to save general results len do output : 1 /22967499Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230013', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230008', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358230000', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229962', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229957', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229952', None, None, None, None, None, '2849713') ('3318', None, None, None, None, None, None, None, '2849713') ('3318', '22967499', '1358229949', None, None, None, None, None, '2849713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013298749923706055 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.904568672180176 time spend to save output : 0.013557672500610352 total time spend for step 10 : 4.918126344680786 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 192.04user 113.12system 6:08.47elapsed 82%CPU (0avgtext+0avgdata 4820088maxresident)k 2738848inputs+173272outputs (24951major+15588520minor)pagefaults 0swaps