python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 304524 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2955248'] with mtr_portfolio_ids : ['23342743'] and first list_photo_ids : [] new path : /proc/304524/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.4498083591461182 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon May 26 16:30:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 7218 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-26 16:30:34.203384: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-26 16:30:34.231090: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-26 16:30:34.232579: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4c98000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-26 16:30:34.232601: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-26 16:30:34.235531: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-26 16:30:34.446444: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x38cfc830 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-26 16:30:34.446483: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-26 16:30:34.447515: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 16:30:34.447863: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 16:30:34.451027: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 16:30:34.453304: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 16:30:34.453629: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 16:30:34.456810: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 16:30:34.457912: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 16:30:34.464125: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 16:30:34.465609: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 16:30:34.465693: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 16:30:34.466476: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 16:30:34.466491: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 16:30:34.466500: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 16:30:34.468660: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-26 16:30:34.835121: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 16:30:34.835251: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 16:30:34.835273: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 16:30:34.835293: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 16:30:34.835311: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 16:30:34.835329: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 16:30:34.835346: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 16:30:34.835365: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 16:30:34.836960: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 16:30:34.838331: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 16:30:34.838369: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 16:30:34.838387: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 16:30:34.838404: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 16:30:34.838421: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 16:30:34.838438: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 16:30:34.838455: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 16:30:34.838472: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 16:30:34.840087: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 16:30:34.840122: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 16:30:34.840130: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 16:30:34.840137: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 16:30:34.841374: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-26 16:30:47.245786: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 16:30:47.425166: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 Detection mask done ! Trying to reset tf kernel 305329 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 417 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.003450155258178711 nb_pixel_total : 67612 time to create 1 rle with old method : 0.07898759841918945 length of segment : 422 time for calcul the mask position with numpy : 0.0007576942443847656 nb_pixel_total : 30200 time to create 1 rle with old method : 0.034554243087768555 length of segment : 125 time for calcul the mask position with numpy : 0.02039170265197754 nb_pixel_total : 325744 time to create 1 rle with new method : 0.05536293983459473 length of segment : 693 time for calcul the mask position with numpy : 0.002523183822631836 nb_pixel_total : 62067 time to create 1 rle with old method : 0.0966804027557373 length of segment : 463 time for calcul the mask position with numpy : 0.0021085739135742188 nb_pixel_total : 52928 time to create 1 rle with old method : 0.07022738456726074 length of segment : 405 time for calcul the mask position with numpy : 0.0027260780334472656 nb_pixel_total : 159372 time to create 1 rle with new method : 0.008426666259765625 length of segment : 802 time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 14604 time to create 1 rle with old method : 0.017508506774902344 length of segment : 107 time for calcul the mask position with numpy : 0.00037789344787597656 nb_pixel_total : 15343 time to create 1 rle with old method : 0.018472671508789062 length of segment : 185 time for calcul the mask position with numpy : 0.0011668205261230469 nb_pixel_total : 59058 time to create 1 rle with old method : 0.06810712814331055 length of segment : 421 time for calcul the mask position with numpy : 0.0007205009460449219 nb_pixel_total : 35542 time to create 1 rle with old method : 0.04488992691040039 length of segment : 356 time for calcul the mask position with numpy : 0.0009026527404785156 nb_pixel_total : 47279 time to create 1 rle with old method : 0.05686640739440918 length of segment : 224 time for calcul the mask position with numpy : 0.002250194549560547 nb_pixel_total : 95227 time to create 1 rle with old method : 0.10804533958435059 length of segment : 623 time for calcul the mask position with numpy : 0.001115560531616211 nb_pixel_total : 20797 time to create 1 rle with old method : 0.03907012939453125 length of segment : 380 time for calcul the mask position with numpy : 0.0003609657287597656 nb_pixel_total : 10003 time to create 1 rle with old method : 0.0119171142578125 length of segment : 213 time for calcul the mask position with numpy : 0.0008285045623779297 nb_pixel_total : 18418 time to create 1 rle with old method : 0.021439075469970703 length of segment : 306 time for calcul the mask position with numpy : 0.001622915267944336 nb_pixel_total : 37572 time to create 1 rle with old method : 0.04402327537536621 length of segment : 607 time for calcul the mask position with numpy : 0.0005223751068115234 nb_pixel_total : 26262 time to create 1 rle with old method : 0.02973628044128418 length of segment : 261 time for calcul the mask position with numpy : 0.0004837512969970703 nb_pixel_total : 22739 time to create 1 rle with old method : 0.02672576904296875 length of segment : 140 time for calcul the mask position with numpy : 0.0017881393432617188 nb_pixel_total : 59007 time to create 1 rle with old method : 0.09516739845275879 length of segment : 369 time for calcul the mask position with numpy : 0.00255584716796875 nb_pixel_total : 62667 time to create 1 rle with old method : 0.07105302810668945 length of segment : 349 time for calcul the mask position with numpy : 0.0034368038177490234 nb_pixel_total : 77303 time to create 1 rle with old method : 0.08860492706298828 length of segment : 537 time for calcul the mask position with numpy : 0.0019109249114990234 nb_pixel_total : 34766 time to create 1 rle with old method : 0.03929018974304199 length of segment : 327 time for calcul the mask position with numpy : 0.004092216491699219 nb_pixel_total : 61677 time to create 1 rle with old method : 0.07245397567749023 length of segment : 444 time for calcul the mask position with numpy : 0.0008544921875 nb_pixel_total : 26651 time to create 1 rle with old method : 0.03028082847595215 length of segment : 156 time for calcul the mask position with numpy : 0.0022704601287841797 nb_pixel_total : 69063 time to create 1 rle with old method : 0.0780482292175293 length of segment : 320 time for calcul the mask position with numpy : 0.0017118453979492188 nb_pixel_total : 41773 time to create 1 rle with old method : 0.04769158363342285 length of segment : 253 time for calcul the mask position with numpy : 0.0019342899322509766 nb_pixel_total : 35985 time to create 1 rle with old method : 0.0422663688659668 length of segment : 280 time for calcul the mask position with numpy : 0.0014889240264892578 nb_pixel_total : 29591 time to create 1 rle with old method : 0.03399515151977539 length of segment : 284 time for calcul the mask position with numpy : 0.0025022029876708984 nb_pixel_total : 46359 time to create 1 rle with old method : 0.05266761779785156 length of segment : 537 time for calcul the mask position with numpy : 0.0006420612335205078 nb_pixel_total : 18951 time to create 1 rle with old method : 0.02222466468811035 length of segment : 126 time for calcul the mask position with numpy : 0.0017278194427490234 nb_pixel_total : 43479 time to create 1 rle with old method : 0.04996967315673828 length of segment : 344 time for calcul the mask position with numpy : 0.0011219978332519531 nb_pixel_total : 26398 time to create 1 rle with old method : 0.031046152114868164 length of segment : 234 time for calcul the mask position with numpy : 0.0031576156616210938 nb_pixel_total : 125890 time to create 1 rle with old method : 0.14245128631591797 length of segment : 473 time for calcul the mask position with numpy : 0.0010006427764892578 nb_pixel_total : 25856 time to create 1 rle with old method : 0.029847383499145508 length of segment : 170 time for calcul the mask position with numpy : 0.0027430057525634766 nb_pixel_total : 74564 time to create 1 rle with old method : 0.0844416618347168 length of segment : 513 time for calcul the mask position with numpy : 0.0043866634368896484 nb_pixel_total : 123030 time to create 1 rle with old method : 0.13845157623291016 length of segment : 425 time for calcul the mask position with numpy : 0.003030061721801758 nb_pixel_total : 89898 time to create 1 rle with old method : 0.10204195976257324 length of segment : 309 time for calcul the mask position with numpy : 0.0006625652313232422 nb_pixel_total : 15345 time to create 1 rle with old method : 0.01786661148071289 length of segment : 140 time for calcul the mask position with numpy : 0.000614166259765625 nb_pixel_total : 16239 time to create 1 rle with old method : 0.019390583038330078 length of segment : 124 time for calcul the mask position with numpy : 0.004896640777587891 nb_pixel_total : 94859 time to create 1 rle with old method : 0.10958361625671387 length of segment : 562 time for calcul the mask position with numpy : 0.0012159347534179688 nb_pixel_total : 37961 time to create 1 rle with old method : 0.04478883743286133 length of segment : 171 time for calcul the mask position with numpy : 0.002898693084716797 nb_pixel_total : 92569 time to create 1 rle with old method : 0.10574007034301758 length of segment : 356 time for calcul the mask position with numpy : 0.0004973411560058594 nb_pixel_total : 11612 time to create 1 rle with old method : 0.01399993896484375 length of segment : 85 time for calcul the mask position with numpy : 0.0030896663665771484 nb_pixel_total : 74755 time to create 1 rle with old method : 0.08535456657409668 length of segment : 483 time for calcul the mask position with numpy : 0.0005238056182861328 nb_pixel_total : 12007 time to create 1 rle with old method : 0.015040159225463867 length of segment : 154 time for calcul the mask position with numpy : 0.004396200180053711 nb_pixel_total : 111645 time to create 1 rle with old method : 0.12837862968444824 length of segment : 391 time for calcul the mask position with numpy : 0.020880460739135742 nb_pixel_total : 457525 time to create 1 rle with new method : 0.055206298828125 length of segment : 925 time for calcul the mask position with numpy : 0.0009160041809082031 nb_pixel_total : 22756 time to create 1 rle with old method : 0.02674698829650879 length of segment : 166 time for calcul the mask position with numpy : 0.0009627342224121094 nb_pixel_total : 25760 time to create 1 rle with old method : 0.029913902282714844 length of segment : 260 time for calcul the mask position with numpy : 0.0005645751953125 nb_pixel_total : 12425 time to create 1 rle with old method : 0.014447450637817383 length of segment : 122 time for calcul the mask position with numpy : 0.006689786911010742 nb_pixel_total : 177320 time to create 1 rle with new method : 0.011584043502807617 length of segment : 644 time for calcul the mask position with numpy : 0.0010645389556884766 nb_pixel_total : 20221 time to create 1 rle with old method : 0.023256540298461914 length of segment : 268 time for calcul the mask position with numpy : 0.0011169910430908203 nb_pixel_total : 31904 time to create 1 rle with old method : 0.036712646484375 length of segment : 240 time for calcul the mask position with numpy : 0.0018007755279541016 nb_pixel_total : 43652 time to create 1 rle with old method : 0.050661563873291016 length of segment : 648 time for calcul the mask position with numpy : 0.0011866092681884766 nb_pixel_total : 37450 time to create 1 rle with old method : 0.04235267639160156 length of segment : 202 time for calcul the mask position with numpy : 0.0014083385467529297 nb_pixel_total : 28254 time to create 1 rle with old method : 0.03209233283996582 length of segment : 336 time for calcul the mask position with numpy : 0.0012428760528564453 nb_pixel_total : 35721 time to create 1 rle with old method : 0.04086804389953613 length of segment : 190 time for calcul the mask position with numpy : 0.00040650367736816406 nb_pixel_total : 12411 time to create 1 rle with old method : 0.02122640609741211 length of segment : 113 time for calcul the mask position with numpy : 0.002424955368041992 nb_pixel_total : 55945 time to create 1 rle with old method : 0.06517672538757324 length of segment : 292 time for calcul the mask position with numpy : 0.0011920928955078125 nb_pixel_total : 20235 time to create 1 rle with old method : 0.023313522338867188 length of segment : 214 time for calcul the mask position with numpy : 0.0018258094787597656 nb_pixel_total : 43559 time to create 1 rle with old method : 0.04919743537902832 length of segment : 389 time for calcul the mask position with numpy : 0.0013349056243896484 nb_pixel_total : 27387 time to create 1 rle with old method : 0.031481266021728516 length of segment : 251 time for calcul the mask position with numpy : 0.0007047653198242188 nb_pixel_total : 29279 time to create 1 rle with old method : 0.03333115577697754 length of segment : 249 time for calcul the mask position with numpy : 0.005685567855834961 nb_pixel_total : 140776 time to create 1 rle with old method : 0.16042232513427734 length of segment : 390 time for calcul the mask position with numpy : 0.001795053482055664 nb_pixel_total : 42819 time to create 1 rle with old method : 0.04860329627990723 length of segment : 273 time for calcul the mask position with numpy : 0.0053539276123046875 nb_pixel_total : 115628 time to create 1 rle with old method : 0.13365864753723145 length of segment : 394 time for calcul the mask position with numpy : 0.0009152889251708984 nb_pixel_total : 16470 time to create 1 rle with old method : 0.01898026466369629 length of segment : 231 time for calcul the mask position with numpy : 0.003489971160888672 nb_pixel_total : 111011 time to create 1 rle with old method : 0.12817955017089844 length of segment : 253 time for calcul the mask position with numpy : 0.0011360645294189453 nb_pixel_total : 20802 time to create 1 rle with old method : 0.023917198181152344 length of segment : 176 time for calcul the mask position with numpy : 0.0012481212615966797 nb_pixel_total : 26048 time to create 1 rle with old method : 0.030019283294677734 length of segment : 174 time for calcul the mask position with numpy : 0.0023119449615478516 nb_pixel_total : 48724 time to create 1 rle with old method : 0.05781984329223633 length of segment : 201 time for calcul the mask position with numpy : 0.0028352737426757812 nb_pixel_total : 46818 time to create 1 rle with old method : 0.0525515079498291 length of segment : 311 time for calcul the mask position with numpy : 0.0036363601684570312 nb_pixel_total : 84353 time to create 1 rle with old method : 0.09663534164428711 length of segment : 433 time for calcul the mask position with numpy : 0.0018513202667236328 nb_pixel_total : 53833 time to create 1 rle with old method : 0.0638418197631836 length of segment : 450 time for calcul the mask position with numpy : 0.0006811618804931641 nb_pixel_total : 14033 time to create 1 rle with old method : 0.017229795455932617 length of segment : 149 time for calcul the mask position with numpy : 0.0006735324859619141 nb_pixel_total : 26032 time to create 1 rle with old method : 0.02995586395263672 length of segment : 331 time for calcul the mask position with numpy : 0.002928018569946289 nb_pixel_total : 55478 time to create 1 rle with old method : 0.06375670433044434 length of segment : 206 time for calcul the mask position with numpy : 0.0009396076202392578 nb_pixel_total : 32879 time to create 1 rle with old method : 0.03824305534362793 length of segment : 227 time for calcul the mask position with numpy : 0.0020062923431396484 nb_pixel_total : 43274 time to create 1 rle with old method : 0.05045175552368164 length of segment : 453 time for calcul the mask position with numpy : 0.0015099048614501953 nb_pixel_total : 39637 time to create 1 rle with old method : 0.04456615447998047 length of segment : 397 time for calcul the mask position with numpy : 0.0012004375457763672 nb_pixel_total : 36302 time to create 1 rle with old method : 0.04095959663391113 length of segment : 301 time for calcul the mask position with numpy : 0.0016560554504394531 nb_pixel_total : 25387 time to create 1 rle with old method : 0.028430461883544922 length of segment : 349 time for calcul the mask position with numpy : 0.001955747604370117 nb_pixel_total : 62374 time to create 1 rle with old method : 0.06958985328674316 length of segment : 325 time for calcul the mask position with numpy : 0.0029571056365966797 nb_pixel_total : 88824 time to create 1 rle with old method : 0.10141134262084961 length of segment : 530 time for calcul the mask position with numpy : 0.0014562606811523438 nb_pixel_total : 44333 time to create 1 rle with old method : 0.05812954902648926 length of segment : 214 time for calcul the mask position with numpy : 0.0012128353118896484 nb_pixel_total : 23418 time to create 1 rle with old method : 0.026662588119506836 length of segment : 269 time for calcul the mask position with numpy : 0.005381345748901367 nb_pixel_total : 160086 time to create 1 rle with new method : 0.01108860969543457 length of segment : 474 time for calcul the mask position with numpy : 0.003154277801513672 nb_pixel_total : 34233 time to create 1 rle with old method : 0.03917407989501953 length of segment : 287 time for calcul the mask position with numpy : 0.0037877559661865234 nb_pixel_total : 100879 time to create 1 rle with old method : 0.11487007141113281 length of segment : 421 time for calcul the mask position with numpy : 0.0011756420135498047 nb_pixel_total : 26036 time to create 1 rle with old method : 0.0303499698638916 length of segment : 187 time for calcul the mask position with numpy : 0.0012576580047607422 nb_pixel_total : 40911 time to create 1 rle with old method : 0.047708988189697266 length of segment : 244 time for calcul the mask position with numpy : 0.0013093948364257812 nb_pixel_total : 30269 time to create 1 rle with old method : 0.0357518196105957 length of segment : 205 time for calcul the mask position with numpy : 0.0005393028259277344 nb_pixel_total : 10399 time to create 1 rle with old method : 0.012336015701293945 length of segment : 123 time for calcul the mask position with numpy : 0.0021009445190429688 nb_pixel_total : 57475 time to create 1 rle with old method : 0.06547045707702637 length of segment : 322 time for calcul the mask position with numpy : 0.0024907588958740234 nb_pixel_total : 84611 time to create 1 rle with old method : 0.09540390968322754 length of segment : 396 time for calcul the mask position with numpy : 0.0007402896881103516 nb_pixel_total : 14048 time to create 1 rle with old method : 0.016394615173339844 length of segment : 164 time for calcul the mask position with numpy : 0.0011677742004394531 nb_pixel_total : 25782 time to create 1 rle with old method : 0.02945995330810547 length of segment : 206 time for calcul the mask position with numpy : 0.0013737678527832031 nb_pixel_total : 38478 time to create 1 rle with old method : 0.04434704780578613 length of segment : 283 time for calcul the mask position with numpy : 0.0026450157165527344 nb_pixel_total : 41246 time to create 1 rle with old method : 0.06458353996276855 length of segment : 184 time for calcul the mask position with numpy : 0.0014171600341796875 nb_pixel_total : 17333 time to create 1 rle with old method : 0.022935867309570312 length of segment : 218 time for calcul the mask position with numpy : 0.0017061233520507812 nb_pixel_total : 32197 time to create 1 rle with old method : 0.039376020431518555 length of segment : 197 time for calcul the mask position with numpy : 0.004855632781982422 nb_pixel_total : 116589 time to create 1 rle with old method : 0.13494181632995605 length of segment : 389 time for calcul the mask position with numpy : 0.0008108615875244141 nb_pixel_total : 13422 time to create 1 rle with old method : 0.01580214500427246 length of segment : 152 time for calcul the mask position with numpy : 0.0023126602172851562 nb_pixel_total : 33698 time to create 1 rle with old method : 0.04615283012390137 length of segment : 235 time for calcul the mask position with numpy : 0.003104686737060547 nb_pixel_total : 43175 time to create 1 rle with old method : 0.06478285789489746 length of segment : 268 time for calcul the mask position with numpy : 0.0033359527587890625 nb_pixel_total : 38764 time to create 1 rle with old method : 0.05216407775878906 length of segment : 354 time for calcul the mask position with numpy : 0.003733396530151367 nb_pixel_total : 77843 time to create 1 rle with old method : 0.08786225318908691 length of segment : 412 time for calcul the mask position with numpy : 0.0009167194366455078 nb_pixel_total : 17162 time to create 1 rle with old method : 0.020153284072875977 length of segment : 142 time for calcul the mask position with numpy : 0.0012755393981933594 nb_pixel_total : 21268 time to create 1 rle with old method : 0.035436153411865234 length of segment : 138 time for calcul the mask position with numpy : 0.0008957386016845703 nb_pixel_total : 22376 time to create 1 rle with old method : 0.028621435165405273 length of segment : 185 time for calcul the mask position with numpy : 0.0016274452209472656 nb_pixel_total : 41325 time to create 1 rle with old method : 0.047742366790771484 length of segment : 245 time for calcul the mask position with numpy : 0.0033240318298339844 nb_pixel_total : 81383 time to create 1 rle with old method : 0.09128665924072266 length of segment : 587 time for calcul the mask position with numpy : 0.0017764568328857422 nb_pixel_total : 28581 time to create 1 rle with old method : 0.032601118087768555 length of segment : 268 time for calcul the mask position with numpy : 0.0015060901641845703 nb_pixel_total : 24574 time to create 1 rle with old method : 0.028189659118652344 length of segment : 238 time for calcul the mask position with numpy : 0.0024187564849853516 nb_pixel_total : 68382 time to create 1 rle with old method : 0.07807397842407227 length of segment : 227 time for calcul the mask position with numpy : 0.0008020401000976562 nb_pixel_total : 26339 time to create 1 rle with old method : 0.030606985092163086 length of segment : 152 time for calcul the mask position with numpy : 0.0015714168548583984 nb_pixel_total : 34485 time to create 1 rle with old method : 0.041939496994018555 length of segment : 257 time for calcul the mask position with numpy : 0.0021855831146240234 nb_pixel_total : 60512 time to create 1 rle with old method : 0.06876993179321289 length of segment : 178 time for calcul the mask position with numpy : 0.00030303001403808594 nb_pixel_total : 8748 time to create 1 rle with old method : 0.010450601577758789 length of segment : 214 time for calcul the mask position with numpy : 0.001199960708618164 nb_pixel_total : 26280 time to create 1 rle with old method : 0.03134465217590332 length of segment : 355 time for calcul the mask position with numpy : 0.0008287429809570312 nb_pixel_total : 26524 time to create 1 rle with old method : 0.030679702758789062 length of segment : 150 time for calcul the mask position with numpy : 0.0031099319458007812 nb_pixel_total : 77575 time to create 1 rle with old method : 0.0913393497467041 length of segment : 406 time for calcul the mask position with numpy : 0.0024390220642089844 nb_pixel_total : 60267 time to create 1 rle with old method : 0.0722506046295166 length of segment : 375 time for calcul the mask position with numpy : 0.0011479854583740234 nb_pixel_total : 19331 time to create 1 rle with old method : 0.023284912109375 length of segment : 150 time for calcul the mask position with numpy : 0.0008714199066162109 nb_pixel_total : 14000 time to create 1 rle with old method : 0.0163424015045166 length of segment : 121 time for calcul the mask position with numpy : 0.0027894973754882812 nb_pixel_total : 58262 time to create 1 rle with old method : 0.06754112243652344 length of segment : 269 time for calcul the mask position with numpy : 0.001407623291015625 nb_pixel_total : 33864 time to create 1 rle with old method : 0.04346823692321777 length of segment : 202 time for calcul the mask position with numpy : 0.0010132789611816406 nb_pixel_total : 18818 time to create 1 rle with old method : 0.027668237686157227 length of segment : 175 time for calcul the mask position with numpy : 0.0030257701873779297 nb_pixel_total : 45324 time to create 1 rle with old method : 0.06294107437133789 length of segment : 514 time for calcul the mask position with numpy : 0.0023393630981445312 nb_pixel_total : 58795 time to create 1 rle with old method : 0.07553219795227051 length of segment : 296 time for calcul the mask position with numpy : 0.0009264945983886719 nb_pixel_total : 25120 time to create 1 rle with old method : 0.02902698516845703 length of segment : 191 time for calcul the mask position with numpy : 0.0003097057342529297 nb_pixel_total : 2785 time to create 1 rle with old method : 0.003473997116088867 length of segment : 61 time for calcul the mask position with numpy : 0.0023336410522460938 nb_pixel_total : 40757 time to create 1 rle with old method : 0.04906034469604492 length of segment : 364 time for calcul the mask position with numpy : 0.0033211708068847656 nb_pixel_total : 117549 time to create 1 rle with old method : 0.136519193649292 length of segment : 555 time for calcul the mask position with numpy : 0.0007548332214355469 nb_pixel_total : 15880 time to create 1 rle with old method : 0.01814413070678711 length of segment : 149 time for calcul the mask position with numpy : 0.0024766921997070312 nb_pixel_total : 86741 time to create 1 rle with old method : 0.10082507133483887 length of segment : 321 time for calcul the mask position with numpy : 0.0008156299591064453 nb_pixel_total : 24633 time to create 1 rle with old method : 0.0296323299407959 length of segment : 299 time for calcul the mask position with numpy : 0.0015969276428222656 nb_pixel_total : 52158 time to create 1 rle with old method : 0.060633182525634766 length of segment : 282 time for calcul the mask position with numpy : 0.0008831024169921875 nb_pixel_total : 28020 time to create 1 rle with old method : 0.032181501388549805 length of segment : 184 time for calcul the mask position with numpy : 0.0006883144378662109 nb_pixel_total : 12970 time to create 1 rle with old method : 0.01520395278930664 length of segment : 150 time for calcul the mask position with numpy : 0.0009181499481201172 nb_pixel_total : 32931 time to create 1 rle with old method : 0.03764200210571289 length of segment : 251 time for calcul the mask position with numpy : 0.0014624595642089844 nb_pixel_total : 57406 time to create 1 rle with old method : 0.0652611255645752 length of segment : 386 time for calcul the mask position with numpy : 0.003000497817993164 nb_pixel_total : 87060 time to create 1 rle with old method : 0.10830402374267578 length of segment : 501 time for calcul the mask position with numpy : 0.0010113716125488281 nb_pixel_total : 31999 time to create 1 rle with old method : 0.03745603561401367 length of segment : 217 time for calcul the mask position with numpy : 0.004130840301513672 nb_pixel_total : 161816 time to create 1 rle with new method : 0.010339498519897461 length of segment : 629 time for calcul the mask position with numpy : 0.0022628307342529297 nb_pixel_total : 44468 time to create 1 rle with old method : 0.0714712142944336 length of segment : 411 time for calcul the mask position with numpy : 0.0006067752838134766 nb_pixel_total : 17135 time to create 1 rle with old method : 0.0197598934173584 length of segment : 180 time for calcul the mask position with numpy : 0.00109100341796875 nb_pixel_total : 27810 time to create 1 rle with old method : 0.03218865394592285 length of segment : 173 time for calcul the mask position with numpy : 0.0010209083557128906 nb_pixel_total : 26640 time to create 1 rle with old method : 0.030478715896606445 length of segment : 226 time for calcul the mask position with numpy : 0.0004906654357910156 nb_pixel_total : 10883 time to create 1 rle with old method : 0.013214349746704102 length of segment : 127 time for calcul the mask position with numpy : 0.0020172595977783203 nb_pixel_total : 73356 time to create 1 rle with old method : 0.08272695541381836 length of segment : 354 time for calcul the mask position with numpy : 0.0009944438934326172 nb_pixel_total : 22716 time to create 1 rle with old method : 0.0259244441986084 length of segment : 217 time for calcul the mask position with numpy : 0.0005180835723876953 nb_pixel_total : 14277 time to create 1 rle with old method : 0.016891956329345703 length of segment : 144 time for calcul the mask position with numpy : 0.0006356239318847656 nb_pixel_total : 21604 time to create 1 rle with old method : 0.026198387145996094 length of segment : 181 time for calcul the mask position with numpy : 0.0017709732055664062 nb_pixel_total : 62713 time to create 1 rle with old method : 0.0703728199005127 length of segment : 461 time for calcul the mask position with numpy : 0.0017936229705810547 nb_pixel_total : 33175 time to create 1 rle with old method : 0.038168907165527344 length of segment : 343 time for calcul the mask position with numpy : 0.0003612041473388672 nb_pixel_total : 17224 time to create 1 rle with old method : 0.019867420196533203 length of segment : 110 time spent for convertir_results : 15.798641920089722 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 157 chid ids of type : 3594 Number RLEs to save : 47227 save missing photos in datou_result : time spend for datou_step_exec : 93.98644876480103 time spend to save output : 2.967933177947998 total time spend for step 1 : 96.95438194274902 step2:crop_condition Mon May 26 16:32:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 157 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 137 About to insert : list_path_to_insert length 137 new photo from crops ! About to upload 137 photos upload in portfolio : 3736932 init cache_photo without model_param we have 137 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748269965_304524 we have uploaded 137 photos in the portfolio 3736932 time of upload the photos Elapsed time : 40.1881058216095 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748270009_304524 we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.594162940979004 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748270016_304524 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3226630687713623 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748270018_304524 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6030848026275635 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748270021_304524 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.738839864730835 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361084490, 1361084485, 1361084474, 1361084173, 1361084126, 1361084081, 1361084058, 1361084053, 1361084047] Looping around the photos to save general results len do output : 157 /1361111443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361111758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084490', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084485', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084474', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084173', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084126', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084081', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084058', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084053', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084047', None, None, None, None, None, '2955248') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 480 time used for this insertion : 0.030096769332885742 save_final save missing photos in datou_result : time spend for datou_step_exec : 93.01582169532776 time spend to save output : 0.034637451171875 total time spend for step 2 : 93.05045914649963 step3:rle_unique_nms_with_priority Mon May 26 16:33:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 157 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 24 nb_hashtags : 1 time to prepare the origin masks : 11.32097053527832 time for calcul the mask position with numpy : 0.558673620223999 nb_pixel_total : 6911502 time to create 1 rle with new method : 1.3541300296783447 time for calcul the mask position with numpy : 0.036971330642700195 nb_pixel_total : 26440 time to create 1 rle with old method : 0.03674769401550293 time for calcul the mask position with numpy : 0.03265070915222168 nb_pixel_total : 61677 time to create 1 rle with old method : 0.07754135131835938 time for calcul the mask position with numpy : 0.030901670455932617 nb_pixel_total : 34766 time to create 1 rle with old method : 0.0423128604888916 time for calcul the mask position with numpy : 0.028713226318359375 nb_pixel_total : 77303 time to create 1 rle with old method : 0.08556485176086426 time for calcul the mask position with numpy : 0.027434587478637695 nb_pixel_total : 52548 time to create 1 rle with old method : 0.05839276313781738 time for calcul the mask position with numpy : 0.028049945831298828 nb_pixel_total : 59007 time to create 1 rle with old method : 0.06735730171203613 time for calcul the mask position with numpy : 0.02849864959716797 nb_pixel_total : 22739 time to create 1 rle with old method : 0.025265932083129883 time for calcul the mask position with numpy : 0.025582313537597656 nb_pixel_total : 4036 time to create 1 rle with old method : 0.004627227783203125 time for calcul the mask position with numpy : 0.02812647819519043 nb_pixel_total : 37572 time to create 1 rle with old method : 0.042035818099975586 time for calcul the mask position with numpy : 0.02438211441040039 nb_pixel_total : 11034 time to create 1 rle with old method : 0.012230873107910156 time for calcul the mask position with numpy : 0.025039196014404297 nb_pixel_total : 10003 time to create 1 rle with old method : 0.010895013809204102 time for calcul the mask position with numpy : 0.024858713150024414 nb_pixel_total : 20797 time to create 1 rle with old method : 0.023137331008911133 time for calcul the mask position with numpy : 0.025220870971679688 nb_pixel_total : 95227 time to create 1 rle with old method : 0.10445570945739746 time for calcul the mask position with numpy : 0.025580167770385742 nb_pixel_total : 47279 time to create 1 rle with old method : 0.051622867584228516 time for calcul the mask position with numpy : 0.025439977645874023 nb_pixel_total : 35542 time to create 1 rle with old method : 0.03870892524719238 time for calcul the mask position with numpy : 0.026002168655395508 nb_pixel_total : 59058 time to create 1 rle with old method : 0.08412289619445801 time for calcul the mask position with numpy : 0.025513648986816406 nb_pixel_total : 15343 time to create 1 rle with old method : 0.01700758934020996 time for calcul the mask position with numpy : 0.02544879913330078 nb_pixel_total : 14604 time to create 1 rle with old method : 0.015964746475219727 time for calcul the mask position with numpy : 0.02727794647216797 nb_pixel_total : 159372 time to create 1 rle with new method : 0.9057159423828125 time for calcul the mask position with numpy : 0.030113697052001953 nb_pixel_total : 52928 time to create 1 rle with old method : 0.05871415138244629 time for calcul the mask position with numpy : 0.026397228240966797 nb_pixel_total : 62067 time to create 1 rle with old method : 0.06833100318908691 time for calcul the mask position with numpy : 0.02826976776123047 nb_pixel_total : 325744 time to create 1 rle with new method : 0.8415853977203369 time for calcul the mask position with numpy : 0.026175498962402344 nb_pixel_total : 30200 time to create 1 rle with old method : 0.033141136169433594 time for calcul the mask position with numpy : 0.025749921798706055 nb_pixel_total : 67612 time to create 1 rle with old method : 0.0744011402130127 create new chi : 5.450322151184082 time to delete rle : 0.0242002010345459 batch 1 Loaded 49 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19339 TO DO : save crop sub photo not yet done ! save time : 1.2433772087097168 nb_obj : 25 nb_hashtags : 2 time to prepare the origin masks : 11.230415105819702 time for calcul the mask position with numpy : 0.3529648780822754 nb_pixel_total : 6601643 time to create 1 rle with new method : 1.2768149375915527 time for calcul the mask position with numpy : 0.02450108528137207 nb_pixel_total : 2861 time to create 1 rle with old method : 0.0033750534057617188 time for calcul the mask position with numpy : 0.025911569595336914 nb_pixel_total : 22756 time to create 1 rle with old method : 0.024744749069213867 time for calcul the mask position with numpy : 0.029986858367919922 nb_pixel_total : 457446 time to create 1 rle with new method : 0.8887815475463867 time for calcul the mask position with numpy : 0.02977442741394043 nb_pixel_total : 105775 time to create 1 rle with old method : 0.12177705764770508 time for calcul the mask position with numpy : 0.027612686157226562 nb_pixel_total : 12007 time to create 1 rle with old method : 0.013270139694213867 time for calcul the mask position with numpy : 0.026812314987182617 nb_pixel_total : 74755 time to create 1 rle with old method : 0.09492373466491699 time for calcul the mask position with numpy : 0.03456997871398926 nb_pixel_total : 11612 time to create 1 rle with old method : 0.02036738395690918 time for calcul the mask position with numpy : 0.044231414794921875 nb_pixel_total : 91496 time to create 1 rle with old method : 0.10191655158996582 time for calcul the mask position with numpy : 0.04238104820251465 nb_pixel_total : 37961 time to create 1 rle with old method : 0.0424799919128418 time for calcul the mask position with numpy : 0.04163670539855957 nb_pixel_total : 94859 time to create 1 rle with old method : 0.11611700057983398 time for calcul the mask position with numpy : 0.043440818786621094 nb_pixel_total : 16239 time to create 1 rle with old method : 0.019753456115722656 time for calcul the mask position with numpy : 0.04217195510864258 nb_pixel_total : 14153 time to create 1 rle with old method : 0.016091585159301758 time for calcul the mask position with numpy : 0.04460930824279785 nb_pixel_total : 89898 time to create 1 rle with old method : 0.10079526901245117 time for calcul the mask position with numpy : 0.04583573341369629 nb_pixel_total : 123030 time to create 1 rle with old method : 0.16414904594421387 time for calcul the mask position with numpy : 0.044605255126953125 nb_pixel_total : 74564 time to create 1 rle with old method : 0.08807516098022461 time for calcul the mask position with numpy : 0.04892301559448242 nb_pixel_total : 25856 time to create 1 rle with old method : 0.03656435012817383 time for calcul the mask position with numpy : 0.050132036209106445 nb_pixel_total : 125890 time to create 1 rle with old method : 0.13921475410461426 time for calcul the mask position with numpy : 0.04082536697387695 nb_pixel_total : 26398 time to create 1 rle with old method : 0.02913951873779297 time for calcul the mask position with numpy : 0.040375471115112305 nb_pixel_total : 43479 time to create 1 rle with old method : 0.04758095741271973 time for calcul the mask position with numpy : 0.04017043113708496 nb_pixel_total : 18951 time to create 1 rle with old method : 0.020929336547851562 time for calcul the mask position with numpy : 0.0437467098236084 nb_pixel_total : 46359 time to create 1 rle with old method : 0.050618648529052734 time for calcul the mask position with numpy : 0.04137372970581055 nb_pixel_total : 29591 time to create 1 rle with old method : 0.03314638137817383 time for calcul the mask position with numpy : 0.04052233695983887 nb_pixel_total : 35985 time to create 1 rle with old method : 0.05378580093383789 time for calcul the mask position with numpy : 0.04525494575500488 nb_pixel_total : 41773 time to create 1 rle with old method : 0.045740365982055664 time for calcul the mask position with numpy : 0.0411677360534668 nb_pixel_total : 69063 time to create 1 rle with old method : 0.08062744140625 create new chi : 5.050963401794434 time to delete rle : 0.004195451736450195 batch 1 Loaded 51 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++Number RLEs to save : 17817 TO DO : save crop sub photo not yet done ! save time : 1.1218149662017822 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 7.339816093444824 time for calcul the mask position with numpy : 0.9122142791748047 nb_pixel_total : 7718741 time to create 1 rle with new method : 1.7996962070465088 time for calcul the mask position with numpy : 0.04684615135192871 nb_pixel_total : 29279 time to create 1 rle with old method : 0.033696651458740234 time for calcul the mask position with numpy : 0.05432844161987305 nb_pixel_total : 27387 time to create 1 rle with old method : 0.03212881088256836 time for calcul the mask position with numpy : 0.04253673553466797 nb_pixel_total : 43559 time to create 1 rle with old method : 0.04946017265319824 time for calcul the mask position with numpy : 0.040242910385131836 nb_pixel_total : 20235 time to create 1 rle with old method : 0.022494792938232422 time for calcul the mask position with numpy : 0.03747677803039551 nb_pixel_total : 55945 time to create 1 rle with old method : 0.09490966796875 time for calcul the mask position with numpy : 0.02733922004699707 nb_pixel_total : 12307 time to create 1 rle with old method : 0.014074325561523438 time for calcul the mask position with numpy : 0.04334664344787598 nb_pixel_total : 35721 time to create 1 rle with old method : 0.04105377197265625 time for calcul the mask position with numpy : 0.04273080825805664 nb_pixel_total : 28254 time to create 1 rle with old method : 0.03366446495056152 time for calcul the mask position with numpy : 0.05101633071899414 nb_pixel_total : 37450 time to create 1 rle with old method : 0.06776309013366699 time for calcul the mask position with numpy : 0.0435490608215332 nb_pixel_total : 43652 time to create 1 rle with old method : 0.055802345275878906 time for calcul the mask position with numpy : 0.04264640808105469 nb_pixel_total : 31904 time to create 1 rle with old method : 0.04312276840209961 time for calcul the mask position with numpy : 0.04094099998474121 nb_pixel_total : 20221 time to create 1 rle with old method : 0.024929523468017578 time for calcul the mask position with numpy : 0.04529166221618652 nb_pixel_total : 177320 time to create 1 rle with new method : 0.8674170970916748 time for calcul the mask position with numpy : 0.0439760684967041 nb_pixel_total : 12425 time to create 1 rle with old method : 0.014061927795410156 create new chi : 4.797751188278198 time to delete rle : 0.002780914306640625 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 10443 TO DO : save crop sub photo not yet done ! save time : 0.7112197875976562 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 9.5978102684021 time for calcul the mask position with numpy : 0.692577600479126 nb_pixel_total : 7380810 time to create 1 rle with new method : 1.648012399673462 time for calcul the mask position with numpy : 0.04591846466064453 nb_pixel_total : 39637 time to create 1 rle with old method : 0.04537200927734375 time for calcul the mask position with numpy : 0.04831647872924805 nb_pixel_total : 43274 time to create 1 rle with old method : 0.051629066467285156 time for calcul the mask position with numpy : 0.05364060401916504 nb_pixel_total : 32879 time to create 1 rle with old method : 0.0505826473236084 time for calcul the mask position with numpy : 0.046358346939086914 nb_pixel_total : 55478 time to create 1 rle with old method : 0.0641183853149414 time for calcul the mask position with numpy : 0.04408836364746094 nb_pixel_total : 21007 time to create 1 rle with old method : 0.023627042770385742 time for calcul the mask position with numpy : 0.04349350929260254 nb_pixel_total : 14033 time to create 1 rle with old method : 0.016757488250732422 time for calcul the mask position with numpy : 0.04252743721008301 nb_pixel_total : 53833 time to create 1 rle with old method : 0.06055498123168945 time for calcul the mask position with numpy : 0.04180717468261719 nb_pixel_total : 84353 time to create 1 rle with old method : 0.09560227394104004 time for calcul the mask position with numpy : 0.04150390625 nb_pixel_total : 46818 time to create 1 rle with old method : 0.057689666748046875 time for calcul the mask position with numpy : 0.04057645797729492 nb_pixel_total : 48724 time to create 1 rle with old method : 0.05424952507019043 time for calcul the mask position with numpy : 0.04075312614440918 nb_pixel_total : 26048 time to create 1 rle with old method : 0.028974056243896484 time for calcul the mask position with numpy : 0.026128292083740234 nb_pixel_total : 20802 time to create 1 rle with old method : 0.033338069915771484 time for calcul the mask position with numpy : 0.02913951873779297 nb_pixel_total : 111011 time to create 1 rle with old method : 0.13143706321716309 time for calcul the mask position with numpy : 0.02950000762939453 nb_pixel_total : 16470 time to create 1 rle with old method : 0.021063804626464844 time for calcul the mask position with numpy : 0.027491331100463867 nb_pixel_total : 115628 time to create 1 rle with old method : 0.15445375442504883 time for calcul the mask position with numpy : 0.02598404884338379 nb_pixel_total : 42819 time to create 1 rle with old method : 0.0477747917175293 time for calcul the mask position with numpy : 0.02778148651123047 nb_pixel_total : 140776 time to create 1 rle with old method : 0.15589427947998047 create new chi : 4.142747163772583 time to delete rle : 0.0018031597137451172 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 12018 TO DO : save crop sub photo not yet done ! save time : 0.8464114665985107 nb_obj : 19 nb_hashtags : 2 time to prepare the origin masks : 9.392033815383911 time for calcul the mask position with numpy : 1.0393197536468506 nb_pixel_total : 7351494 time to create 1 rle with new method : 0.9476222991943359 time for calcul the mask position with numpy : 0.03953981399536133 nb_pixel_total : 41246 time to create 1 rle with old method : 0.05015230178833008 time for calcul the mask position with numpy : 0.0426640510559082 nb_pixel_total : 38478 time to create 1 rle with old method : 0.042818546295166016 time for calcul the mask position with numpy : 0.040819644927978516 nb_pixel_total : 25782 time to create 1 rle with old method : 0.02886199951171875 time for calcul the mask position with numpy : 0.040879011154174805 nb_pixel_total : 14048 time to create 1 rle with old method : 0.015923261642456055 time for calcul the mask position with numpy : 0.039849042892456055 nb_pixel_total : 84611 time to create 1 rle with old method : 0.09407448768615723 time for calcul the mask position with numpy : 0.041222333908081055 nb_pixel_total : 57475 time to create 1 rle with old method : 0.06406974792480469 time for calcul the mask position with numpy : 0.042070865631103516 nb_pixel_total : 10399 time to create 1 rle with old method : 0.01620030403137207 time for calcul the mask position with numpy : 0.04090619087219238 nb_pixel_total : 30269 time to create 1 rle with old method : 0.03365731239318848 time for calcul the mask position with numpy : 0.040758371353149414 nb_pixel_total : 40911 time to create 1 rle with old method : 0.045623779296875 time for calcul the mask position with numpy : 0.041754722595214844 nb_pixel_total : 26036 time to create 1 rle with old method : 0.03297686576843262 time for calcul the mask position with numpy : 0.056076765060424805 nb_pixel_total : 100879 time to create 1 rle with old method : 0.11627578735351562 time for calcul the mask position with numpy : 0.04114365577697754 nb_pixel_total : 34233 time to create 1 rle with old method : 0.038559675216674805 time for calcul the mask position with numpy : 0.04450678825378418 nb_pixel_total : 160086 time to create 1 rle with new method : 0.8163747787475586 time for calcul the mask position with numpy : 0.04320812225341797 nb_pixel_total : 23418 time to create 1 rle with old method : 0.026179075241088867 time for calcul the mask position with numpy : 0.041940927505493164 nb_pixel_total : 44333 time to create 1 rle with old method : 0.0489039421081543 time for calcul the mask position with numpy : 0.041910409927368164 nb_pixel_total : 86639 time to create 1 rle with old method : 0.0999293327331543 time for calcul the mask position with numpy : 0.03933119773864746 nb_pixel_total : 62374 time to create 1 rle with old method : 0.06921005249023438 time for calcul the mask position with numpy : 0.04111528396606445 nb_pixel_total : 25387 time to create 1 rle with old method : 0.02855062484741211 time for calcul the mask position with numpy : 0.04178047180175781 nb_pixel_total : 36302 time to create 1 rle with old method : 0.05917644500732422 create new chi : 4.591487407684326 time to delete rle : 0.0041086673736572266 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 12980 TO DO : save crop sub photo not yet done ! save time : 0.8517377376556396 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 9.13764214515686 time for calcul the mask position with numpy : 1.1239655017852783 nb_pixel_total : 7486244 time to create 1 rle with new method : 0.5886409282684326 time for calcul the mask position with numpy : 0.04076194763183594 nb_pixel_total : 8748 time to create 1 rle with old method : 0.009926795959472656 time for calcul the mask position with numpy : 0.04264259338378906 nb_pixel_total : 60512 time to create 1 rle with old method : 0.06658935546875 time for calcul the mask position with numpy : 0.04073357582092285 nb_pixel_total : 34485 time to create 1 rle with old method : 0.03829789161682129 time for calcul the mask position with numpy : 0.04249262809753418 nb_pixel_total : 26339 time to create 1 rle with old method : 0.028995275497436523 time for calcul the mask position with numpy : 0.04292559623718262 nb_pixel_total : 68382 time to create 1 rle with old method : 0.07426118850708008 time for calcul the mask position with numpy : 0.04380917549133301 nb_pixel_total : 24574 time to create 1 rle with old method : 0.027251720428466797 time for calcul the mask position with numpy : 0.03992819786071777 nb_pixel_total : 28581 time to create 1 rle with old method : 0.03133368492126465 time for calcul the mask position with numpy : 0.04108452796936035 nb_pixel_total : 81383 time to create 1 rle with old method : 0.0906991958618164 time for calcul the mask position with numpy : 0.03422665596008301 nb_pixel_total : 41325 time to create 1 rle with old method : 0.04587078094482422 time for calcul the mask position with numpy : 0.0261533260345459 nb_pixel_total : 22376 time to create 1 rle with old method : 0.02601337432861328 time for calcul the mask position with numpy : 0.03716635704040527 nb_pixel_total : 21268 time to create 1 rle with old method : 0.036072731018066406 time for calcul the mask position with numpy : 0.026605844497680664 nb_pixel_total : 17162 time to create 1 rle with old method : 0.01922917366027832 time for calcul the mask position with numpy : 0.027693748474121094 nb_pixel_total : 77843 time to create 1 rle with old method : 0.09122753143310547 time for calcul the mask position with numpy : 0.026278018951416016 nb_pixel_total : 38764 time to create 1 rle with old method : 0.044042348861694336 time for calcul the mask position with numpy : 0.0281217098236084 nb_pixel_total : 43175 time to create 1 rle with old method : 0.048291683197021484 time for calcul the mask position with numpy : 0.025133371353149414 nb_pixel_total : 33698 time to create 1 rle with old method : 0.037970542907714844 time for calcul the mask position with numpy : 0.024639368057250977 nb_pixel_total : 13422 time to create 1 rle with old method : 0.015213251113891602 time for calcul the mask position with numpy : 0.0265042781829834 nb_pixel_total : 116589 time to create 1 rle with old method : 0.12754225730895996 time for calcul the mask position with numpy : 0.02799201011657715 nb_pixel_total : 32197 time to create 1 rle with old method : 0.04305696487426758 time for calcul the mask position with numpy : 0.0278475284576416 nb_pixel_total : 17333 time to create 1 rle with old method : 0.01943659782409668 create new chi : 3.3593943119049072 time to delete rle : 0.003084897994995117 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 12272 TO DO : save crop sub photo not yet done ! save time : 0.7872476577758789 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 7.693364143371582 time for calcul the mask position with numpy : 0.6043570041656494 nb_pixel_total : 7827455 time to create 1 rle with new method : 0.9405422210693359 time for calcul the mask position with numpy : 0.04427385330200195 nb_pixel_total : 2785 time to create 1 rle with old method : 0.0033109188079833984 time for calcul the mask position with numpy : 0.04358839988708496 nb_pixel_total : 25120 time to create 1 rle with old method : 0.029563426971435547 time for calcul the mask position with numpy : 0.042092323303222656 nb_pixel_total : 58795 time to create 1 rle with old method : 0.06583595275878906 time for calcul the mask position with numpy : 0.04752993583679199 nb_pixel_total : 45324 time to create 1 rle with old method : 0.05569624900817871 time for calcul the mask position with numpy : 0.04696297645568848 nb_pixel_total : 18818 time to create 1 rle with old method : 0.02759408950805664 time for calcul the mask position with numpy : 0.04396963119506836 nb_pixel_total : 33864 time to create 1 rle with old method : 0.037699222564697266 time for calcul the mask position with numpy : 0.04414820671081543 nb_pixel_total : 58262 time to create 1 rle with old method : 0.0655670166015625 time for calcul the mask position with numpy : 0.04101419448852539 nb_pixel_total : 14000 time to create 1 rle with old method : 0.015710115432739258 time for calcul the mask position with numpy : 0.04118490219116211 nb_pixel_total : 19331 time to create 1 rle with old method : 0.02399587631225586 time for calcul the mask position with numpy : 0.03954482078552246 nb_pixel_total : 60267 time to create 1 rle with old method : 0.06641244888305664 time for calcul the mask position with numpy : 0.0384368896484375 nb_pixel_total : 77575 time to create 1 rle with old method : 0.10234284400939941 time for calcul the mask position with numpy : 0.04319143295288086 nb_pixel_total : 26524 time to create 1 rle with old method : 0.029705047607421875 time for calcul the mask position with numpy : 0.024058818817138672 nb_pixel_total : 26280 time to create 1 rle with old method : 0.028896570205688477 create new chi : 2.688816785812378 time to delete rle : 0.0018262863159179688 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 8690 TO DO : save crop sub photo not yet done ! save time : 0.5766198635101318 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 9.488103866577148 time for calcul the mask position with numpy : 0.7530431747436523 nb_pixel_total : 7556967 time to create 1 rle with new method : 0.8364958763122559 time for calcul the mask position with numpy : 0.03912496566772461 nb_pixel_total : 149329 time to create 1 rle with old method : 0.1659860610961914 time for calcul the mask position with numpy : 0.04108858108520508 nb_pixel_total : 31999 time to create 1 rle with old method : 0.03597450256347656 time for calcul the mask position with numpy : 0.04212069511413574 nb_pixel_total : 87060 time to create 1 rle with old method : 0.10523200035095215 time for calcul the mask position with numpy : 0.04540133476257324 nb_pixel_total : 57406 time to create 1 rle with old method : 0.07276391983032227 time for calcul the mask position with numpy : 0.045259952545166016 nb_pixel_total : 32931 time to create 1 rle with old method : 0.04694628715515137 time for calcul the mask position with numpy : 0.049268484115600586 nb_pixel_total : 12970 time to create 1 rle with old method : 0.01656508445739746 time for calcul the mask position with numpy : 0.04388594627380371 nb_pixel_total : 28020 time to create 1 rle with old method : 0.031159162521362305 time for calcul the mask position with numpy : 0.04204416275024414 nb_pixel_total : 52158 time to create 1 rle with old method : 0.05760931968688965 time for calcul the mask position with numpy : 0.04707789421081543 nb_pixel_total : 24633 time to create 1 rle with old method : 0.027632713317871094 time for calcul the mask position with numpy : 0.045371055603027344 nb_pixel_total : 86741 time to create 1 rle with old method : 0.09621024131774902 time for calcul the mask position with numpy : 0.04426765441894531 nb_pixel_total : 15880 time to create 1 rle with old method : 0.017965316772460938 time for calcul the mask position with numpy : 0.043651580810546875 nb_pixel_total : 117549 time to create 1 rle with old method : 0.1445767879486084 time for calcul the mask position with numpy : 0.04284977912902832 nb_pixel_total : 40757 time to create 1 rle with old method : 0.046914100646972656 create new chi : 3.079739809036255 time to delete rle : 0.0038874149322509766 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 10582 TO DO : save crop sub photo not yet done ! save time : 0.7181532382965088 nb_obj : 12 nb_hashtags : 1 time to prepare the origin masks : 5.922450542449951 time for calcul the mask position with numpy : 1.0209128856658936 nb_pixel_total : 7922399 time to create 1 rle with new method : 1.1249611377716064 time for calcul the mask position with numpy : 0.04217791557312012 nb_pixel_total : 17224 time to create 1 rle with old method : 0.019110441207885742 time for calcul the mask position with numpy : 0.025935888290405273 nb_pixel_total : 33175 time to create 1 rle with old method : 0.03804731369018555 time for calcul the mask position with numpy : 0.027808189392089844 nb_pixel_total : 62713 time to create 1 rle with old method : 0.0700232982635498 time for calcul the mask position with numpy : 0.029746055603027344 nb_pixel_total : 21604 time to create 1 rle with old method : 0.023688316345214844 time for calcul the mask position with numpy : 0.025025129318237305 nb_pixel_total : 14277 time to create 1 rle with old method : 0.01605987548828125 time for calcul the mask position with numpy : 0.02513599395751953 nb_pixel_total : 22716 time to create 1 rle with old method : 0.025347471237182617 time for calcul the mask position with numpy : 0.025838613510131836 nb_pixel_total : 73356 time to create 1 rle with old method : 0.08100485801696777 time for calcul the mask position with numpy : 0.026270151138305664 nb_pixel_total : 10883 time to create 1 rle with old method : 0.012268781661987305 time for calcul the mask position with numpy : 0.02607274055480957 nb_pixel_total : 26640 time to create 1 rle with old method : 0.02985835075378418 time for calcul the mask position with numpy : 0.026140213012695312 nb_pixel_total : 27810 time to create 1 rle with old method : 0.0308990478515625 time for calcul the mask position with numpy : 0.025828838348388672 nb_pixel_total : 17135 time to create 1 rle with old method : 0.019077062606811523 time for calcul the mask position with numpy : 0.02605581283569336 nb_pixel_total : 44468 time to create 1 rle with old method : 0.0495457649230957 create new chi : 2.940999984741211 time to delete rle : 0.0013685226440429688 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8014 TO DO : save crop sub photo not yet done ! save time : 0.5544342994689941 map_output_result : {1361084490: (0.0, 'Should be the crop_list due to order', 0), 1361084485: (0.0, 'Should be the crop_list due to order', 0), 1361084474: (0.0, 'Should be the crop_list due to order', 0), 1361084173: (0.0, 'Should be the crop_list due to order', 0), 1361084126: (0.0, 'Should be the crop_list due to order', 0), 1361084081: (0.0, 'Should be the crop_list due to order', 0), 1361084058: (0.0, 'Should be the crop_list due to order', 0), 1361084053: (0.0, 'Should be the crop_list due to order', 0), 1361084047: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361084490, 1361084485, 1361084474, 1361084173, 1361084126, 1361084081, 1361084058, 1361084053, 1361084047] Looping around the photos to save general results len do output : 9 /1361084490.Didn't retrieve data . /1361084485.Didn't retrieve data . /1361084474.Didn't retrieve data . /1361084173.Didn't retrieve data . /1361084126.Didn't retrieve data . /1361084081.Didn't retrieve data . /1361084058.Didn't retrieve data . /1361084053.Didn't retrieve data . /1361084047.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084490', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084485', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084474', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084173', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084126', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084081', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084058', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084053', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084047', None, None, None, None, None, '2955248') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.013544082641601562 save_final save missing photos in datou_result : time spend for datou_step_exec : 126.11808633804321 time spend to save output : 0.014065265655517578 total time spend for step 3 : 126.13215160369873 step4:ventilate_hashtags_in_portfolio Mon May 26 16:35:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23342743 get user id for portfolio 23342743 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342743 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','papier','pet_fonce','metal','mal_croppe','background','flou','environnement','carton','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342743 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','papier','pet_fonce','metal','mal_croppe','background','flou','environnement','carton','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342743 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','papier','pet_fonce','metal','mal_croppe','background','flou','environnement','carton','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23344787,23344788,23344789,23344790,23344791,23344792,23344793,23344794,23344795,23344796,23344797?tags=pehd,papier,pet_fonce,metal,mal_croppe,background,flou,environnement,carton,autre,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361084490, 1361084485, 1361084474, 1361084173, 1361084126, 1361084081, 1361084058, 1361084053, 1361084047] Looping around the photos to save general results len do output : 1 /23342743. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084490', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084485', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084474', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084173', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084126', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084081', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084058', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084053', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084047', None, None, None, None, None, '2955248') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.014762163162231445 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5734169483184814 time spend to save output : 0.015072345733642578 total time spend for step 4 : 1.588489294052124 step5:final Mon May 26 16:35:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361084490: ('0.1057252148705418',), 1361084485: ('0.1057252148705418',), 1361084474: ('0.1057252148705418',), 1361084173: ('0.1057252148705418',), 1361084126: ('0.1057252148705418',), 1361084081: ('0.1057252148705418',), 1361084058: ('0.1057252148705418',), 1361084053: ('0.1057252148705418',), 1361084047: ('0.1057252148705418',)} new output for save of step final : {1361084490: ('0.1057252148705418',), 1361084485: ('0.1057252148705418',), 1361084474: ('0.1057252148705418',), 1361084173: ('0.1057252148705418',), 1361084126: ('0.1057252148705418',), 1361084081: ('0.1057252148705418',), 1361084058: ('0.1057252148705418',), 1361084053: ('0.1057252148705418',), 1361084047: ('0.1057252148705418',)} [1361084490, 1361084485, 1361084474, 1361084173, 1361084126, 1361084081, 1361084058, 1361084053, 1361084047] Looping around the photos to save general results len do output : 9 /1361084490.Didn't retrieve data . /1361084485.Didn't retrieve data . /1361084474.Didn't retrieve data . /1361084173.Didn't retrieve data . /1361084126.Didn't retrieve data . /1361084081.Didn't retrieve data . /1361084058.Didn't retrieve data . /1361084053.Didn't retrieve data . /1361084047.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084490', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084485', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084474', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084173', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084126', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084081', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084058', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084053', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084047', None, None, None, None, None, '2955248') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.019167423248291016 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10762763023376465 time spend to save output : 0.019652605056762695 total time spend for step 5 : 0.12728023529052734 step6:blur_detection Mon May 26 16:35:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217.jpg resize: (2160, 3840) 1361084490 -5.847520704318634 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863.jpg resize: (2160, 3840) 1361084485 -5.792393228804991 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d.jpg resize: (2160, 3840) 1361084474 -5.829245502251382 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065.jpg resize: (2160, 3840) 1361084173 -5.890648756163799 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb.jpg resize: (2160, 3840) 1361084126 -5.947937138606529 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554.jpg resize: (2160, 3840) 1361084081 -6.211484114693203 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3.jpg resize: (2160, 3840) 1361084058 -5.6778997330032315 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b.jpg resize: (2160, 3840) 1361084053 -5.70182982298527 treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35.jpg resize: (2160, 3840) 1361084047 -3.520667827259295 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252471_0.png resize: (354, 344) 1361111443 -0.8358016261778485 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252472_0.png resize: (120, 302) 1361111444 -3.0598755326750626 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252473_0.png resize: (688, 836) 1361111445 1.0589334619242834 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252474_0.png resize: (402, 410) 1361111448 -2.2516885043697354 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252475_0.png resize: (324, 501) 1361111449 -3.1329574640380784 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252476_0.png resize: (731, 262) 1361111450 -3.83766943787058 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252477_0.png resize: (104, 183) 1361111452 -2.4780308837064573 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252478_0.png resize: (185, 118) 1361111453 -2.282394544924267 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252479_0.png resize: (418, 206) 1361111454 -2.8194691962304232 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252480_0.png resize: (355, 141) 1361111456 -3.3205335157804643 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252481_0.png resize: (224, 280) 1361111457 -4.039028090095308 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252482_0.png resize: (547, 297) 1361111458 -3.629368213454471 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252483_0.png resize: (240, 241) 1361111460 -1.408404193073837 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252484_0.png resize: (201, 130) 1361111461 -1.774079417265274 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252485_0.png resize: (287, 145) 1361111462 -2.5593818390598173 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252486_0.png resize: (498, 194) 1361111464 -3.243249451996396 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252487_0.png resize: (208, 171) 1361111465 -3.397044926062855 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252488_0.png resize: (140, 230) 1361111466 -2.597328583468987 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252489_0.png resize: (333, 306) 1361111468 -4.368519011616985 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252490_0.png resize: (293, 334) 1361111469 -2.140928056274459 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252491_0.png resize: (446, 261) 1361111470 -2.7854284379273873 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252492_0.png resize: (253, 209) 1361111473 -3.5189361591450323 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252493_0.png resize: (392, 450) 1361111474 -2.791583487934315 treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252494_0.png resize: (156, 243) 1361111475 -1.1313241489354902 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252495_0.png resize: (320, 327) 1361111477 3.357281647956043 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252496_0.png resize: (253, 279) 1361111478 -2.122599636147308 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252497_0.png resize: (280, 331) 1361111479 -2.7660549769444347 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252498_0.png resize: (251, 218) 1361111481 -3.1501830097641816 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252499_0.png resize: (346, 260) 1361111482 -2.5142695709071 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252500_0.png resize: (124, 203) 1361111483 -1.7488337228078938 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252501_0.png resize: (303, 217) 1361111485 -2.086795884715657 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252502_0.png resize: (201, 206) 1361111486 -2.2949794383169726 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252503_0.png resize: (472, 400) 1361111487 -0.5012955091112733 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252504_0.png resize: (170, 262) 1361111489 -1.05075759719639 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252505_0.png resize: (373, 384) 1361111490 -3.68362718926998 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252506_0.png resize: (382, 545) 1361111491 -2.28609584498889 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252507_0.png resize: (297, 448) 1361111493 -4.654760307944388 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252508_0.png resize: (108, 208) 1361111494 -0.29802345415060716 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252509_0.png resize: (124, 201) 1361111495 -4.517189272332921 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252510_0.png resize: (549, 475) 1361111498 -2.8180857088797295 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252512_0.png resize: (356, 395) 1361111499 -4.087979959617366 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252513_0.png resize: (67, 253) 1361111500 -2.642920962324703 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252514_0.png resize: (435, 300) 1361111502 -3.6929488042169774 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252515_0.png resize: (154, 114) 1361111503 -1.4766900618294114 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252516_0.png resize: (344, 676) 1361111504 -2.4557717396467154 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252517_0.png resize: (859, 836) 1361111506 -5.092371625040455 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252518_0.png resize: (166, 169) 1361111507 -4.479928223459442 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252519_0.png resize: (211, 200) 1361111508 -3.1579188615355136 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252520_0.png resize: (120, 158) 1361111510 -1.7927302961376093 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252521_0.png resize: (505, 613) 1361111511 -2.6539542277406794 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252522_0.png resize: (155, 211) 1361111512 -2.907396645096865 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252523_0.png resize: (225, 200) 1361111514 -0.5276452861409857 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252524_0.png resize: (354, 213) 1361111515 -2.576953467306477 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252526_0.png resize: (312, 140) 1361111516 -3.0343083695902804 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252527_0.png resize: (187, 277) 1361111518 0.9032236957273587 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252528_0.png resize: (89, 224) 1361111519 -3.9649077432243227 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252529_0.png resize: (238, 531) 1361111520 -2.2650758385921326 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252530_0.png resize: (214, 222) 1361111522 -2.7681383736982608 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252531_0.png resize: (298, 304) 1361111523 -0.26184783356841534 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252534_0.png resize: (386, 577) 1361111524 -2.2224079349631616 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252536_0.png resize: (288, 589) 1361111526 -2.677418772594939 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252537_0.png resize: (207, 131) 1361111527 -3.689905773914046 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252539_0.png resize: (176, 170) 1361111528 -1.204004761862554 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252542_0.png resize: (306, 250) 1361111530 -3.2383717538454384 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252543_0.png resize: (359, 439) 1361111531 1.0138134780632821 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252544_0.png resize: (318, 255) 1361111532 -3.107159438773517 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252545_0.png resize: (135, 154) 1361111534 -3.8108651044272492 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252546_0.png resize: (206, 246) 1361111535 -2.9525954378623602 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252547_0.png resize: (189, 387) 1361111536 -2.6796187924429 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252548_0.png resize: (205, 283) 1361111538 -3.10009361512986 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252549_0.png resize: (381, 200) 1361111539 -3.6770349959592665 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252550_0.png resize: (261, 211) 1361111541 -2.0900470394897277 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252551_0.png resize: (298, 170) 1361111542 1.8868465313902043 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252552_0.png resize: (339, 205) 1361111543 -2.8354706752441188 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252553_0.png resize: (269, 333) 1361111545 -1.8885897216069216 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252554_0.png resize: (340, 569) 1361111546 -4.063051882365565 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252555_0.png resize: (210, 308) 1361111547 2.8327727718427664 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252556_0.png resize: (254, 157) 1361111549 -2.2454846158426944 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252557_0.png resize: (427, 602) 1361111550 -3.5327774447346734 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252558_0.png resize: (259, 355) 1361111551 -3.1304743419185193 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252560_0.png resize: (185, 223) 1361111553 -0.30052310441949037 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252561_0.png resize: (230, 258) 1361111554 -1.3358575776953325 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252562_0.png resize: (203, 219) 1361111555 -2.9931307467048995 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252564_0.png resize: (295, 359) 1361111557 -3.3932116576513653 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252565_0.png resize: (292, 406) 1361111558 -3.4522284819642786 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252567_0.png resize: (198, 217) 1361111559 -0.14488809619611007 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252569_0.png resize: (164, 388) 1361111561 -4.203990489477285 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252570_0.png resize: (217, 115) 1361111563 -2.995561659703324 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252571_0.png resize: (196, 229) 1361111564 -2.4235113259809182 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252572_0.png resize: (353, 465) 1361111565 -4.20943373505729 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252573_0.png resize: (151, 156) 1361111567 -2.8560757214529824 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252574_0.png resize: (229, 243) 1361111568 -3.115875537737489 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252575_0.png resize: (235, 261) 1361111569 -2.3681527568578344 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252576_0.png resize: (348, 206) 1361111571 -3.885600797635794 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252577_0.png resize: (356, 388) 1361111572 -2.7144802009371305 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252578_0.png resize: (140, 230) 1361111573 -3.343671530108714 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252579_0.png resize: (136, 222) 1361111575 -0.7903031000543379 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252580_0.png resize: (162, 211) 1361111577 -1.565369463829032 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252581_0.png resize: (231, 270) 1361111578 -1.613296222766084 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252582_0.png resize: (504, 271) 1361111580 -1.3683610350377677 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252584_0.png resize: (191, 220) 1361111581 -1.9970013276729004 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252586_0.png resize: (148, 226) 1361111582 -3.566089629847014 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252587_0.png resize: (257, 187) 1361111584 -3.96807417181249 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252588_0.png resize: (149, 563) 1361111585 -3.072100992447023 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252589_0.png resize: (136, 167) 1361111586 -4.277326873632735 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252590_0.png resize: (262, 188) 1361111588 -3.8097752176350768 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252591_0.png resize: (123, 262) 1361111589 -3.4656254577609387 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252592_0.png resize: (339, 448) 1361111591 -0.8839709038366454 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252593_0.png resize: (258, 437) 1361111592 -2.9801159015013257 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252594_0.png resize: (150, 216) 1361111593 -3.5519202379627344 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252595_0.png resize: (117, 203) 1361111595 -4.0477184076332815 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252596_0.png resize: (250, 327) 1361111596 -1.85496664694815 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252597_0.png resize: (202, 265) 1361111597 -1.1683362830279016 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252598_0.png resize: (151, 166) 1361111599 -2.1162216039951316 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252599_0.png resize: (466, 260) 1361111600 -3.2664725074654886 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252601_0.png resize: (181, 185) 1361111601 -2.566681376492891 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252602_0.png resize: (61, 82) 1361111603 -3.4456254008672174 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252603_0.png resize: (306, 385) 1361111604 -3.165724062015331 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252604_0.png resize: (407, 437) 1361111605 -2.3376106165505885 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252605_0.png resize: (149, 145) 1361111607 -3.834841866875189 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252606_0.png resize: (313, 488) 1361111608 -3.7959334680642955 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252610_0.png resize: (139, 184) 1361111609 -3.5372009880316506 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252611_0.png resize: (200, 225) 1361111611 -3.8258660476181663 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252613_0.png resize: (500, 279) 1361111612 -3.1234381005464495 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252615_0.png resize: (530, 549) 1361111613 -2.807629804392576 treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252616_0.png resize: (379, 269) 1361111615 -2.947365286669001 treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252617_0.png resize: (180, 123) 1361111616 -2.60436328448355 treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252618_0.png resize: (171, 257) 1361111617 -3.0095516697595 treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252619_0.png resize: (207, 257) 1361111619 -4.011255979526472 treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252620_0.png resize: (127, 110) 1361111620 -1.6217804138448864 treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252621_0.png resize: (349, 285) 1361111622 -3.330854839385115 treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252622_0.png resize: (217, 146) 1361111623 -3.2488183185775226 treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252623_0.png resize: (144, 149) 1361111624 -3.3190310923720516 treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252624_0.png resize: (181, 174) 1361111626 -4.543831397297164 treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252625_0.png resize: (330, 300) 1361111627 -4.448247985472396 treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252626_0.png resize: (333, 246) 1361111628 -3.52154175278588 treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252627_0.png resize: (110, 197) 1361111630 -2.9673039499502667 treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252511_0.png resize: (168, 348) 1361111678 -2.787855561823748 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252525_0.png resize: (199, 301) 1361111679 -2.60074196518888 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252533_0.png resize: (248, 159) 1361111680 -2.822264234205455 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252535_0.png resize: (273, 226) 1361111682 -3.519164452450995 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252540_0.png resize: (173, 192) 1361111683 -1.5202632338231254 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252559_0.png resize: (353, 418) 1361111684 -4.064905358599028 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252563_0.png resize: (123, 128) 1361111686 -1.5827034710025742 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252566_0.png resize: (118, 201) 1361111687 -2.0583569283403476 treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252568_0.png resize: (283, 181) 1361111689 -2.612913315435986 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252583_0.png resize: (225, 223) 1361111691 -3.934982979700815 treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252600_0.png resize: (289, 346) 1361111692 -2.76861583637911 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252609_0.png resize: (163, 239) 1361111694 -3.758203839987447 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252614_0.png resize: (216, 203) 1361111696 -2.7290034741674427 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252538_0.png resize: (236, 600) 1361111722 -2.7394798487662855 treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252541_0.png resize: (198, 420) 1361111723 -3.778314989242477 treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252585_0.png resize: (222, 411) 1361111725 -2.5103978892104886 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252607_0.png resize: (280, 119) 1361111726 -4.125811637154658 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252608_0.png resize: (279, 262) 1361111727 -4.8929410745447015 treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252532_0.png resize: (247, 240) 1361111743 -2.4359406499715366 treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252612_0.png resize: (317, 241) 1361111758 -4.544028453412436 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 166 time used for this insertion : 0.02240443229675293 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 166 time used for this insertion : 0.03617429733276367 save missing photos in datou_result : time spend for datou_step_exec : 42.581037282943726 time spend to save output : 0.0649418830871582 total time spend for step 6 : 42.645979166030884 step7:brightness Mon May 26 16:36:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217.jpg treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863.jpg treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d.jpg treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065.jpg treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb.jpg treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554.jpg treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3.jpg treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b.jpg treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35.jpg treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252471_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252472_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252473_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252474_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252475_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252476_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252477_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252478_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252479_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252480_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252481_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252482_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252483_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252484_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252485_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252486_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252487_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252488_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252489_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252490_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252491_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252492_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252493_0.png treat image : temp/1748269829_304524_1361084490_2397c3d5e12db6fe96e423d872735217_rle_crop_3813252494_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252495_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252496_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252497_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252498_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252499_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252500_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252501_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252502_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252503_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252504_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252505_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252506_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252507_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252508_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252509_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252510_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252512_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252513_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252514_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252515_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252516_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252517_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252518_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252519_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252520_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252521_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252522_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252523_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252524_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252526_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252527_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252528_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252529_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252530_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252531_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252534_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252536_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252537_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252539_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252542_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252543_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252544_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252545_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252546_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252547_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252548_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252549_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252550_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252551_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252552_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252553_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252554_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252555_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252556_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252557_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252558_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252560_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252561_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252562_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252564_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252565_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252567_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252569_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252570_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252571_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252572_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252573_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252574_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252575_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252576_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252577_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252578_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252579_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252580_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252581_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252582_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252584_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252586_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252587_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252588_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252589_0.png treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252590_0.png treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252591_0.png treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252592_0.png treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252593_0.png treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252594_0.png treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252595_0.png treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252596_0.png treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252597_0.png treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252598_0.png treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252599_0.png treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252601_0.png treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252602_0.png treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252603_0.png treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252604_0.png treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252605_0.png treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252606_0.png treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252610_0.png treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252611_0.png treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252613_0.png treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252615_0.png treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252616_0.png treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252617_0.png treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252618_0.png treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252619_0.png treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252620_0.png treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252621_0.png treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252622_0.png treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252623_0.png treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252624_0.png treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252625_0.png treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252626_0.png treat image : temp/1748269829_304524_1361084047_7ac85a3a03900143e127bc7e4707cb35_rle_crop_3813252627_0.png treat image : temp/1748269829_304524_1361084485_83730de08dad5dbc21fc8f10ba1f2863_rle_crop_3813252511_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252525_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252533_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252535_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252540_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252559_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252563_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252566_0.png treat image : temp/1748269829_304524_1361084126_559fdc419955c15eb2f76a1e563de0bb_rle_crop_3813252568_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252583_0.png treat image : temp/1748269829_304524_1361084058_dc31d261975157acb4324242719d50a3_rle_crop_3813252600_0.png treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252609_0.png treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252614_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252538_0.png treat image : temp/1748269829_304524_1361084173_711eaf65225179f424b150041c3e2065_rle_crop_3813252541_0.png treat image : temp/1748269829_304524_1361084081_fc400490b8c67ad5975198d51a740554_rle_crop_3813252585_0.png treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252607_0.png treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252608_0.png treat image : temp/1748269829_304524_1361084474_534b311e402a61a08885214f70b5ea6d_rle_crop_3813252532_0.png treat image : temp/1748269829_304524_1361084053_bd62f4bda95da858d34cbdf19773121b_rle_crop_3813252612_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 166 time used for this insertion : 0.01706552505493164 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 166 time used for this insertion : 0.029963016510009766 save missing photos in datou_result : time spend for datou_step_exec : 11.365617752075195 time spend to save output : 0.052321434020996094 total time spend for step 7 : 11.417939186096191 step8:velours_tree Mon May 26 16:36:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.0552270412445068 time spend to save output : 3.218650817871094e-05 total time spend for step 8 : 1.0552592277526855 step9:send_mail_cod Mon May 26 16:36:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23342743_26-05-2025_16_36_44.pdf 23344787 imagette233447871748270204 23344788 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233447881748270204 23344789 change filename to text .imagette233447891748270205 23344790 imagette233447901748270205 23344791 imagette233447911748270205 23344792 imagette233447921748270205 23344793 imagette233447931748270205 23344795 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233447951748270205 23344796 change filename to text .imagette233447961748270206 23344797 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233447971748270206 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23342743 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23344787,23344788,23344789,23344790,23344791,23344792,23344793,23344794,23344795,23344796,23344797?tags=pehd,papier,pet_fonce,metal,mal_croppe,background,flou,environnement,carton,autre,pet_clair args[1361084490] : ((1361084490, -5.847520704318634, 492609224), (1361084490, 1.4731089065814842, 2107752395), '0.1057252148705418') We are sending mail with results at report@fotonower.com args[1361084485] : ((1361084485, -5.792393228804991, 492609224), (1361084485, 0.8235964693402469, 2107752395), '0.1057252148705418') We are sending mail with results at report@fotonower.com args[1361084474] : ((1361084474, -5.829245502251382, 492609224), (1361084474, 1.2568073630415135, 2107752395), '0.1057252148705418') We are sending mail with results at report@fotonower.com args[1361084173] : ((1361084173, -5.890648756163799, 492609224), (1361084173, 1.6147360731024727, 2107752395), '0.1057252148705418') We are sending mail with results at report@fotonower.com args[1361084126] : ((1361084126, -5.947937138606529, 492609224), (1361084126, 1.11300465211975, 2107752395), '0.1057252148705418') We are sending mail with results at report@fotonower.com args[1361084081] : ((1361084081, -6.211484114693203, 492609224), (1361084081, 1.3820758453000206, 2107752395), '0.1057252148705418') We are sending mail with results at report@fotonower.com args[1361084058] : ((1361084058, -5.6778997330032315, 492609224), (1361084058, 0.6501189617032561, 2107752395), '0.1057252148705418') We are sending mail with results at report@fotonower.com args[1361084053] : ((1361084053, -5.70182982298527, 492609224), (1361084053, 0.4755226951752582, 2107752395), '0.1057252148705418') We are sending mail with results at report@fotonower.com args[1361084047] : ((1361084047, -3.520667827259295, 492609224), (1361084047, -0.19937786419035608, 496442774), '0.1057252148705418') We are sending mail with results at report@fotonower.com refus_total : 0.1057252148705418 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23342743 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342743_26-05-2025_16_36_44.pdf results_Auto_P23342743_26-05-2025_16_36_44.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342743_26-05-2025_16_36_44.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23342743','results_Auto_P23342743_26-05-2025_16_36_44.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342743_26-05-2025_16_36_44.pdf','pdf','','0.54','0.1057252148705418') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23342743

https://www.fotonower.com/image?json=false&list_photos_id=1361084490
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361084485
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361084474
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361084173
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361084126
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361084081
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361084058
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361084053
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361084047
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.57%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/23344788?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23344789?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23344795?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23344796?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23344797?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342743_26-05-2025_16_36_44.pdf.

Lien vers velours :https://www.fotonower.com/velours/23344787,23344788,23344789,23344790,23344791,23344792,23344793,23344794,23344795,23344796,23344797?tags=pehd,papier,pet_fonce,metal,mal_croppe,background,flou,environnement,carton,autre,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 26 May 2025 14:36:49 GMT Content-Length: 0 Connection: close X-Message-Id: 178lTYR-T-WtJGOYBTzeMg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361084490, 1361084485, 1361084474, 1361084173, 1361084126, 1361084081, 1361084058, 1361084053, 1361084047] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084490', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084485', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084474', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084173', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084126', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084081', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084058', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084053', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084047', None, None, None, None, None, '2955248') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.016158103942871094 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.193275690078735 time spend to save output : 0.016483545303344727 total time spend for step 9 : 5.20975923538208 step10:split_time_score Mon May 26 16:36:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26052025 23342743 Nombre de photos uploadées : 9 / 23040 (0%) 26052025 23342743 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 26052025 23342743 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 4.291534423828125e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0003998279571533203 elapsed_time : insert_dashboard_record_day_entry 0.02431654930114746 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344668 order by id desc limit 1 Qualite : 0.10631123107156629 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23331064_26-05-2025_13_10_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331064 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23331064 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331066 order by id desc limit 1 Qualite : 0.09622099389524323 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23331105_26-05-2025_15_13_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331105 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23331105 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23328666 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23328671 order by id desc limit 1 Qualite : 0.1437267627398686 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339058 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339058 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339060 order by id desc limit 1 Qualite : 0.10856602044753087 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339062_26-05-2025_15_34_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339062 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339062 AND mptpi.`type`=3594 To do Qualite : 0.12075810185185182 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339075_26-05-2025_15_29_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339075 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339075 AND mptpi.`type`=3594 To do Qualite : 0.11833079346707819 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339078_26-05-2025_15_20_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339078 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339078 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339082 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339099 order by id desc limit 1 Qualite : 0.1057252148705418 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342743_26-05-2025_16_36_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23342743 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342743 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23342745 order by id desc limit 1 Qualite : 0.11492990451388885 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23342759_26-05-2025_16_32_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23342759 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23342759 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344670 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344672 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344698 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23344701 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26052025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361084490, 1361084485, 1361084474, 1361084173, 1361084126, 1361084081, 1361084058, 1361084053, 1361084047] Looping around the photos to save general results len do output : 1 /23342743Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084490', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084485', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084474', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084173', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084126', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084081', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084058', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084053', None, None, None, None, None, '2955248') ('3318', None, None, None, None, None, None, None, '2955248') ('3318', '23342743', '1361084047', None, None, None, None, None, '2955248') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01508331298828125 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.212198734283447 time spend to save output : 0.015390157699584961 total time spend for step 10 : 12.227588891983032 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 158.96user 166.39system 6:36.46elapsed 82%CPU (0avgtext+0avgdata 5305932maxresident)k 793832inputs+117224outputs (16492major+16704962minor)pagefaults 0swaps