python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 41413 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3351437'] with mtr_portfolio_ids : ['25325810'] and first list_photo_ids : [] new path : /proc/41413/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.5467228889465332 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Jul 25 11:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10733 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-25 11:40:33.797758: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-25 11:40:33.823414: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-25 11:40:33.825026: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fde1c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-25 11:40:33.825077: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-25 11:40:33.827648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-25 11:40:33.976116: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x403085b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-25 11:40:33.976152: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-25 11:40:33.977056: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-25 11:40:33.977333: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-25 11:40:33.979306: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-25 11:40:33.984777: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-25 11:40:33.985101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-25 11:40:33.987399: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-25 11:40:33.988637: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-25 11:40:33.996022: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-25 11:40:33.997505: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-25 11:40:33.997592: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-25 11:40:33.998348: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-25 11:40:33.998363: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-25 11:40:33.998372: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-25 11:40:33.999702: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9947 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-25 11:40:34.245090: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-25 11:40:34.245202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-25 11:40:34.245218: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-25 11:40:34.245232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-25 11:40:34.245246: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-25 11:40:34.245259: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-25 11:40:34.245272: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-25 11:40:34.245286: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-25 11:40:34.246561: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-25 11:40:34.247722: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-25 11:40:34.247752: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-25 11:40:34.247767: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-25 11:40:34.247781: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-25 11:40:34.247794: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-25 11:40:34.247807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-25 11:40:34.247820: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-25 11:40:34.247833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-25 11:40:34.249091: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-25 11:40:34.249125: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-25 11:40:34.249133: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-25 11:40:34.249140: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-25 11:40:34.250413: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9947 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-25 11:40:45.511124: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-25 11:40:45.688888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 49 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 43 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 43 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 Detection mask done ! Trying to reset tf kernel 42129 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 155 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5444 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0028684139251708984 nb_pixel_total : 72981 time to create 1 rle with old method : 0.08619832992553711 length of segment : 288 time for calcul the mask position with numpy : 0.0015873908996582031 nb_pixel_total : 54298 time to create 1 rle with old method : 0.06105446815490723 length of segment : 395 time for calcul the mask position with numpy : 0.0006885528564453125 nb_pixel_total : 21679 time to create 1 rle with old method : 0.02676081657409668 length of segment : 185 time for calcul the mask position with numpy : 0.0006895065307617188 nb_pixel_total : 21033 time to create 1 rle with old method : 0.026004314422607422 length of segment : 216 time for calcul the mask position with numpy : 0.000637054443359375 nb_pixel_total : 27753 time to create 1 rle with old method : 0.03415536880493164 length of segment : 262 time for calcul the mask position with numpy : 0.006389141082763672 nb_pixel_total : 179870 time to create 1 rle with new method : 0.018810033798217773 length of segment : 609 time for calcul the mask position with numpy : 0.0015439987182617188 nb_pixel_total : 60813 time to create 1 rle with old method : 0.06505799293518066 length of segment : 355 time for calcul the mask position with numpy : 0.0011031627655029297 nb_pixel_total : 48188 time to create 1 rle with old method : 0.05147957801818848 length of segment : 247 time for calcul the mask position with numpy : 0.0006308555603027344 nb_pixel_total : 16759 time to create 1 rle with old method : 0.018721580505371094 length of segment : 278 time for calcul the mask position with numpy : 0.0015060901641845703 nb_pixel_total : 70939 time to create 1 rle with old method : 0.08324360847473145 length of segment : 308 time for calcul the mask position with numpy : 0.003321409225463867 nb_pixel_total : 135148 time to create 1 rle with old method : 0.1498103141784668 length of segment : 498 time for calcul the mask position with numpy : 0.0005011558532714844 nb_pixel_total : 18767 time to create 1 rle with old method : 0.021035194396972656 length of segment : 137 time for calcul the mask position with numpy : 0.0014858245849609375 nb_pixel_total : 64236 time to create 1 rle with old method : 0.07995271682739258 length of segment : 285 time for calcul the mask position with numpy : 0.0002467632293701172 nb_pixel_total : 8382 time to create 1 rle with old method : 0.010046005249023438 length of segment : 74 time for calcul the mask position with numpy : 0.0055294036865234375 nb_pixel_total : 31824 time to create 1 rle with old method : 0.0396876335144043 length of segment : 220 time for calcul the mask position with numpy : 0.00064849853515625 nb_pixel_total : 28454 time to create 1 rle with old method : 0.03337717056274414 length of segment : 237 time for calcul the mask position with numpy : 0.0011928081512451172 nb_pixel_total : 58749 time to create 1 rle with old method : 0.06889867782592773 length of segment : 368 time for calcul the mask position with numpy : 0.0008313655853271484 nb_pixel_total : 30645 time to create 1 rle with old method : 0.0358426570892334 length of segment : 189 time for calcul the mask position with numpy : 0.0006814002990722656 nb_pixel_total : 30581 time to create 1 rle with old method : 0.035584449768066406 length of segment : 203 time for calcul the mask position with numpy : 0.0004794597625732422 nb_pixel_total : 20982 time to create 1 rle with old method : 0.029146194458007812 length of segment : 243 time for calcul the mask position with numpy : 0.0022096633911132812 nb_pixel_total : 114219 time to create 1 rle with old method : 0.13681292533874512 length of segment : 346 time for calcul the mask position with numpy : 0.002448558807373047 nb_pixel_total : 121584 time to create 1 rle with old method : 0.14300298690795898 length of segment : 513 time for calcul the mask position with numpy : 0.00033354759216308594 nb_pixel_total : 13653 time to create 1 rle with old method : 0.015903949737548828 length of segment : 244 time for calcul the mask position with numpy : 0.0012621879577636719 nb_pixel_total : 65186 time to create 1 rle with old method : 0.07576346397399902 length of segment : 224 time for calcul the mask position with numpy : 0.0012178421020507812 nb_pixel_total : 52479 time to create 1 rle with old method : 0.05945587158203125 length of segment : 279 time for calcul the mask position with numpy : 0.003628253936767578 nb_pixel_total : 89107 time to create 1 rle with old method : 0.10013222694396973 length of segment : 329 time for calcul the mask position with numpy : 0.0011687278747558594 nb_pixel_total : 22025 time to create 1 rle with old method : 0.02572774887084961 length of segment : 225 time for calcul the mask position with numpy : 0.0053615570068359375 nb_pixel_total : 136907 time to create 1 rle with old method : 0.1618795394897461 length of segment : 489 time for calcul the mask position with numpy : 0.001953125 nb_pixel_total : 25371 time to create 1 rle with old method : 0.03548836708068848 length of segment : 301 time for calcul the mask position with numpy : 0.008957147598266602 nb_pixel_total : 181593 time to create 1 rle with new method : 0.01742863655090332 length of segment : 413 time for calcul the mask position with numpy : 0.0008432865142822266 nb_pixel_total : 26268 time to create 1 rle with old method : 0.03085160255432129 length of segment : 329 time for calcul the mask position with numpy : 0.0012485980987548828 nb_pixel_total : 12167 time to create 1 rle with old method : 0.020214319229125977 length of segment : 138 time for calcul the mask position with numpy : 0.0006022453308105469 nb_pixel_total : 7346 time to create 1 rle with old method : 0.008658170700073242 length of segment : 90 time for calcul the mask position with numpy : 0.0055539608001708984 nb_pixel_total : 107929 time to create 1 rle with old method : 0.12546849250793457 length of segment : 525 time for calcul the mask position with numpy : 0.009297847747802734 nb_pixel_total : 195371 time to create 1 rle with new method : 0.01692342758178711 length of segment : 614 time for calcul the mask position with numpy : 0.0031082630157470703 nb_pixel_total : 81950 time to create 1 rle with old method : 0.09756755828857422 length of segment : 405 time for calcul the mask position with numpy : 0.0012919902801513672 nb_pixel_total : 31570 time to create 1 rle with old method : 0.03693366050720215 length of segment : 285 time for calcul the mask position with numpy : 0.0015544891357421875 nb_pixel_total : 33654 time to create 1 rle with old method : 0.042684316635131836 length of segment : 214 time for calcul the mask position with numpy : 0.005483388900756836 nb_pixel_total : 115240 time to create 1 rle with old method : 0.12935757637023926 length of segment : 490 time for calcul the mask position with numpy : 0.004622936248779297 nb_pixel_total : 114451 time to create 1 rle with old method : 0.12987542152404785 length of segment : 691 time for calcul the mask position with numpy : 0.0047338008880615234 nb_pixel_total : 163072 time to create 1 rle with new method : 0.00865030288696289 length of segment : 416 time for calcul the mask position with numpy : 0.0007033348083496094 nb_pixel_total : 14655 time to create 1 rle with old method : 0.017108678817749023 length of segment : 160 time for calcul the mask position with numpy : 0.0009665489196777344 nb_pixel_total : 24383 time to create 1 rle with old method : 0.028226375579833984 length of segment : 213 time for calcul the mask position with numpy : 0.002814054489135742 nb_pixel_total : 150697 time to create 1 rle with new method : 0.008609294891357422 length of segment : 579 time for calcul the mask position with numpy : 0.0005404949188232422 nb_pixel_total : 15610 time to create 1 rle with old method : 0.018070220947265625 length of segment : 199 time for calcul the mask position with numpy : 0.007078409194946289 nb_pixel_total : 150188 time to create 1 rle with new method : 0.012572050094604492 length of segment : 475 time for calcul the mask position with numpy : 0.0020568370819091797 nb_pixel_total : 53098 time to create 1 rle with old method : 0.05949711799621582 length of segment : 399 time for calcul the mask position with numpy : 0.0015952587127685547 nb_pixel_total : 37301 time to create 1 rle with old method : 0.04444384574890137 length of segment : 228 time for calcul the mask position with numpy : 0.001745462417602539 nb_pixel_total : 77375 time to create 1 rle with old method : 0.0881955623626709 length of segment : 448 time for calcul the mask position with numpy : 0.002408742904663086 nb_pixel_total : 49220 time to create 1 rle with old method : 0.05593991279602051 length of segment : 400 time for calcul the mask position with numpy : 0.0017437934875488281 nb_pixel_total : 33363 time to create 1 rle with old method : 0.03890180587768555 length of segment : 222 time for calcul the mask position with numpy : 0.0025691986083984375 nb_pixel_total : 59520 time to create 1 rle with old method : 0.07078194618225098 length of segment : 317 time for calcul the mask position with numpy : 0.0009100437164306641 nb_pixel_total : 17872 time to create 1 rle with old method : 0.02060079574584961 length of segment : 174 time for calcul the mask position with numpy : 0.0015764236450195312 nb_pixel_total : 24338 time to create 1 rle with old method : 0.02953362464904785 length of segment : 181 time for calcul the mask position with numpy : 0.004675388336181641 nb_pixel_total : 90859 time to create 1 rle with old method : 0.10293102264404297 length of segment : 726 time for calcul the mask position with numpy : 0.001873016357421875 nb_pixel_total : 38877 time to create 1 rle with old method : 0.045332908630371094 length of segment : 184 time for calcul the mask position with numpy : 0.002848386764526367 nb_pixel_total : 45422 time to create 1 rle with old method : 0.05144786834716797 length of segment : 439 time for calcul the mask position with numpy : 0.003083944320678711 nb_pixel_total : 53332 time to create 1 rle with old method : 0.060079097747802734 length of segment : 460 time for calcul the mask position with numpy : 0.0019245147705078125 nb_pixel_total : 47116 time to create 1 rle with old method : 0.0537416934967041 length of segment : 329 time for calcul the mask position with numpy : 0.001682281494140625 nb_pixel_total : 44092 time to create 1 rle with old method : 0.05013442039489746 length of segment : 341 time for calcul the mask position with numpy : 0.0019121170043945312 nb_pixel_total : 42044 time to create 1 rle with old method : 0.04799842834472656 length of segment : 324 time for calcul the mask position with numpy : 0.008288860321044922 nb_pixel_total : 108681 time to create 1 rle with old method : 0.12406182289123535 length of segment : 545 time for calcul the mask position with numpy : 0.004898786544799805 nb_pixel_total : 88336 time to create 1 rle with old method : 0.11912846565246582 length of segment : 460 time for calcul the mask position with numpy : 0.0006442070007324219 nb_pixel_total : 17047 time to create 1 rle with old method : 0.01970529556274414 length of segment : 118 time for calcul the mask position with numpy : 0.0005180835723876953 nb_pixel_total : 22281 time to create 1 rle with old method : 0.0264434814453125 length of segment : 196 time for calcul the mask position with numpy : 0.0016186237335205078 nb_pixel_total : 58112 time to create 1 rle with old method : 0.06709599494934082 length of segment : 397 time for calcul the mask position with numpy : 0.0004906654357910156 nb_pixel_total : 6801 time to create 1 rle with old method : 0.008124113082885742 length of segment : 231 time for calcul the mask position with numpy : 0.0009789466857910156 nb_pixel_total : 11285 time to create 1 rle with old method : 0.013157367706298828 length of segment : 217 time for calcul the mask position with numpy : 0.00037360191345214844 nb_pixel_total : 9300 time to create 1 rle with old method : 0.010888814926147461 length of segment : 218 time for calcul the mask position with numpy : 0.0029134750366210938 nb_pixel_total : 64362 time to create 1 rle with old method : 0.07329607009887695 length of segment : 289 time for calcul the mask position with numpy : 0.0005655288696289062 nb_pixel_total : 18451 time to create 1 rle with old method : 0.020900964736938477 length of segment : 333 time for calcul the mask position with numpy : 0.0010557174682617188 nb_pixel_total : 22322 time to create 1 rle with old method : 0.026018381118774414 length of segment : 239 time for calcul the mask position with numpy : 0.0014998912811279297 nb_pixel_total : 57127 time to create 1 rle with old method : 0.08728814125061035 length of segment : 320 time for calcul the mask position with numpy : 0.002287626266479492 nb_pixel_total : 66626 time to create 1 rle with old method : 0.07697176933288574 length of segment : 397 time for calcul the mask position with numpy : 0.0007493495941162109 nb_pixel_total : 18063 time to create 1 rle with old method : 0.021044492721557617 length of segment : 163 time for calcul the mask position with numpy : 0.0007469654083251953 nb_pixel_total : 21592 time to create 1 rle with old method : 0.02506732940673828 length of segment : 176 time for calcul the mask position with numpy : 0.0018620491027832031 nb_pixel_total : 62069 time to create 1 rle with old method : 0.07189631462097168 length of segment : 306 time for calcul the mask position with numpy : 0.0034165382385253906 nb_pixel_total : 104266 time to create 1 rle with old method : 0.11819148063659668 length of segment : 415 time for calcul the mask position with numpy : 0.00106048583984375 nb_pixel_total : 21490 time to create 1 rle with old method : 0.024378061294555664 length of segment : 269 time for calcul the mask position with numpy : 0.0007083415985107422 nb_pixel_total : 17468 time to create 1 rle with old method : 0.02075648307800293 length of segment : 204 time for calcul the mask position with numpy : 0.0006525516510009766 nb_pixel_total : 21419 time to create 1 rle with old method : 0.02511286735534668 length of segment : 151 time for calcul the mask position with numpy : 0.002472400665283203 nb_pixel_total : 75754 time to create 1 rle with old method : 0.08580231666564941 length of segment : 502 time for calcul the mask position with numpy : 0.0005946159362792969 nb_pixel_total : 21903 time to create 1 rle with old method : 0.025368928909301758 length of segment : 238 time for calcul the mask position with numpy : 0.0010256767272949219 nb_pixel_total : 33342 time to create 1 rle with old method : 0.038286447525024414 length of segment : 206 time for calcul the mask position with numpy : 0.001697540283203125 nb_pixel_total : 45938 time to create 1 rle with old method : 0.051817893981933594 length of segment : 355 time for calcul the mask position with numpy : 0.002294778823852539 nb_pixel_total : 75794 time to create 1 rle with old method : 0.08488321304321289 length of segment : 353 time for calcul the mask position with numpy : 0.0009121894836425781 nb_pixel_total : 22260 time to create 1 rle with old method : 0.025942564010620117 length of segment : 238 time for calcul the mask position with numpy : 0.0006489753723144531 nb_pixel_total : 18312 time to create 1 rle with old method : 0.02126288414001465 length of segment : 136 time for calcul the mask position with numpy : 0.001959562301635742 nb_pixel_total : 60569 time to create 1 rle with old method : 0.06844544410705566 length of segment : 398 time for calcul the mask position with numpy : 0.02223658561706543 nb_pixel_total : 273602 time to create 1 rle with new method : 0.025519371032714844 length of segment : 641 time for calcul the mask position with numpy : 0.0015494823455810547 nb_pixel_total : 32243 time to create 1 rle with old method : 0.037343502044677734 length of segment : 292 time for calcul the mask position with numpy : 0.0006768703460693359 nb_pixel_total : 21123 time to create 1 rle with old method : 0.02466559410095215 length of segment : 265 time for calcul the mask position with numpy : 0.0005223751068115234 nb_pixel_total : 10588 time to create 1 rle with old method : 0.01247406005859375 length of segment : 147 time for calcul the mask position with numpy : 0.0025038719177246094 nb_pixel_total : 90324 time to create 1 rle with old method : 0.10039925575256348 length of segment : 388 time for calcul the mask position with numpy : 0.0012974739074707031 nb_pixel_total : 27608 time to create 1 rle with old method : 0.03212785720825195 length of segment : 288 time for calcul the mask position with numpy : 0.0005168914794921875 nb_pixel_total : 12683 time to create 1 rle with old method : 0.015189170837402344 length of segment : 96 time for calcul the mask position with numpy : 0.0007805824279785156 nb_pixel_total : 14141 time to create 1 rle with old method : 0.01701068878173828 length of segment : 118 time for calcul the mask position with numpy : 0.0009162425994873047 nb_pixel_total : 23334 time to create 1 rle with old method : 0.0277559757232666 length of segment : 120 time for calcul the mask position with numpy : 0.0016775131225585938 nb_pixel_total : 22108 time to create 1 rle with old method : 0.02514195442199707 length of segment : 270 time for calcul the mask position with numpy : 0.0003581047058105469 nb_pixel_total : 9161 time to create 1 rle with old method : 0.011041641235351562 length of segment : 89 time for calcul the mask position with numpy : 0.004784822463989258 nb_pixel_total : 68404 time to create 1 rle with old method : 0.07781052589416504 length of segment : 425 time for calcul the mask position with numpy : 0.004765748977661133 nb_pixel_total : 96804 time to create 1 rle with old method : 0.10807061195373535 length of segment : 808 time for calcul the mask position with numpy : 0.0020499229431152344 nb_pixel_total : 25981 time to create 1 rle with old method : 0.029520750045776367 length of segment : 388 time for calcul the mask position with numpy : 0.0020868778228759766 nb_pixel_total : 48604 time to create 1 rle with old method : 0.05546140670776367 length of segment : 292 time for calcul the mask position with numpy : 0.004326581954956055 nb_pixel_total : 74986 time to create 1 rle with old method : 0.08475971221923828 length of segment : 399 time for calcul the mask position with numpy : 0.000888824462890625 nb_pixel_total : 10891 time to create 1 rle with old method : 0.012583017349243164 length of segment : 140 time for calcul the mask position with numpy : 0.0018889904022216797 nb_pixel_total : 31371 time to create 1 rle with old method : 0.0355837345123291 length of segment : 350 time for calcul the mask position with numpy : 0.00035858154296875 nb_pixel_total : 6495 time to create 1 rle with old method : 0.008071660995483398 length of segment : 65 time for calcul the mask position with numpy : 0.0028753280639648438 nb_pixel_total : 58214 time to create 1 rle with old method : 0.06565546989440918 length of segment : 408 time for calcul the mask position with numpy : 0.0008866786956787109 nb_pixel_total : 21008 time to create 1 rle with old method : 0.02417898178100586 length of segment : 181 time for calcul the mask position with numpy : 0.002466440200805664 nb_pixel_total : 77063 time to create 1 rle with old method : 0.08864331245422363 length of segment : 334 time for calcul the mask position with numpy : 0.003920078277587891 nb_pixel_total : 65425 time to create 1 rle with old method : 0.07639169692993164 length of segment : 497 time for calcul the mask position with numpy : 0.0012428760528564453 nb_pixel_total : 31686 time to create 1 rle with old method : 0.036451101303100586 length of segment : 265 time for calcul the mask position with numpy : 0.0026247501373291016 nb_pixel_total : 27048 time to create 1 rle with old method : 0.03184628486633301 length of segment : 522 time for calcul the mask position with numpy : 0.0014007091522216797 nb_pixel_total : 44005 time to create 1 rle with old method : 0.050292253494262695 length of segment : 298 time for calcul the mask position with numpy : 0.0015273094177246094 nb_pixel_total : 43554 time to create 1 rle with old method : 0.04995560646057129 length of segment : 234 time for calcul the mask position with numpy : 0.0009648799896240234 nb_pixel_total : 21275 time to create 1 rle with old method : 0.02438831329345703 length of segment : 227 time for calcul the mask position with numpy : 0.0023212432861328125 nb_pixel_total : 66017 time to create 1 rle with old method : 0.0746145248413086 length of segment : 454 time for calcul the mask position with numpy : 0.0010755062103271484 nb_pixel_total : 42678 time to create 1 rle with old method : 0.049101829528808594 length of segment : 267 time for calcul the mask position with numpy : 0.003384113311767578 nb_pixel_total : 99098 time to create 1 rle with old method : 0.11163949966430664 length of segment : 519 time for calcul the mask position with numpy : 0.003751516342163086 nb_pixel_total : 116795 time to create 1 rle with old method : 0.1337592601776123 length of segment : 453 time for calcul the mask position with numpy : 0.0008552074432373047 nb_pixel_total : 16425 time to create 1 rle with old method : 0.019152164459228516 length of segment : 210 time for calcul the mask position with numpy : 0.0013735294342041016 nb_pixel_total : 39064 time to create 1 rle with old method : 0.04417228698730469 length of segment : 293 time for calcul the mask position with numpy : 0.0014421939849853516 nb_pixel_total : 51655 time to create 1 rle with old method : 0.05971264839172363 length of segment : 168 time for calcul the mask position with numpy : 0.0011875629425048828 nb_pixel_total : 33880 time to create 1 rle with old method : 0.039540767669677734 length of segment : 253 time for calcul the mask position with numpy : 0.0011012554168701172 nb_pixel_total : 31542 time to create 1 rle with old method : 0.035951852798461914 length of segment : 219 time for calcul the mask position with numpy : 0.0018076896667480469 nb_pixel_total : 52960 time to create 1 rle with old method : 0.06135678291320801 length of segment : 365 time for calcul the mask position with numpy : 0.0007214546203613281 nb_pixel_total : 24684 time to create 1 rle with old method : 0.028709888458251953 length of segment : 205 time for calcul the mask position with numpy : 0.0023040771484375 nb_pixel_total : 45011 time to create 1 rle with old method : 0.05212545394897461 length of segment : 375 time for calcul the mask position with numpy : 0.0025131702423095703 nb_pixel_total : 110579 time to create 1 rle with old method : 0.1251063346862793 length of segment : 399 time for calcul the mask position with numpy : 0.0006418228149414062 nb_pixel_total : 16114 time to create 1 rle with old method : 0.018957853317260742 length of segment : 167 time for calcul the mask position with numpy : 0.002348184585571289 nb_pixel_total : 71605 time to create 1 rle with old method : 0.08197879791259766 length of segment : 481 time for calcul the mask position with numpy : 0.0030324459075927734 nb_pixel_total : 81410 time to create 1 rle with old method : 0.09421849250793457 length of segment : 324 time for calcul the mask position with numpy : 0.002072572708129883 nb_pixel_total : 75189 time to create 1 rle with old method : 0.090362548828125 length of segment : 249 time for calcul the mask position with numpy : 0.002543926239013672 nb_pixel_total : 82014 time to create 1 rle with old method : 0.09251236915588379 length of segment : 616 time for calcul the mask position with numpy : 0.002154111862182617 nb_pixel_total : 48707 time to create 1 rle with old method : 0.05560564994812012 length of segment : 381 time for calcul the mask position with numpy : 0.0009024143218994141 nb_pixel_total : 15164 time to create 1 rle with old method : 0.01790308952331543 length of segment : 183 time for calcul the mask position with numpy : 0.0048828125 nb_pixel_total : 91581 time to create 1 rle with old method : 0.10232782363891602 length of segment : 412 time for calcul the mask position with numpy : 0.0018589496612548828 nb_pixel_total : 36489 time to create 1 rle with old method : 0.041280508041381836 length of segment : 446 time for calcul the mask position with numpy : 0.0010657310485839844 nb_pixel_total : 21729 time to create 1 rle with old method : 0.025319576263427734 length of segment : 227 time for calcul the mask position with numpy : 0.001390218734741211 nb_pixel_total : 31049 time to create 1 rle with old method : 0.03568863868713379 length of segment : 249 time for calcul the mask position with numpy : 0.0062923431396484375 nb_pixel_total : 115343 time to create 1 rle with old method : 0.1320197582244873 length of segment : 748 time for calcul the mask position with numpy : 0.002716064453125 nb_pixel_total : 54887 time to create 1 rle with old method : 0.06190609931945801 length of segment : 541 time for calcul the mask position with numpy : 0.0015895366668701172 nb_pixel_total : 28852 time to create 1 rle with old method : 0.03351306915283203 length of segment : 171 time for calcul the mask position with numpy : 0.01056814193725586 nb_pixel_total : 241628 time to create 1 rle with new method : 0.035254478454589844 length of segment : 825 time for calcul the mask position with numpy : 0.0012347698211669922 nb_pixel_total : 33854 time to create 1 rle with old method : 0.03837323188781738 length of segment : 175 time for calcul the mask position with numpy : 0.0004715919494628906 nb_pixel_total : 25255 time to create 1 rle with old method : 0.029792070388793945 length of segment : 271 time for calcul the mask position with numpy : 0.005017280578613281 nb_pixel_total : 104960 time to create 1 rle with old method : 0.12014603614807129 length of segment : 739 time for calcul the mask position with numpy : 0.002357006072998047 nb_pixel_total : 57516 time to create 1 rle with old method : 0.06574726104736328 length of segment : 357 time for calcul the mask position with numpy : 0.0047338008880615234 nb_pixel_total : 105738 time to create 1 rle with old method : 0.12107539176940918 length of segment : 568 time for calcul the mask position with numpy : 0.004259824752807617 nb_pixel_total : 101184 time to create 1 rle with old method : 0.12467217445373535 length of segment : 404 time for calcul the mask position with numpy : 0.004069328308105469 nb_pixel_total : 81775 time to create 1 rle with old method : 0.09434318542480469 length of segment : 486 time for calcul the mask position with numpy : 0.0016834735870361328 nb_pixel_total : 35135 time to create 1 rle with old method : 0.041106462478637695 length of segment : 271 time for calcul the mask position with numpy : 0.0035147666931152344 nb_pixel_total : 76548 time to create 1 rle with old method : 0.08739018440246582 length of segment : 471 time for calcul the mask position with numpy : 0.0025224685668945312 nb_pixel_total : 38976 time to create 1 rle with old method : 0.044420480728149414 length of segment : 586 time for calcul the mask position with numpy : 0.0003116130828857422 nb_pixel_total : 10461 time to create 1 rle with old method : 0.01219940185546875 length of segment : 173 time spent for convertir_results : 16.645974159240723 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 156 chid ids of type : 3594 Number RLEs to save : 51273 save missing photos in datou_result : time spend for datou_step_exec : 84.82697081565857 time spend to save output : 2.868929147720337 total time spend for step 1 : 87.6958999633789 step2:crop_condition Fri Jul 25 11:41:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 156 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 136 About to insert : list_path_to_insert length 136 new photo from crops ! About to upload 136 photos upload in portfolio : 3736932 init cache_photo without model_param we have 136 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753436557_41413 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 136 photos in the portfolio 3736932 time of upload the photos Elapsed time : 35.15259671211243 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753436595_41413 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.096686601638794 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753436598_41413 This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.638624906539917 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753436603_41413 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.2354063987731934 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753436607_41413 This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5602834224700928 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1373722742, 1373722643, 1373722641, 1373722636, 1373722625, 1373722611, 1373722593, 1373722438] Looping around the photos to save general results len do output : 156 /1373730105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373730284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722742', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722643', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722641', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722636', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722625', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722611', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722593', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722438', None, None, None, None, None, '3351437') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 476 time used for this insertion : 0.06274819374084473 save_final save missing photos in datou_result : time spend for datou_step_exec : 89.31112313270569 time spend to save output : 0.06872725486755371 total time spend for step 2 : 89.37985038757324 step3:rle_unique_nms_with_priority Fri Jul 25 11:43:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 156 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 23 nb_hashtags : 2 time to prepare the origin masks : 8.301541805267334 time for calcul the mask position with numpy : 0.7285809516906738 nb_pixel_total : 7146215 time to create 1 rle with new method : 0.7561483383178711 time for calcul the mask position with numpy : 0.04459381103515625 nb_pixel_total : 13653 time to create 1 rle with old method : 0.015569686889648438 time for calcul the mask position with numpy : 0.05020856857299805 nb_pixel_total : 121584 time to create 1 rle with old method : 0.13888907432556152 time for calcul the mask position with numpy : 0.041300058364868164 nb_pixel_total : 10919 time to create 1 rle with old method : 0.012702465057373047 time for calcul the mask position with numpy : 0.030552148818969727 nb_pixel_total : 20982 time to create 1 rle with old method : 0.022932052612304688 time for calcul the mask position with numpy : 0.02733755111694336 nb_pixel_total : 30581 time to create 1 rle with old method : 0.03351140022277832 time for calcul the mask position with numpy : 0.02588820457458496 nb_pixel_total : 30645 time to create 1 rle with old method : 0.034889936447143555 time for calcul the mask position with numpy : 0.026036977767944336 nb_pixel_total : 58749 time to create 1 rle with old method : 0.06305193901062012 time for calcul the mask position with numpy : 0.025458812713623047 nb_pixel_total : 28454 time to create 1 rle with old method : 0.031121492385864258 time for calcul the mask position with numpy : 0.02620410919189453 nb_pixel_total : 31824 time to create 1 rle with old method : 0.033712148666381836 time for calcul the mask position with numpy : 0.024134397506713867 nb_pixel_total : 8330 time to create 1 rle with old method : 0.009044647216796875 time for calcul the mask position with numpy : 0.02427387237548828 nb_pixel_total : 64236 time to create 1 rle with old method : 0.06929206848144531 time for calcul the mask position with numpy : 0.024032115936279297 nb_pixel_total : 18767 time to create 1 rle with old method : 0.019753694534301758 time for calcul the mask position with numpy : 0.02498912811279297 nb_pixel_total : 135148 time to create 1 rle with old method : 0.15358376502990723 time for calcul the mask position with numpy : 0.02508831024169922 nb_pixel_total : 70939 time to create 1 rle with old method : 0.0782783031463623 time for calcul the mask position with numpy : 0.025405406951904297 nb_pixel_total : 16759 time to create 1 rle with old method : 0.01911139488220215 time for calcul the mask position with numpy : 0.027230501174926758 nb_pixel_total : 48188 time to create 1 rle with old method : 0.05219578742980957 time for calcul the mask position with numpy : 0.02531266212463379 nb_pixel_total : 60813 time to create 1 rle with old method : 0.06522440910339355 time for calcul the mask position with numpy : 0.02877330780029297 nb_pixel_total : 179870 time to create 1 rle with new method : 0.5782265663146973 time for calcul the mask position with numpy : 0.028970003128051758 nb_pixel_total : 27753 time to create 1 rle with old method : 0.030150890350341797 time for calcul the mask position with numpy : 0.023654699325561523 nb_pixel_total : 21033 time to create 1 rle with old method : 0.022691726684570312 time for calcul the mask position with numpy : 0.025202274322509766 nb_pixel_total : 21679 time to create 1 rle with old method : 0.023540735244750977 time for calcul the mask position with numpy : 0.026426076889038086 nb_pixel_total : 54298 time to create 1 rle with old method : 0.06063485145568848 time for calcul the mask position with numpy : 0.02776932716369629 nb_pixel_total : 72981 time to create 1 rle with old method : 0.07990574836730957 create new chi : 3.8682007789611816 time to delete rle : 0.02970409393310547 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 15209 TO DO : save crop sub photo not yet done ! save time : 0.7974276542663574 nb_obj : 29 nb_hashtags : 2 time to prepare the origin masks : 4.841932535171509 time for calcul the mask position with numpy : 0.4446556568145752 nb_pixel_total : 6316420 time to create 1 rle with new method : 0.849461555480957 time for calcul the mask position with numpy : 0.03415822982788086 nb_pixel_total : 89107 time to create 1 rle with old method : 0.10163164138793945 time for calcul the mask position with numpy : 0.03899335861206055 nb_pixel_total : 24383 time to create 1 rle with old method : 0.03715395927429199 time for calcul the mask position with numpy : 0.03435182571411133 nb_pixel_total : 14655 time to create 1 rle with old method : 0.017097949981689453 time for calcul the mask position with numpy : 0.034734249114990234 nb_pixel_total : 136907 time to create 1 rle with old method : 0.15231633186340332 time for calcul the mask position with numpy : 0.03373122215270996 nb_pixel_total : 33363 time to create 1 rle with old method : 0.03916645050048828 time for calcul the mask position with numpy : 0.03377890586853027 nb_pixel_total : 22025 time to create 1 rle with old method : 0.023917198181152344 time for calcul the mask position with numpy : 0.03329324722290039 nb_pixel_total : 12167 time to create 1 rle with old method : 0.013498544692993164 time for calcul the mask position with numpy : 0.0333559513092041 nb_pixel_total : 33654 time to create 1 rle with old method : 0.03531670570373535 time for calcul the mask position with numpy : 0.03356790542602539 nb_pixel_total : 37301 time to create 1 rle with old method : 0.04094338417053223 time for calcul the mask position with numpy : 0.03294515609741211 nb_pixel_total : 59520 time to create 1 rle with old method : 0.06372690200805664 time for calcul the mask position with numpy : 0.03353691101074219 nb_pixel_total : 52479 time to create 1 rle with old method : 0.05495643615722656 time for calcul the mask position with numpy : 0.03371000289916992 nb_pixel_total : 107929 time to create 1 rle with old method : 0.11559534072875977 time for calcul the mask position with numpy : 0.034651756286621094 nb_pixel_total : 115151 time to create 1 rle with old method : 0.12442207336425781 time for calcul the mask position with numpy : 0.03512454032897949 nb_pixel_total : 48847 time to create 1 rle with old method : 0.06324410438537598 time for calcul the mask position with numpy : 0.03775811195373535 nb_pixel_total : 195371 time to create 1 rle with new method : 0.6648223400115967 time for calcul the mask position with numpy : 0.037787675857543945 nb_pixel_total : 114451 time to create 1 rle with old method : 0.14075827598571777 time for calcul the mask position with numpy : 0.033147335052490234 nb_pixel_total : 150188 time to create 1 rle with new method : 0.5644979476928711 time for calcul the mask position with numpy : 0.03296947479248047 nb_pixel_total : 31570 time to create 1 rle with old method : 0.03375577926635742 time for calcul the mask position with numpy : 0.034528493881225586 nb_pixel_total : 81950 time to create 1 rle with old method : 0.08915948867797852 time for calcul the mask position with numpy : 0.033812761306762695 nb_pixel_total : 76193 time to create 1 rle with old method : 0.08090448379516602 time for calcul the mask position with numpy : 0.03327655792236328 nb_pixel_total : 15600 time to create 1 rle with old method : 0.016955137252807617 time for calcul the mask position with numpy : 0.032912254333496094 nb_pixel_total : 7346 time to create 1 rle with old method : 0.007856130599975586 time for calcul the mask position with numpy : 0.03293347358703613 nb_pixel_total : 162878 time to create 1 rle with new method : 0.6034448146820068 time for calcul the mask position with numpy : 0.037567853927612305 nb_pixel_total : 53098 time to create 1 rle with old method : 0.05649375915527344 time for calcul the mask position with numpy : 0.03405261039733887 nb_pixel_total : 3429 time to create 1 rle with old method : 0.004099130630493164 time for calcul the mask position with numpy : 0.0350344181060791 nb_pixel_total : 181593 time to create 1 rle with new method : 0.5804800987243652 time for calcul the mask position with numpy : 0.03404426574707031 nb_pixel_total : 26268 time to create 1 rle with old method : 0.028621673583984375 time for calcul the mask position with numpy : 0.03582406044006348 nb_pixel_total : 25371 time to create 1 rle with old method : 0.028322219848632812 time for calcul the mask position with numpy : 0.03392314910888672 nb_pixel_total : 65186 time to create 1 rle with old method : 0.07182192802429199 create new chi : 6.302232503890991 time to delete rle : 0.0026497840881347656 batch 1 Loaded 59 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 21133 TO DO : save crop sub photo not yet done ! save time : 1.1506304740905762 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 7.718609809875488 time for calcul the mask position with numpy : 0.66241455078125 nb_pixel_total : 7467521 time to create 1 rle with new method : 0.7358307838439941 time for calcul the mask position with numpy : 0.024584531784057617 nb_pixel_total : 22322 time to create 1 rle with old method : 0.023954153060913086 time for calcul the mask position with numpy : 0.03935122489929199 nb_pixel_total : 18451 time to create 1 rle with old method : 0.020093917846679688 time for calcul the mask position with numpy : 0.03676724433898926 nb_pixel_total : 64362 time to create 1 rle with old method : 0.06991434097290039 time for calcul the mask position with numpy : 0.035683631896972656 nb_pixel_total : 9300 time to create 1 rle with old method : 0.009990453720092773 time for calcul the mask position with numpy : 0.024938583374023438 nb_pixel_total : 11285 time to create 1 rle with old method : 0.012192726135253906 time for calcul the mask position with numpy : 0.02593231201171875 nb_pixel_total : 5410 time to create 1 rle with old method : 0.005988121032714844 time for calcul the mask position with numpy : 0.025174856185913086 nb_pixel_total : 55452 time to create 1 rle with old method : 0.05961465835571289 time for calcul the mask position with numpy : 0.025691509246826172 nb_pixel_total : 22281 time to create 1 rle with old method : 0.02450108528137207 time for calcul the mask position with numpy : 0.025066614151000977 nb_pixel_total : 17047 time to create 1 rle with old method : 0.018784761428833008 time for calcul the mask position with numpy : 0.025245189666748047 nb_pixel_total : 88336 time to create 1 rle with old method : 0.09748053550720215 time for calcul the mask position with numpy : 0.02558732032775879 nb_pixel_total : 108681 time to create 1 rle with old method : 0.11625146865844727 time for calcul the mask position with numpy : 0.02550792694091797 nb_pixel_total : 42044 time to create 1 rle with old method : 0.04693865776062012 time for calcul the mask position with numpy : 0.025343656539916992 nb_pixel_total : 44092 time to create 1 rle with old method : 0.047582149505615234 time for calcul the mask position with numpy : 0.025230884552001953 nb_pixel_total : 47116 time to create 1 rle with old method : 0.05194568634033203 time for calcul the mask position with numpy : 0.024316072463989258 nb_pixel_total : 53332 time to create 1 rle with old method : 0.05634450912475586 time for calcul the mask position with numpy : 0.026381969451904297 nb_pixel_total : 45422 time to create 1 rle with old method : 0.04873299598693848 time for calcul the mask position with numpy : 0.025005578994750977 nb_pixel_total : 38877 time to create 1 rle with old method : 0.0419163703918457 time for calcul the mask position with numpy : 0.027112722396850586 nb_pixel_total : 90859 time to create 1 rle with old method : 0.10298013687133789 time for calcul the mask position with numpy : 0.029626131057739258 nb_pixel_total : 24338 time to create 1 rle with old method : 0.03970527648925781 time for calcul the mask position with numpy : 0.025960922241210938 nb_pixel_total : 17872 time to create 1 rle with old method : 0.019687414169311523 create new chi : 2.901794672012329 time to delete rle : 0.002083301544189453 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 14742 TO DO : save crop sub photo not yet done ! save time : 0.7957210540771484 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 5.384154319763184 time for calcul the mask position with numpy : 0.6524944305419922 nb_pixel_total : 7773281 time to create 1 rle with new method : 0.7864596843719482 time for calcul the mask position with numpy : 0.02447032928466797 nb_pixel_total : 33342 time to create 1 rle with old method : 0.03716611862182617 time for calcul the mask position with numpy : 0.02488541603088379 nb_pixel_total : 21903 time to create 1 rle with old method : 0.027503490447998047 time for calcul the mask position with numpy : 0.02426886558532715 nb_pixel_total : 75754 time to create 1 rle with old method : 0.08135223388671875 time for calcul the mask position with numpy : 0.025020360946655273 nb_pixel_total : 21419 time to create 1 rle with old method : 0.025543928146362305 time for calcul the mask position with numpy : 0.024704456329345703 nb_pixel_total : 17468 time to create 1 rle with old method : 0.01917552947998047 time for calcul the mask position with numpy : 0.023814678192138672 nb_pixel_total : 21490 time to create 1 rle with old method : 0.024078845977783203 time for calcul the mask position with numpy : 0.025915145874023438 nb_pixel_total : 104266 time to create 1 rle with old method : 0.11319828033447266 time for calcul the mask position with numpy : 0.025695323944091797 nb_pixel_total : 62069 time to create 1 rle with old method : 0.08417224884033203 time for calcul the mask position with numpy : 0.026680469512939453 nb_pixel_total : 21592 time to create 1 rle with old method : 0.026178598403930664 time for calcul the mask position with numpy : 0.025068283081054688 nb_pixel_total : 18063 time to create 1 rle with old method : 0.019777536392211914 time for calcul the mask position with numpy : 0.025014162063598633 nb_pixel_total : 66626 time to create 1 rle with old method : 0.07185173034667969 time for calcul the mask position with numpy : 0.02444767951965332 nb_pixel_total : 57127 time to create 1 rle with old method : 0.061364173889160156 create new chi : 2.374140977859497 time to delete rle : 0.001998424530029297 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 8854 TO DO : save crop sub photo not yet done ! save time : 0.540827751159668 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 5.08949089050293 time for calcul the mask position with numpy : 0.6085836887359619 nb_pixel_total : 7603356 time to create 1 rle with new method : 1.0123047828674316 time for calcul the mask position with numpy : 0.023934364318847656 nb_pixel_total : 12683 time to create 1 rle with old method : 0.014243841171264648 time for calcul the mask position with numpy : 0.023589372634887695 nb_pixel_total : 27608 time to create 1 rle with old method : 0.02950453758239746 time for calcul the mask position with numpy : 0.024729490280151367 nb_pixel_total : 90324 time to create 1 rle with old method : 0.09842395782470703 time for calcul the mask position with numpy : 0.024571657180786133 nb_pixel_total : 10588 time to create 1 rle with old method : 0.011808633804321289 time for calcul the mask position with numpy : 0.025055885314941406 nb_pixel_total : 21123 time to create 1 rle with old method : 0.023406505584716797 time for calcul the mask position with numpy : 0.02456355094909668 nb_pixel_total : 32243 time to create 1 rle with old method : 0.035535573959350586 time for calcul the mask position with numpy : 0.02682018280029297 nb_pixel_total : 273602 time to create 1 rle with new method : 0.77317214012146 time for calcul the mask position with numpy : 0.027133703231811523 nb_pixel_total : 60569 time to create 1 rle with old method : 0.07463312149047852 time for calcul the mask position with numpy : 0.03205275535583496 nb_pixel_total : 18312 time to create 1 rle with old method : 0.026277780532836914 time for calcul the mask position with numpy : 0.032332658767700195 nb_pixel_total : 22260 time to create 1 rle with old method : 0.024976491928100586 time for calcul the mask position with numpy : 0.027083158493041992 nb_pixel_total : 75794 time to create 1 rle with old method : 0.0856781005859375 time for calcul the mask position with numpy : 0.02629709243774414 nb_pixel_total : 45938 time to create 1 rle with old method : 0.05191516876220703 create new chi : 3.256941556930542 time to delete rle : 0.0013659000396728516 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 9354 TO DO : save crop sub photo not yet done ! save time : 0.5106768608093262 nb_obj : 23 nb_hashtags : 4 time to prepare the origin masks : 10.307186365127563 time for calcul the mask position with numpy : 0.8493726253509521 nb_pixel_total : 7371450 time to create 1 rle with new method : 0.8007588386535645 time for calcul the mask position with numpy : 0.03652191162109375 nb_pixel_total : 41556 time to create 1 rle with old method : 0.04973745346069336 time for calcul the mask position with numpy : 0.052094459533691406 nb_pixel_total : 66017 time to create 1 rle with old method : 0.07596158981323242 time for calcul the mask position with numpy : 0.04051518440246582 nb_pixel_total : 21275 time to create 1 rle with old method : 0.02901911735534668 time for calcul the mask position with numpy : 0.04719686508178711 nb_pixel_total : 43554 time to create 1 rle with old method : 0.0559694766998291 time for calcul the mask position with numpy : 0.04176640510559082 nb_pixel_total : 44005 time to create 1 rle with old method : 0.04967808723449707 time for calcul the mask position with numpy : 0.04573345184326172 nb_pixel_total : 20888 time to create 1 rle with old method : 0.02384161949157715 time for calcul the mask position with numpy : 0.043138980865478516 nb_pixel_total : 31686 time to create 1 rle with old method : 0.03561234474182129 time for calcul the mask position with numpy : 0.04577898979187012 nb_pixel_total : 65425 time to create 1 rle with old method : 0.0720067024230957 time for calcul the mask position with numpy : 0.04104256629943848 nb_pixel_total : 77063 time to create 1 rle with old method : 0.08521580696105957 time for calcul the mask position with numpy : 0.04122161865234375 nb_pixel_total : 21008 time to create 1 rle with old method : 0.02661585807800293 time for calcul the mask position with numpy : 0.02520298957824707 nb_pixel_total : 58214 time to create 1 rle with old method : 0.06346344947814941 time for calcul the mask position with numpy : 0.02713799476623535 nb_pixel_total : 6495 time to create 1 rle with old method : 0.01083230972290039 time for calcul the mask position with numpy : 0.026567697525024414 nb_pixel_total : 31371 time to create 1 rle with old method : 0.04393935203552246 time for calcul the mask position with numpy : 0.025030136108398438 nb_pixel_total : 10891 time to create 1 rle with old method : 0.012265443801879883 time for calcul the mask position with numpy : 0.027025222778320312 nb_pixel_total : 74986 time to create 1 rle with old method : 0.08818888664245605 time for calcul the mask position with numpy : 0.039649009704589844 nb_pixel_total : 48604 time to create 1 rle with old method : 0.07096195220947266 time for calcul the mask position with numpy : 0.04064011573791504 nb_pixel_total : 25981 time to create 1 rle with old method : 0.030623674392700195 time for calcul the mask position with numpy : 0.04143381118774414 nb_pixel_total : 96804 time to create 1 rle with old method : 0.10719466209411621 time for calcul the mask position with numpy : 0.04373502731323242 nb_pixel_total : 68404 time to create 1 rle with old method : 0.07580137252807617 time for calcul the mask position with numpy : 0.03879666328430176 nb_pixel_total : 9140 time to create 1 rle with old method : 0.010286092758178711 time for calcul the mask position with numpy : 0.03883814811706543 nb_pixel_total : 22108 time to create 1 rle with old method : 0.025479555130004883 time for calcul the mask position with numpy : 0.03865694999694824 nb_pixel_total : 23334 time to create 1 rle with old method : 0.02569270133972168 time for calcul the mask position with numpy : 0.04275774955749512 nb_pixel_total : 14141 time to create 1 rle with old method : 0.016140222549438477 create new chi : 3.67222261428833 time to delete rle : 0.0037539005279541016 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 16243 TO DO : save crop sub photo not yet done ! save time : 0.9307570457458496 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 6.503572702407837 time for calcul the mask position with numpy : 0.6050126552581787 nb_pixel_total : 7347393 time to create 1 rle with new method : 0.8338930606842041 time for calcul the mask position with numpy : 0.03859663009643555 nb_pixel_total : 82014 time to create 1 rle with old method : 0.09561324119567871 time for calcul the mask position with numpy : 0.04475283622741699 nb_pixel_total : 75189 time to create 1 rle with old method : 0.08394384384155273 time for calcul the mask position with numpy : 0.043299198150634766 nb_pixel_total : 81410 time to create 1 rle with old method : 0.08981919288635254 time for calcul the mask position with numpy : 0.04043006896972656 nb_pixel_total : 70587 time to create 1 rle with old method : 0.07616496086120605 time for calcul the mask position with numpy : 0.04206085205078125 nb_pixel_total : 16114 time to create 1 rle with old method : 0.017483949661254883 time for calcul the mask position with numpy : 0.03977155685424805 nb_pixel_total : 110579 time to create 1 rle with old method : 0.12301230430603027 time for calcul the mask position with numpy : 0.03696894645690918 nb_pixel_total : 45011 time to create 1 rle with old method : 0.04809427261352539 time for calcul the mask position with numpy : 0.023396730422973633 nb_pixel_total : 24684 time to create 1 rle with old method : 0.025738954544067383 time for calcul the mask position with numpy : 0.0248260498046875 nb_pixel_total : 52960 time to create 1 rle with old method : 0.0557100772857666 time for calcul the mask position with numpy : 0.023891925811767578 nb_pixel_total : 31542 time to create 1 rle with old method : 0.033591270446777344 time for calcul the mask position with numpy : 0.0236053466796875 nb_pixel_total : 33880 time to create 1 rle with old method : 0.03556108474731445 time for calcul the mask position with numpy : 0.024098634719848633 nb_pixel_total : 51655 time to create 1 rle with old method : 0.05378270149230957 time for calcul the mask position with numpy : 0.024768352508544922 nb_pixel_total : 39064 time to create 1 rle with old method : 0.041075706481933594 time for calcul the mask position with numpy : 0.029075145721435547 nb_pixel_total : 16425 time to create 1 rle with old method : 0.01711249351501465 time for calcul the mask position with numpy : 0.03943586349487305 nb_pixel_total : 116795 time to create 1 rle with old method : 0.12458491325378418 time for calcul the mask position with numpy : 0.037567138671875 nb_pixel_total : 99098 time to create 1 rle with old method : 0.10406732559204102 create new chi : 3.0444695949554443 time to delete rle : 0.0019278526306152344 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 12724 TO DO : save crop sub photo not yet done ! save time : 0.7764873504638672 nb_obj : 21 nb_hashtags : 3 time to prepare the origin masks : 7.5068039894104 time for calcul the mask position with numpy : 0.6353940963745117 nb_pixel_total : 6945453 time to create 1 rle with new method : 0.750666618347168 time for calcul the mask position with numpy : 0.029540300369262695 nb_pixel_total : 10461 time to create 1 rle with old method : 0.012533426284790039 time for calcul the mask position with numpy : 0.04198002815246582 nb_pixel_total : 38976 time to create 1 rle with old method : 0.045861005783081055 time for calcul the mask position with numpy : 0.02594733238220215 nb_pixel_total : 76548 time to create 1 rle with old method : 0.08674454689025879 time for calcul the mask position with numpy : 0.029201269149780273 nb_pixel_total : 35031 time to create 1 rle with old method : 0.03968334197998047 time for calcul the mask position with numpy : 0.026163101196289062 nb_pixel_total : 81649 time to create 1 rle with old method : 0.10619211196899414 time for calcul the mask position with numpy : 0.025780677795410156 nb_pixel_total : 101184 time to create 1 rle with old method : 0.11237287521362305 time for calcul the mask position with numpy : 0.024759769439697266 nb_pixel_total : 105738 time to create 1 rle with old method : 0.12469482421875 time for calcul the mask position with numpy : 0.034204721450805664 nb_pixel_total : 57516 time to create 1 rle with old method : 0.06701159477233887 time for calcul the mask position with numpy : 0.02608323097229004 nb_pixel_total : 104960 time to create 1 rle with old method : 0.1113746166229248 time for calcul the mask position with numpy : 0.023429155349731445 nb_pixel_total : 25255 time to create 1 rle with old method : 0.02832508087158203 time for calcul the mask position with numpy : 0.02450704574584961 nb_pixel_total : 33854 time to create 1 rle with old method : 0.037346601486206055 time for calcul the mask position with numpy : 0.02549457550048828 nb_pixel_total : 233974 time to create 1 rle with new method : 0.862281084060669 time for calcul the mask position with numpy : 0.0248110294342041 nb_pixel_total : 28852 time to create 1 rle with old method : 0.03173518180847168 time for calcul the mask position with numpy : 0.024586915969848633 nb_pixel_total : 54887 time to create 1 rle with old method : 0.05981707572937012 time for calcul the mask position with numpy : 0.02526259422302246 nb_pixel_total : 115343 time to create 1 rle with old method : 0.12437248229980469 time for calcul the mask position with numpy : 0.024249553680419922 nb_pixel_total : 31049 time to create 1 rle with old method : 0.03359174728393555 time for calcul the mask position with numpy : 0.023943424224853516 nb_pixel_total : 21729 time to create 1 rle with old method : 0.023398876190185547 time for calcul the mask position with numpy : 0.02440190315246582 nb_pixel_total : 36489 time to create 1 rle with old method : 0.04041457176208496 time for calcul the mask position with numpy : 0.02462029457092285 nb_pixel_total : 91581 time to create 1 rle with old method : 0.10033082962036133 time for calcul the mask position with numpy : 0.024854421615600586 nb_pixel_total : 15164 time to create 1 rle with old method : 0.016553878784179688 time for calcul the mask position with numpy : 0.025004863739013672 nb_pixel_total : 48707 time to create 1 rle with old method : 0.05623888969421387 create new chi : 4.130268573760986 time to delete rle : 0.0029075145721435547 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19256 TO DO : save crop sub photo not yet done ! save time : 1.0011928081512451 map_output_result : {1373722742: (0.0, 'Should be the crop_list due to order', 0), 1373722643: (0.0, 'Should be the crop_list due to order', 0), 1373722641: (0.0, 'Should be the crop_list due to order', 0), 1373722636: (0.0, 'Should be the crop_list due to order', 0), 1373722625: (0.0, 'Should be the crop_list due to order', 0), 1373722611: (0.0, 'Should be the crop_list due to order', 0), 1373722593: (0.0, 'Should be the crop_list due to order', 0), 1373722438: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1373722742, 1373722643, 1373722641, 1373722636, 1373722625, 1373722611, 1373722593, 1373722438] Looping around the photos to save general results len do output : 8 /1373722742.Didn't retrieve data . /1373722643.Didn't retrieve data . /1373722641.Didn't retrieve data . /1373722636.Didn't retrieve data . /1373722625.Didn't retrieve data . /1373722611.Didn't retrieve data . /1373722593.Didn't retrieve data . /1373722438.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722742', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722643', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722641', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722636', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722625', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722611', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722593', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722438', None, None, None, None, None, '3351437') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012678384780883789 save_final save missing photos in datou_result : time spend for datou_step_exec : 93.24365305900574 time spend to save output : 0.014253854751586914 total time spend for step 3 : 93.25790691375732 step4:ventilate_hashtags_in_portfolio Fri Jul 25 11:45:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25325810 get user id for portfolio 25325810 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25325810 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pehd','mal_croppe','papier','environnement','flou','pet_fonce','metal','autre','pet_clair','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25325810 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pehd','mal_croppe','papier','environnement','flou','pet_fonce','metal','autre','pet_clair','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25325810 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pehd','mal_croppe','papier','environnement','flou','pet_fonce','metal','autre','pet_clair','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25326299,25326300,25326301,25326302,25326303,25326304,25326305,25326306,25326307,25326308,25326309?tags=background,pehd,mal_croppe,papier,environnement,flou,pet_fonce,metal,autre,pet_clair,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1373722742, 1373722643, 1373722641, 1373722636, 1373722625, 1373722611, 1373722593, 1373722438] Looping around the photos to save general results len do output : 1 /25325810. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722742', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722643', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722641', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722636', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722625', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722611', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722593', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722438', None, None, None, None, None, '3351437') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014066934585571289 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.63450026512146 time spend to save output : 0.014310598373413086 total time spend for step 4 : 1.648810863494873 step5:final Fri Jul 25 11:45:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1373722742: ('0.1263519814573688',), 1373722643: ('0.1263519814573688',), 1373722641: ('0.1263519814573688',), 1373722636: ('0.1263519814573688',), 1373722625: ('0.1263519814573688',), 1373722611: ('0.1263519814573688',), 1373722593: ('0.1263519814573688',), 1373722438: ('0.1263519814573688',)} new output for save of step final : {1373722742: ('0.1263519814573688',), 1373722643: ('0.1263519814573688',), 1373722641: ('0.1263519814573688',), 1373722636: ('0.1263519814573688',), 1373722625: ('0.1263519814573688',), 1373722611: ('0.1263519814573688',), 1373722593: ('0.1263519814573688',), 1373722438: ('0.1263519814573688',)} [1373722742, 1373722643, 1373722641, 1373722636, 1373722625, 1373722611, 1373722593, 1373722438] Looping around the photos to save general results len do output : 8 /1373722742.Didn't retrieve data . /1373722643.Didn't retrieve data . /1373722641.Didn't retrieve data . /1373722636.Didn't retrieve data . /1373722625.Didn't retrieve data . /1373722611.Didn't retrieve data . /1373722593.Didn't retrieve data . /1373722438.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722742', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722643', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722641', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722636', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722625', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722611', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722593', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722438', None, None, None, None, None, '3351437') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012606143951416016 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14371681213378906 time spend to save output : 0.013052940368652344 total time spend for step 5 : 0.1567697525024414 step6:blur_detection Fri Jul 25 11:45:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05.jpg resize: (2160, 3840) 1373722742 -7.546721668205393 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56.jpg resize: (2160, 3840) 1373722643 -7.1450391841448315 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c.jpg resize: (2160, 3840) 1373722641 -7.295529968270833 treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce.jpg resize: (2160, 3840) 1373722636 -7.64002888588679 treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0.jpg resize: (2160, 3840) 1373722625 -7.605020686038079 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4.jpg resize: (2160, 3840) 1373722611 -7.660901916971166 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca.jpg resize: (2160, 3840) 1373722593 -7.627968232485165 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402.jpg resize: (2160, 3840) 1373722438 -7.460147930898517 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808179_0.png resize: (250, 361) 1373730105 -3.056116156284335 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808180_0.png resize: (394, 180) 1373730106 -2.5127157410484404 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808181_0.png resize: (185, 152) 1373730108 -4.933212380457114 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808182_0.png resize: (216, 150) 1373730109 -4.368690600154041 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808183_0.png resize: (206, 228) 1373730110 -4.1392567854226705 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808184_0.png resize: (496, 564) 1373730112 -2.1518856774955775 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808185_0.png resize: (355, 264) 1373730113 0.5953596423109873 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808186_0.png resize: (247, 250) 1373730114 -3.9481737079822645 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808187_0.png resize: (161, 203) 1373730115 -3.212118410800927 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808188_0.png resize: (308, 340) 1373730117 -0.10087180473982237 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808189_0.png resize: (434, 535) 1373730118 -4.884353233153625 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808190_0.png resize: (123, 205) 1373730119 -4.764955978442178 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808191_0.png resize: (279, 310) 1373730121 -1.5778207036367438 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808192_0.png resize: (72, 147) 1373730122 -3.77056157253937 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808193_0.png resize: (220, 224) 1373730123 -2.6036880657281114 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808194_0.png resize: (235, 182) 1373730124 -2.892140125872072 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808195_0.png resize: (296, 273) 1373730126 -5.044017709733884 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808196_0.png resize: (189, 242) 1373730127 -1.796267925012327 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808197_0.png resize: (202, 225) 1373730128 -2.0760563758513073 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808198_0.png resize: (243, 110) 1373730130 -4.38485264806034 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808200_0.png resize: (461, 442) 1373730131 -4.7565666575480945 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808201_0.png resize: (228, 98) 1373730132 -4.084940196003536 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808202_0.png resize: (213, 551) 1373730133 -1.3774167203975634 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808203_0.png resize: (249, 317) 1373730135 -2.5960438245325594 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808204_0.png resize: (296, 403) 1373730136 1.8191395329480964 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808205_0.png resize: (225, 162) 1373730137 -1.5013267502953616 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808206_0.png resize: (422, 394) 1373730139 -0.7275026241591944 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808207_0.png resize: (297, 142) 1373730140 -3.9687782514478256 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808208_0.png resize: (385, 667) 1373730141 -4.174107025676131 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808209_0.png resize: (247, 169) 1373730142 -4.519933828857577 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808210_0.png resize: (129, 180) 1373730144 -2.9438259921049017 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808211_0.png resize: (89, 111) 1373730145 -2.6550725740876557 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808212_0.png resize: (501, 337) 1373730146 -3.644097071841984 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808213_0.png resize: (613, 473) 1373730147 -2.500756694189959 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808214_0.png resize: (343, 337) 1373730148 -4.545954563964314 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808215_0.png resize: (283, 136) 1373730149 -4.629898493832456 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808216_0.png resize: (208, 246) 1373730150 -4.663108566291682 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808217_0.png resize: (449, 418) 1373730151 -2.2831538142673864 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808218_0.png resize: (587, 244) 1373730152 -4.782690247544534 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808220_0.png resize: (159, 119) 1373730153 -4.005744395528752 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808221_0.png resize: (213, 145) 1373730154 -4.799067898597773 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808222_0.png resize: (383, 525) 1373730155 -5.308796005821858 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808223_0.png resize: (151, 157) 1373730156 -5.275440192733688 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808224_0.png resize: (473, 516) 1373730157 -3.098705995240471 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808225_0.png resize: (385, 193) 1373730158 -4.156722061171598 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808226_0.png resize: (227, 237) 1373730159 -4.189366457852876 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808227_0.png resize: (447, 227) 1373730160 -3.8218429177545663 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808228_0.png resize: (358, 259) 1373730161 -4.119707521039114 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808229_0.png resize: (213, 238) 1373730162 -3.5525529558387037 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808230_0.png resize: (277, 347) 1373730163 -4.590110591335934 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808231_0.png resize: (174, 144) 1373730164 -3.162925454370014 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808232_0.png resize: (181, 212) 1373730165 -3.2416234006774207 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808233_0.png resize: (459, 358) 1373730168 -3.8569522150402347 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808234_0.png resize: (159, 384) 1373730169 -0.9708941433398133 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808235_0.png resize: (433, 260) 1373730170 -1.4768691735954202 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808236_0.png resize: (383, 251) 1373730171 -4.01138603216905 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808237_0.png resize: (326, 209) 1373730172 -2.790474308619488 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808238_0.png resize: (341, 160) 1373730173 -3.3934293426251356 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808239_0.png resize: (315, 222) 1373730174 -3.260466405151808 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808240_0.png resize: (464, 641) 1373730175 -4.06095362678071 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808241_0.png resize: (437, 290) 1373730176 -3.41802958301209 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808243_0.png resize: (196, 180) 1373730177 -3.523289900718922 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808244_0.png resize: (379, 281) 1373730178 -4.643509789645531 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808245_0.png resize: (130, 98) 1373730179 -2.112153800534883 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808247_0.png resize: (215, 69) 1373730180 -3.979779929160829 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808248_0.png resize: (249, 380) 1373730181 -4.392577717242882 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808249_0.png resize: (312, 97) 1373730182 -4.773892199977119 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808250_0.png resize: (207, 144) 1373730183 -2.7741069576928044 treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808251_0.png resize: (320, 222) 1373730184 0.001013296811990439 treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808252_0.png resize: (383, 273) 1373730185 -3.240725741199387 treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808254_0.png resize: (176, 188) 1373730186 -3.45892559696343 treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808255_0.png resize: (301, 310) 1373730187 -3.0025563646423903 treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808256_0.png resize: (406, 481) 1373730188 -4.267075988769317 treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808257_0.png resize: (269, 97) 1373730189 -4.60382844611288 treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808258_0.png resize: (139, 240) 1373730191 -3.804556714403364 treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808260_0.png resize: (373, 383) 1373730192 -4.566001747766542 treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808261_0.png resize: (238, 142) 1373730193 -2.371027525367229 treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808262_0.png resize: (201, 264) 1373730194 -1.5849208842143805 treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808263_0.png resize: (355, 211) 1373730195 -4.862464588356028 treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808264_0.png resize: (353, 349) 1373730196 -2.170199351980709 treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808265_0.png resize: (238, 156) 1373730197 -2.630936758248195 treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808267_0.png resize: (376, 253) 1373730198 -3.6425951309275533 treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808268_0.png resize: (641, 748) 1373730199 -3.8533705674511376 treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808269_0.png resize: (178, 313) 1373730200 -4.180427897497999 treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808270_0.png resize: (239, 187) 1373730201 -3.1141574710795785 treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808273_0.png resize: (278, 171) 1373730202 -3.544747610690077 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808276_0.png resize: (120, 241) 1373730203 -3.056905421042273 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808277_0.png resize: (270, 125) 1373730204 -3.7042316171195724 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808278_0.png resize: (70, 196) 1373730205 -3.950341136157073 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808279_0.png resize: (317, 321) 1373730206 -3.7416003988058515 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808280_0.png resize: (667, 208) 1373730207 -4.1246522662651754 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808281_0.png resize: (366, 143) 1373730208 -3.2577058036402073 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808283_0.png resize: (380, 297) 1373730209 -3.4156879826874924 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808284_0.png resize: (140, 117) 1373730210 -4.869984572904405 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808285_0.png resize: (342, 131) 1373730211 -4.7987701707923796 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808286_0.png resize: (56, 194) 1373730212 -4.431458313499185 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808287_0.png resize: (376, 281) 1373730213 -3.662491611897154 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808289_0.png resize: (310, 348) 1373730214 -2.688605336129594 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808290_0.png resize: (421, 400) 1373730215 -4.401800846290973 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808291_0.png resize: (265, 181) 1373730216 -4.475892467830921 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808292_0.png resize: (343, 355) 1373730217 -2.9802568713634265 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808293_0.png resize: (290, 208) 1373730218 -4.999225888692812 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808295_0.png resize: (227, 135) 1373730219 -3.1967705085913183 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808296_0.png resize: (364, 247) 1373730220 -2.843560582993234 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808297_0.png resize: (266, 272) 1373730221 -4.5066448084100115 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808298_0.png resize: (427, 400) 1373730222 -1.4709668319482752 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808299_0.png resize: (451, 412) 1373730223 -1.1605268247926497 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808300_0.png resize: (191, 137) 1373730224 -3.789203810787901 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808301_0.png resize: (286, 196) 1373730225 -1.9415054379342274 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808302_0.png resize: (138, 477) 1373730226 -3.688844736074842 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808303_0.png resize: (224, 224) 1373730227 -2.7117401294262877 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808304_0.png resize: (196, 247) 1373730228 -3.231564835475804 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808305_0.png resize: (364, 288) 1373730229 -2.184214505876867 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808306_0.png resize: (205, 204) 1373730230 -2.6751326834193745 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808308_0.png resize: (388, 385) 1373730231 -0.9268628037813849 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808310_0.png resize: (459, 205) 1373730232 -5.379323796650895 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808311_0.png resize: (205, 712) 1373730233 -3.8678487879467203 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808312_0.png resize: (248, 392) 1373730234 -0.7061464474263104 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808313_0.png resize: (416, 294) 1373730235 -5.014601100672219 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808314_0.png resize: (381, 189) 1373730236 -4.661254917438729 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808315_0.png resize: (165, 189) 1373730237 -4.601590550038132 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808316_0.png resize: (412, 449) 1373730238 -1.1686470142946799 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808317_0.png resize: (402, 143) 1373730239 -4.503492694375906 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808318_0.png resize: (227, 149) 1373730240 -3.090192631048791 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808319_0.png resize: (249, 212) 1373730241 -3.3618015012758753 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808320_0.png resize: (478, 541) 1373730242 -4.930865362553625 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808321_0.png resize: (421, 205) 1373730243 -4.2954981061098945 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808322_0.png resize: (171, 352) 1373730244 -3.5732668199366233 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808323_0.png resize: (619, 685) 1373730245 -5.110629868703447 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808324_0.png resize: (175, 282) 1373730247 -3.1795062670920897 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808325_0.png resize: (200, 194) 1373730248 -3.131220659468494 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808329_0.png resize: (399, 460) 1373730249 -3.347809204768781 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808330_0.png resize: (431, 468) 1373730250 -3.0178142831480828 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808331_0.png resize: (254, 356) 1373730251 -2.0743178081998703 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808333_0.png resize: (320, 290) 1373730252 -3.9649561671480966 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808334_0.png resize: (167, 80) 1373730253 -2.9298635357450777 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808246_0.png resize: (216, 120) 1373730257 -4.070911505723797 treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808253_0.png resize: (162, 158) 1373730258 -2.8791274221787613 treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808259_0.png resize: (150, 188) 1373730259 -3.634488798260994 treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808266_0.png resize: (134, 176) 1373730260 -3.0781639611529177 treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808271_0.png resize: (146, 92) 1373730261 -3.879731978607867 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808275_0.png resize: (114, 171) 1373730262 -2.8101000796225195 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808282_0.png resize: (283, 236) 1373730263 -4.710637149007639 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808309_0.png resize: (167, 148) 1373730264 -4.061058338281621 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808327_0.png resize: (355, 255) 1373730266 -4.696407688756156 treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808242_0.png resize: (112, 193) 1373730268 -3.9805695064687168 treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808199_0.png resize: (319, 571) 1373730274 -4.952209721691676 treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808219_0.png resize: (412, 479) 1373730275 -5.408469334918413 treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808272_0.png resize: (320, 389) 1373730276 -4.871597467328137 treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808274_0.png resize: (95, 161) 1373730277 -4.538370861837469 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808288_0.png resize: (173, 165) 1373730278 -4.334769852938156 treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808307_0.png resize: (375, 281) 1373730279 -4.1788565049897635 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808326_0.png resize: (534, 344) 1373730280 -4.754873751919274 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808328_0.png resize: (421, 462) 1373730281 -4.942334241693682 treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808332_0.png resize: (440, 282) 1373730282 -3.979827306843825 treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808294_0.png resize: (234, 243) 1373730284 -4.4721075483167745 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 164 time used for this insertion : 0.023348093032836914 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 164 time used for this insertion : 0.033601999282836914 save missing photos in datou_result : time spend for datou_step_exec : 35.42687225341797 time spend to save output : 0.06310153007507324 total time spend for step 6 : 35.48997378349304 step7:brightness Fri Jul 25 11:45:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05.jpg treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56.jpg treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c.jpg treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce.jpg treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0.jpg treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4.jpg treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca.jpg treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402.jpg treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808179_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808180_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808181_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808182_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808183_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808184_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808185_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808186_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808187_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808188_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808189_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808190_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808191_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808192_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808193_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808194_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808195_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808196_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808197_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808198_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808200_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808201_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808202_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808203_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808204_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808205_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808206_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808207_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808208_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808209_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808210_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808211_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808212_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808213_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808214_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808215_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808216_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808217_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808218_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808220_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808221_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808222_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808223_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808224_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808225_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808226_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808227_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808228_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808229_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808230_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808231_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808232_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808233_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808234_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808235_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808236_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808237_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808238_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808239_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808240_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808241_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808243_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808244_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808245_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808247_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808248_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808249_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808250_0.png treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808251_0.png treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808252_0.png treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808254_0.png treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808255_0.png treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808256_0.png treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808257_0.png treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808258_0.png treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808260_0.png treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808261_0.png treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808262_0.png treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808263_0.png treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808264_0.png treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808265_0.png treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808267_0.png treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808268_0.png treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808269_0.png treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808270_0.png treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808273_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808276_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808277_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808278_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808279_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808280_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808281_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808283_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808284_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808285_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808286_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808287_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808289_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808290_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808291_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808292_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808293_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808295_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808296_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808297_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808298_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808299_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808300_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808301_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808302_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808303_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808304_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808305_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808306_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808308_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808310_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808311_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808312_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808313_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808314_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808315_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808316_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808317_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808318_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808319_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808320_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808321_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808322_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808323_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808324_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808325_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808329_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808330_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808331_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808333_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808334_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808246_0.png treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808253_0.png treat image : temp/1753436429_41413_1373722636_b32d663e62d5b388896e72c44c3d39ce_rle_crop_3893808259_0.png treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808266_0.png treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808271_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808275_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808282_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808309_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808327_0.png treat image : temp/1753436429_41413_1373722641_ffc432cdaa39ecad01923ec8abf3b82c_rle_crop_3893808242_0.png treat image : temp/1753436429_41413_1373722742_43527965b46074776967710d9477ff05_rle_crop_3893808199_0.png treat image : temp/1753436429_41413_1373722643_5fa5fdd0a9d805de6dd2ce5be3fc7b56_rle_crop_3893808219_0.png treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808272_0.png treat image : temp/1753436429_41413_1373722625_16bdfe2f70c7c98388dce5c8487d7db0_rle_crop_3893808274_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808288_0.png treat image : temp/1753436429_41413_1373722593_1abdf464b7ff9d68f94e6b8f5c7cbcca_rle_crop_3893808307_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808326_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808328_0.png treat image : temp/1753436429_41413_1373722438_0bc5f13f3c2bc21b82f5e5be8788e402_rle_crop_3893808332_0.png treat image : temp/1753436429_41413_1373722611_09117190c542e8717a749ce855c41db4_rle_crop_3893808294_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 164 time used for this insertion : 0.0295407772064209 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 164 time used for this insertion : 0.04468560218811035 save missing photos in datou_result : time spend for datou_step_exec : 9.192415237426758 time spend to save output : 0.0887150764465332 total time spend for step 7 : 9.281130313873291 step8:velours_tree Fri Jul 25 11:45:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.0987482070922852 time spend to save output : 4.601478576660156e-05 total time spend for step 8 : 1.0987942218780518 step9:send_mail_cod Fri Jul 25 11:45:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25325810_25-07-2025_11_45_49.pdf 25326299 imagette253262991753436749 25326300 imagette253263001753436749 25326301 imagette253263011753436749 25326302 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette253263021753436749 25326304 imagette253263041753436750 25326305 imagette253263051753436750 25326306 change filename to text .imagette253263061753436750 25326307 change filename to text .imagette253263071753436750 25326308 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette253263081753436750 25326309 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette253263091753436751 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25325810 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25326299,25326300,25326301,25326302,25326303,25326304,25326305,25326306,25326307,25326308,25326309?tags=background,pehd,mal_croppe,papier,environnement,flou,pet_fonce,metal,autre,pet_clair,carton args[1373722742] : ((1373722742, -7.546721668205393, 492609224), (1373722742, 1.3497289206421137, 2107752395), '0.1263519814573688') We are sending mail with results at report@fotonower.com args[1373722643] : ((1373722643, -7.1450391841448315, 492609224), (1373722643, 0.9194295551200156, 2107752395), '0.1263519814573688') We are sending mail with results at report@fotonower.com args[1373722641] : ((1373722641, -7.295529968270833, 492609224), (1373722641, 0.9261771241862983, 2107752395), '0.1263519814573688') We are sending mail with results at report@fotonower.com args[1373722636] : ((1373722636, -7.64002888588679, 492609224), (1373722636, 0.9353563261603111, 2107752395), '0.1263519814573688') We are sending mail with results at report@fotonower.com args[1373722625] : ((1373722625, -7.605020686038079, 492609224), (1373722625, 0.940915674568275, 2107752395), '0.1263519814573688') We are sending mail with results at report@fotonower.com args[1373722611] : ((1373722611, -7.660901916971166, 492609224), (1373722611, 0.9559725889909645, 2107752395), '0.1263519814573688') We are sending mail with results at report@fotonower.com args[1373722593] : ((1373722593, -7.627968232485165, 492609224), (1373722593, 1.0825475759378405, 2107752395), '0.1263519814573688') We are sending mail with results at report@fotonower.com args[1373722438] : ((1373722438, -7.460147930898517, 492609224), (1373722438, 0.8878149802225801, 2107752395), '0.1263519814573688') We are sending mail with results at report@fotonower.com refus_total : 0.1263519814573688 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25325810 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25325810_25-07-2025_11_45_49.pdf results_Auto_P25325810_25-07-2025_11_45_49.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25325810_25-07-2025_11_45_49.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25325810','results_Auto_P25325810_25-07-2025_11_45_49.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25325810_25-07-2025_11_45_49.pdf','pdf','','0.55','0.1263519814573688') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25325810

https://www.fotonower.com/image?json=false&list_photos_id=1373722742
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373722643
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373722641
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373722636
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373722625
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373722611
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373722593
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373722438
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.64%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/25326302?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/25326306?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25326307?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25326308?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25326309?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25325810_25-07-2025_11_45_49.pdf.

Lien vers velours :https://www.fotonower.com/velours/25326299,25326300,25326301,25326302,25326303,25326304,25326305,25326306,25326307,25326308,25326309?tags=background,pehd,mal_croppe,papier,environnement,flou,pet_fonce,metal,autre,pet_clair,carton.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 25 Jul 2025 09:45:54 GMT Content-Length: 0 Connection: close X-Message-Id: R4jJWfxCSW-Jtu5i_72kbQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1373722742, 1373722643, 1373722641, 1373722636, 1373722625, 1373722611, 1373722593, 1373722438] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722742', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722643', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722641', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722636', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722625', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722611', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722593', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722438', None, None, None, None, None, '3351437') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014033079147338867 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.548663139343262 time spend to save output : 0.014344453811645508 total time spend for step 9 : 5.563007593154907 step10:split_time_score Fri Jul 25 11:45:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 25072025 25325810 Nombre de photos uploadées : 8 / 23040 (0%) 25072025 25325810 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 25072025 25325810 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 1.0728836059570312e-05 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.00042247772216796875 elapsed_time : insert_dashboard_record_day_entry 0.028159379959106445 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.054167143903853805 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25312451_25-07-2025_07_32_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25312451 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25312451 AND mptpi.`type`=3726 To do Qualite : 0.06383829687305634 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25312453_25-07-2025_07_39_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25312453 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25312453 AND mptpi.`type`=3726 To do Qualite : 0.06471374068870918 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25312457_25-07-2025_07_08_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25312457 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25312457 AND mptpi.`type`=3726 To do Qualite : 0.01642281275008202 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25312459_25-07-2025_07_28_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25312459 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25312459 AND mptpi.`type`=3726 To do Qualite : 0.031425342682482246 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25319576_25-07-2025_09_43_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25319576 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25319576 AND mptpi.`type`=3726 To do Qualite : 0.1263519814573688 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25325810_25-07-2025_11_45_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25325810 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25325810 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25325815 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'25072025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1373722742, 1373722643, 1373722641, 1373722636, 1373722625, 1373722611, 1373722593, 1373722438] Looping around the photos to save general results len do output : 1 /25325810Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722742', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722643', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722641', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722636', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722625', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722611', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722593', None, None, None, None, None, '3351437') ('3318', None, None, None, None, None, None, None, '3351437') ('3318', '25325810', '1373722438', None, None, None, None, None, '3351437') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014583349227905273 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.4333477020263672 time spend to save output : 0.014804363250732422 total time spend for step 10 : 1.4481520652770996 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 154.93user 125.32system 5:31.31elapsed 84%CPU (0avgtext+0avgdata 5424128maxresident)k 870328inputs+130512outputs (22850major+14480146minor)pagefaults 0swaps