python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 698640 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3354047'] with mtr_portfolio_ids : ['25335919'] and first list_photo_ids : [] new path : /proc/698640/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.795595407485962 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Jul 25 16:40:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10733 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-25 16:40:31.668327: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-25 16:40:31.695414: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-25 16:40:31.697330: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f2d1c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-25 16:40:31.697381: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-25 16:40:31.700530: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-25 16:40:31.827850: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x19caef70 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-25 16:40:31.827898: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-25 16:40:31.829405: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-25 16:40:31.829823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-25 16:40:31.836170: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-25 16:40:31.838910: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-25 16:40:31.839320: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-25 16:40:31.842441: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-25 16:40:31.843910: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-25 16:40:31.848606: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-25 16:40:31.850106: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-25 16:40:31.850182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-25 16:40:31.850959: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-25 16:40:31.850977: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-25 16:40:31.850986: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-25 16:40:31.852369: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9947 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-25 16:40:32.130108: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-25 16:40:32.130253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-25 16:40:32.130287: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-25 16:40:32.130319: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-25 16:40:32.130349: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-25 16:40:32.130379: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-25 16:40:32.130408: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-25 16:40:32.130438: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-25 16:40:32.132561: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-25 16:40:32.133663: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-25 16:40:32.133694: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-25 16:40:32.133710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-25 16:40:32.133725: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-25 16:40:32.133740: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-25 16:40:32.133754: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-25 16:40:32.133769: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-25 16:40:32.133784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-25 16:40:32.134982: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-25 16:40:32.135014: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-25 16:40:32.135022: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-25 16:40:32.135030: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-25 16:40:32.136285: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9947 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-25 16:40:44.298821: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-25 16:40:44.496322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 48 Detection mask done ! Trying to reset tf kernel 699237 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 818 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9540 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.004543781280517578 nb_pixel_total : 116642 time to create 1 rle with old method : 0.13187551498413086 length of segment : 474 time for calcul the mask position with numpy : 0.0008990764617919922 nb_pixel_total : 29840 time to create 1 rle with old method : 0.042111873626708984 length of segment : 276 time for calcul the mask position with numpy : 0.004735231399536133 nb_pixel_total : 174600 time to create 1 rle with new method : 0.014804363250732422 length of segment : 729 time for calcul the mask position with numpy : 0.0005035400390625 nb_pixel_total : 23138 time to create 1 rle with old method : 0.027515649795532227 length of segment : 174 time for calcul the mask position with numpy : 0.00040221214294433594 nb_pixel_total : 26903 time to create 1 rle with old method : 0.03211069107055664 length of segment : 126 time for calcul the mask position with numpy : 0.0007195472717285156 nb_pixel_total : 45576 time to create 1 rle with old method : 0.053124427795410156 length of segment : 362 time for calcul the mask position with numpy : 0.0003647804260253906 nb_pixel_total : 19467 time to create 1 rle with old method : 0.021854877471923828 length of segment : 257 time for calcul the mask position with numpy : 0.0014417171478271484 nb_pixel_total : 85907 time to create 1 rle with old method : 0.10030364990234375 length of segment : 943 time for calcul the mask position with numpy : 0.0004367828369140625 nb_pixel_total : 26953 time to create 1 rle with old method : 0.03233838081359863 length of segment : 137 time for calcul the mask position with numpy : 0.00041747093200683594 nb_pixel_total : 24151 time to create 1 rle with old method : 0.03211021423339844 length of segment : 165 time for calcul the mask position with numpy : 0.0008530616760253906 nb_pixel_total : 51323 time to create 1 rle with old method : 0.06240963935852051 length of segment : 284 time for calcul the mask position with numpy : 0.0003902912139892578 nb_pixel_total : 19979 time to create 1 rle with old method : 0.024272441864013672 length of segment : 184 time for calcul the mask position with numpy : 0.0007190704345703125 nb_pixel_total : 36331 time to create 1 rle with old method : 0.042589426040649414 length of segment : 365 time for calcul the mask position with numpy : 0.0016367435455322266 nb_pixel_total : 98406 time to create 1 rle with old method : 0.11385655403137207 length of segment : 371 time for calcul the mask position with numpy : 0.0005865097045898438 nb_pixel_total : 29724 time to create 1 rle with old method : 0.03489041328430176 length of segment : 295 time for calcul the mask position with numpy : 0.0014040470123291016 nb_pixel_total : 78456 time to create 1 rle with old method : 0.09729981422424316 length of segment : 466 time for calcul the mask position with numpy : 0.0014820098876953125 nb_pixel_total : 73855 time to create 1 rle with old method : 0.08660435676574707 length of segment : 400 time for calcul the mask position with numpy : 0.005575895309448242 nb_pixel_total : 249117 time to create 1 rle with new method : 0.02269124984741211 length of segment : 705 time for calcul the mask position with numpy : 0.0006341934204101562 nb_pixel_total : 21738 time to create 1 rle with old method : 0.02549433708190918 length of segment : 250 time for calcul the mask position with numpy : 0.0005974769592285156 nb_pixel_total : 26576 time to create 1 rle with old method : 0.031125783920288086 length of segment : 335 time for calcul the mask position with numpy : 0.0015294551849365234 nb_pixel_total : 53789 time to create 1 rle with old method : 0.06950020790100098 length of segment : 374 time for calcul the mask position with numpy : 0.0009851455688476562 nb_pixel_total : 39546 time to create 1 rle with old method : 0.0477294921875 length of segment : 165 time for calcul the mask position with numpy : 0.004680633544921875 nb_pixel_total : 132083 time to create 1 rle with old method : 0.17233514785766602 length of segment : 472 time for calcul the mask position with numpy : 0.004124164581298828 nb_pixel_total : 94909 time to create 1 rle with old method : 0.11063337326049805 length of segment : 386 time for calcul the mask position with numpy : 0.001119375228881836 nb_pixel_total : 27025 time to create 1 rle with old method : 0.0317387580871582 length of segment : 162 time for calcul the mask position with numpy : 0.0006291866302490234 nb_pixel_total : 9890 time to create 1 rle with old method : 0.01171255111694336 length of segment : 142 time for calcul the mask position with numpy : 0.0008137226104736328 nb_pixel_total : 16731 time to create 1 rle with old method : 0.019735336303710938 length of segment : 179 time for calcul the mask position with numpy : 0.0015511512756347656 nb_pixel_total : 32163 time to create 1 rle with old method : 0.040009260177612305 length of segment : 192 time for calcul the mask position with numpy : 0.0012052059173583984 nb_pixel_total : 26799 time to create 1 rle with old method : 0.030773639678955078 length of segment : 253 time for calcul the mask position with numpy : 0.002727985382080078 nb_pixel_total : 76202 time to create 1 rle with old method : 0.08564615249633789 length of segment : 443 time for calcul the mask position with numpy : 0.0011239051818847656 nb_pixel_total : 24498 time to create 1 rle with old method : 0.028209686279296875 length of segment : 250 time for calcul the mask position with numpy : 0.0006732940673828125 nb_pixel_total : 11033 time to create 1 rle with old method : 0.012588024139404297 length of segment : 183 time for calcul the mask position with numpy : 0.0018672943115234375 nb_pixel_total : 42971 time to create 1 rle with old method : 0.050232648849487305 length of segment : 551 time for calcul the mask position with numpy : 0.0037238597869873047 nb_pixel_total : 114364 time to create 1 rle with old method : 0.13788986206054688 length of segment : 566 time for calcul the mask position with numpy : 0.0018074512481689453 nb_pixel_total : 48066 time to create 1 rle with old method : 0.05676627159118652 length of segment : 313 time for calcul the mask position with numpy : 0.002359151840209961 nb_pixel_total : 45931 time to create 1 rle with old method : 0.05369877815246582 length of segment : 284 time for calcul the mask position with numpy : 0.005327463150024414 nb_pixel_total : 128110 time to create 1 rle with old method : 0.1496438980102539 length of segment : 663 time for calcul the mask position with numpy : 0.0008168220520019531 nb_pixel_total : 21801 time to create 1 rle with old method : 0.026090383529663086 length of segment : 140 time for calcul the mask position with numpy : 0.0013647079467773438 nb_pixel_total : 33394 time to create 1 rle with old method : 0.03945326805114746 length of segment : 245 time for calcul the mask position with numpy : 0.007685661315917969 nb_pixel_total : 227703 time to create 1 rle with new method : 0.01484227180480957 length of segment : 789 time for calcul the mask position with numpy : 0.0034112930297851562 nb_pixel_total : 87572 time to create 1 rle with old method : 0.10322237014770508 length of segment : 350 time for calcul the mask position with numpy : 0.0021898746490478516 nb_pixel_total : 50603 time to create 1 rle with old method : 0.06102919578552246 length of segment : 324 time for calcul the mask position with numpy : 0.0005671977996826172 nb_pixel_total : 11694 time to create 1 rle with old method : 0.014274358749389648 length of segment : 105 time for calcul the mask position with numpy : 0.0012781620025634766 nb_pixel_total : 34765 time to create 1 rle with old method : 0.04256916046142578 length of segment : 237 time for calcul the mask position with numpy : 0.0043354034423828125 nb_pixel_total : 113640 time to create 1 rle with old method : 0.1313769817352295 length of segment : 332 time for calcul the mask position with numpy : 0.00038909912109375 nb_pixel_total : 6037 time to create 1 rle with old method : 0.0070993900299072266 length of segment : 159 time for calcul the mask position with numpy : 0.003939390182495117 nb_pixel_total : 101092 time to create 1 rle with old method : 0.11796188354492188 length of segment : 547 time for calcul the mask position with numpy : 0.001493215560913086 nb_pixel_total : 27685 time to create 1 rle with old method : 0.031713247299194336 length of segment : 464 time for calcul the mask position with numpy : 0.0033540725708007812 nb_pixel_total : 64330 time to create 1 rle with old method : 0.07315826416015625 length of segment : 332 time for calcul the mask position with numpy : 0.004899740219116211 nb_pixel_total : 93336 time to create 1 rle with old method : 0.10451745986938477 length of segment : 604 time for calcul the mask position with numpy : 0.0008461475372314453 nb_pixel_total : 25992 time to create 1 rle with old method : 0.03133106231689453 length of segment : 222 time for calcul the mask position with numpy : 0.001081228256225586 nb_pixel_total : 22948 time to create 1 rle with old method : 0.028500080108642578 length of segment : 147 time for calcul the mask position with numpy : 0.004725933074951172 nb_pixel_total : 125806 time to create 1 rle with old method : 0.15140748023986816 length of segment : 263 time for calcul the mask position with numpy : 0.0011546611785888672 nb_pixel_total : 24378 time to create 1 rle with old method : 0.02921128273010254 length of segment : 199 time for calcul the mask position with numpy : 0.001314401626586914 nb_pixel_total : 27135 time to create 1 rle with old method : 0.03245282173156738 length of segment : 208 time for calcul the mask position with numpy : 0.0065326690673828125 nb_pixel_total : 151215 time to create 1 rle with new method : 0.011459589004516602 length of segment : 560 time for calcul the mask position with numpy : 0.0010683536529541016 nb_pixel_total : 27155 time to create 1 rle with old method : 0.0325164794921875 length of segment : 148 time for calcul the mask position with numpy : 0.0024814605712890625 nb_pixel_total : 51367 time to create 1 rle with old method : 0.060324668884277344 length of segment : 393 time for calcul the mask position with numpy : 0.0010485649108886719 nb_pixel_total : 15610 time to create 1 rle with old method : 0.018406391143798828 length of segment : 319 time for calcul the mask position with numpy : 0.0009374618530273438 nb_pixel_total : 12823 time to create 1 rle with old method : 0.015158891677856445 length of segment : 213 time for calcul the mask position with numpy : 0.0014641284942626953 nb_pixel_total : 15530 time to create 1 rle with old method : 0.018373966217041016 length of segment : 209 time for calcul the mask position with numpy : 0.0007660388946533203 nb_pixel_total : 13495 time to create 1 rle with old method : 0.023094654083251953 length of segment : 131 time for calcul the mask position with numpy : 0.0024068355560302734 nb_pixel_total : 35144 time to create 1 rle with old method : 0.04695248603820801 length of segment : 475 time for calcul the mask position with numpy : 0.001003265380859375 nb_pixel_total : 10756 time to create 1 rle with old method : 0.01327061653137207 length of segment : 187 time for calcul the mask position with numpy : 0.0016069412231445312 nb_pixel_total : 26863 time to create 1 rle with old method : 0.03142809867858887 length of segment : 328 time for calcul the mask position with numpy : 0.0015354156494140625 nb_pixel_total : 34060 time to create 1 rle with old method : 0.03890705108642578 length of segment : 225 time for calcul the mask position with numpy : 0.0026788711547851562 nb_pixel_total : 64724 time to create 1 rle with old method : 0.07474184036254883 length of segment : 550 time for calcul the mask position with numpy : 0.0015633106231689453 nb_pixel_total : 45406 time to create 1 rle with old method : 0.05149030685424805 length of segment : 375 time for calcul the mask position with numpy : 0.0014426708221435547 nb_pixel_total : 21671 time to create 1 rle with old method : 0.026083707809448242 length of segment : 188 time for calcul the mask position with numpy : 0.0032885074615478516 nb_pixel_total : 87257 time to create 1 rle with old method : 0.10318708419799805 length of segment : 612 time for calcul the mask position with numpy : 0.018892765045166016 nb_pixel_total : 264676 time to create 1 rle with new method : 0.04347038269042969 length of segment : 676 time for calcul the mask position with numpy : 0.0007770061492919922 nb_pixel_total : 19410 time to create 1 rle with old method : 0.023342370986938477 length of segment : 243 time for calcul the mask position with numpy : 0.005041837692260742 nb_pixel_total : 160103 time to create 1 rle with new method : 0.010320663452148438 length of segment : 464 time for calcul the mask position with numpy : 0.004270315170288086 nb_pixel_total : 126456 time to create 1 rle with old method : 0.14847612380981445 length of segment : 412 time for calcul the mask position with numpy : 0.0010099411010742188 nb_pixel_total : 23253 time to create 1 rle with old method : 0.028554201126098633 length of segment : 200 time for calcul the mask position with numpy : 0.0007042884826660156 nb_pixel_total : 12669 time to create 1 rle with old method : 0.01575469970703125 length of segment : 223 time for calcul the mask position with numpy : 0.0008008480072021484 nb_pixel_total : 21621 time to create 1 rle with old method : 0.027367830276489258 length of segment : 179 time for calcul the mask position with numpy : 0.0038912296295166016 nb_pixel_total : 90612 time to create 1 rle with old method : 0.1071920394897461 length of segment : 464 time for calcul the mask position with numpy : 0.0021333694458007812 nb_pixel_total : 69365 time to create 1 rle with old method : 0.08539986610412598 length of segment : 338 time for calcul the mask position with numpy : 0.0011403560638427734 nb_pixel_total : 27624 time to create 1 rle with old method : 0.03295588493347168 length of segment : 277 time for calcul the mask position with numpy : 0.0011012554168701172 nb_pixel_total : 30387 time to create 1 rle with old method : 0.0365908145904541 length of segment : 229 time for calcul the mask position with numpy : 0.0007703304290771484 nb_pixel_total : 12980 time to create 1 rle with old method : 0.01564192771911621 length of segment : 230 time for calcul the mask position with numpy : 0.004223346710205078 nb_pixel_total : 135291 time to create 1 rle with old method : 0.16357755661010742 length of segment : 414 time for calcul the mask position with numpy : 0.0012013912200927734 nb_pixel_total : 31089 time to create 1 rle with old method : 0.03679227828979492 length of segment : 376 time for calcul the mask position with numpy : 0.0008907318115234375 nb_pixel_total : 38659 time to create 1 rle with old method : 0.04576683044433594 length of segment : 293 time for calcul the mask position with numpy : 0.0014982223510742188 nb_pixel_total : 46848 time to create 1 rle with old method : 0.055437326431274414 length of segment : 244 time for calcul the mask position with numpy : 0.007073402404785156 nb_pixel_total : 187149 time to create 1 rle with new method : 0.016321182250976562 length of segment : 794 time for calcul the mask position with numpy : 0.0007956027984619141 nb_pixel_total : 22252 time to create 1 rle with old method : 0.030073165893554688 length of segment : 169 time for calcul the mask position with numpy : 0.0005090236663818359 nb_pixel_total : 12354 time to create 1 rle with old method : 0.01575469970703125 length of segment : 125 time for calcul the mask position with numpy : 0.0005838871002197266 nb_pixel_total : 22708 time to create 1 rle with old method : 0.02811717987060547 length of segment : 161 time for calcul the mask position with numpy : 0.0012233257293701172 nb_pixel_total : 35081 time to create 1 rle with old method : 0.0406341552734375 length of segment : 277 time for calcul the mask position with numpy : 0.0010242462158203125 nb_pixel_total : 18313 time to create 1 rle with old method : 0.022962093353271484 length of segment : 242 time for calcul the mask position with numpy : 0.0009093284606933594 nb_pixel_total : 21245 time to create 1 rle with old method : 0.024567604064941406 length of segment : 261 time for calcul the mask position with numpy : 0.002274751663208008 nb_pixel_total : 76101 time to create 1 rle with old method : 0.08977723121643066 length of segment : 262 time for calcul the mask position with numpy : 0.0004954338073730469 nb_pixel_total : 19052 time to create 1 rle with old method : 0.02245187759399414 length of segment : 292 time for calcul the mask position with numpy : 0.0006628036499023438 nb_pixel_total : 16120 time to create 1 rle with old method : 0.01967930793762207 length of segment : 144 time for calcul the mask position with numpy : 0.0006041526794433594 nb_pixel_total : 15669 time to create 1 rle with old method : 0.018776893615722656 length of segment : 139 time for calcul the mask position with numpy : 0.0009701251983642578 nb_pixel_total : 34472 time to create 1 rle with old method : 0.040314435958862305 length of segment : 235 time for calcul the mask position with numpy : 0.0009660720825195312 nb_pixel_total : 20389 time to create 1 rle with old method : 0.02509927749633789 length of segment : 233 time for calcul the mask position with numpy : 0.0008776187896728516 nb_pixel_total : 20611 time to create 1 rle with old method : 0.024851560592651367 length of segment : 199 time for calcul the mask position with numpy : 0.0003674030303955078 nb_pixel_total : 13480 time to create 1 rle with old method : 0.016689300537109375 length of segment : 121 time for calcul the mask position with numpy : 0.0004515647888183594 nb_pixel_total : 15091 time to create 1 rle with old method : 0.018587589263916016 length of segment : 116 time for calcul the mask position with numpy : 0.0006253719329833984 nb_pixel_total : 20093 time to create 1 rle with old method : 0.024433374404907227 length of segment : 122 time for calcul the mask position with numpy : 0.0060613155364990234 nb_pixel_total : 151433 time to create 1 rle with new method : 0.013133764266967773 length of segment : 546 time for calcul the mask position with numpy : 0.022381305694580078 nb_pixel_total : 409737 time to create 1 rle with new method : 0.12623906135559082 length of segment : 1272 time for calcul the mask position with numpy : 0.0008242130279541016 nb_pixel_total : 12489 time to create 1 rle with old method : 0.014711856842041016 length of segment : 235 time for calcul the mask position with numpy : 0.00147247314453125 nb_pixel_total : 18218 time to create 1 rle with old method : 0.021260976791381836 length of segment : 295 time for calcul the mask position with numpy : 0.0047113895416259766 nb_pixel_total : 115737 time to create 1 rle with old method : 0.13231444358825684 length of segment : 509 time for calcul the mask position with numpy : 0.0006377696990966797 nb_pixel_total : 10697 time to create 1 rle with old method : 0.013159751892089844 length of segment : 148 time for calcul the mask position with numpy : 0.0028052330017089844 nb_pixel_total : 99663 time to create 1 rle with old method : 0.11973977088928223 length of segment : 525 time for calcul the mask position with numpy : 0.0004379749298095703 nb_pixel_total : 9080 time to create 1 rle with old method : 0.010952949523925781 length of segment : 248 time for calcul the mask position with numpy : 0.00033354759216308594 nb_pixel_total : 9494 time to create 1 rle with old method : 0.011794805526733398 length of segment : 83 time for calcul the mask position with numpy : 0.0007729530334472656 nb_pixel_total : 34111 time to create 1 rle with old method : 0.041318655014038086 length of segment : 299 time for calcul the mask position with numpy : 0.0020952224731445312 nb_pixel_total : 45899 time to create 1 rle with old method : 0.0545041561126709 length of segment : 586 time for calcul the mask position with numpy : 0.0016589164733886719 nb_pixel_total : 24017 time to create 1 rle with old method : 0.029490232467651367 length of segment : 332 time for calcul the mask position with numpy : 0.005190610885620117 nb_pixel_total : 120061 time to create 1 rle with old method : 0.14066195487976074 length of segment : 378 time for calcul the mask position with numpy : 0.0028760433197021484 nb_pixel_total : 86547 time to create 1 rle with old method : 0.10103631019592285 length of segment : 389 time for calcul the mask position with numpy : 0.0006089210510253906 nb_pixel_total : 15905 time to create 1 rle with old method : 0.01935577392578125 length of segment : 204 time for calcul the mask position with numpy : 0.0032579898834228516 nb_pixel_total : 62605 time to create 1 rle with old method : 0.07193922996520996 length of segment : 327 time for calcul the mask position with numpy : 0.0005118846893310547 nb_pixel_total : 11028 time to create 1 rle with old method : 0.0125885009765625 length of segment : 162 time for calcul the mask position with numpy : 0.007401943206787109 nb_pixel_total : 161300 time to create 1 rle with new method : 0.009332418441772461 length of segment : 741 time for calcul the mask position with numpy : 0.001218557357788086 nb_pixel_total : 28684 time to create 1 rle with old method : 0.033449411392211914 length of segment : 125 time for calcul the mask position with numpy : 0.004283905029296875 nb_pixel_total : 119498 time to create 1 rle with old method : 0.13936257362365723 length of segment : 506 time for calcul the mask position with numpy : 0.00150299072265625 nb_pixel_total : 33412 time to create 1 rle with old method : 0.039653778076171875 length of segment : 312 time for calcul the mask position with numpy : 0.0015277862548828125 nb_pixel_total : 28542 time to create 1 rle with old method : 0.03470039367675781 length of segment : 282 time for calcul the mask position with numpy : 0.0017428398132324219 nb_pixel_total : 37435 time to create 1 rle with old method : 0.044130802154541016 length of segment : 432 time for calcul the mask position with numpy : 0.0007770061492919922 nb_pixel_total : 13536 time to create 1 rle with old method : 0.016657590866088867 length of segment : 122 time for calcul the mask position with numpy : 0.003854990005493164 nb_pixel_total : 84266 time to create 1 rle with old method : 0.09808826446533203 length of segment : 374 time for calcul the mask position with numpy : 0.0016505718231201172 nb_pixel_total : 32809 time to create 1 rle with old method : 0.03873133659362793 length of segment : 220 time for calcul the mask position with numpy : 0.0008759498596191406 nb_pixel_total : 20879 time to create 1 rle with old method : 0.024933576583862305 length of segment : 137 time for calcul the mask position with numpy : 0.0014934539794921875 nb_pixel_total : 43357 time to create 1 rle with old method : 0.04948568344116211 length of segment : 276 time for calcul the mask position with numpy : 0.0007922649383544922 nb_pixel_total : 18676 time to create 1 rle with old method : 0.02123093605041504 length of segment : 285 time for calcul the mask position with numpy : 0.00087738037109375 nb_pixel_total : 19253 time to create 1 rle with old method : 0.022261619567871094 length of segment : 174 time for calcul the mask position with numpy : 0.0027894973754882812 nb_pixel_total : 25224 time to create 1 rle with old method : 0.029675006866455078 length of segment : 329 time for calcul the mask position with numpy : 0.0024538040161132812 nb_pixel_total : 37715 time to create 1 rle with old method : 0.04288625717163086 length of segment : 658 time for calcul the mask position with numpy : 0.0006878376007080078 nb_pixel_total : 13814 time to create 1 rle with old method : 0.016805648803710938 length of segment : 118 time for calcul the mask position with numpy : 0.002126932144165039 nb_pixel_total : 37094 time to create 1 rle with old method : 0.04477238655090332 length of segment : 257 time for calcul the mask position with numpy : 0.007352590560913086 nb_pixel_total : 131767 time to create 1 rle with old method : 0.15201544761657715 length of segment : 673 time for calcul the mask position with numpy : 0.002808809280395508 nb_pixel_total : 39167 time to create 1 rle with old method : 0.04448533058166504 length of segment : 534 time for calcul the mask position with numpy : 0.004206180572509766 nb_pixel_total : 108754 time to create 1 rle with old method : 0.12564706802368164 length of segment : 458 time for calcul the mask position with numpy : 0.0037691593170166016 nb_pixel_total : 63955 time to create 1 rle with old method : 0.07341504096984863 length of segment : 358 time for calcul the mask position with numpy : 0.0014710426330566406 nb_pixel_total : 28489 time to create 1 rle with old method : 0.03273487091064453 length of segment : 248 time for calcul the mask position with numpy : 0.006006956100463867 nb_pixel_total : 151589 time to create 1 rle with new method : 0.010525941848754883 length of segment : 914 time for calcul the mask position with numpy : 0.0006203651428222656 nb_pixel_total : 9980 time to create 1 rle with old method : 0.011818647384643555 length of segment : 136 time for calcul the mask position with numpy : 0.0023984909057617188 nb_pixel_total : 54800 time to create 1 rle with old method : 0.062155723571777344 length of segment : 286 time for calcul the mask position with numpy : 0.001531839370727539 nb_pixel_total : 27944 time to create 1 rle with old method : 0.03318357467651367 length of segment : 191 time for calcul the mask position with numpy : 0.002849578857421875 nb_pixel_total : 63849 time to create 1 rle with old method : 0.07246518135070801 length of segment : 375 time for calcul the mask position with numpy : 0.0022726058959960938 nb_pixel_total : 60166 time to create 1 rle with old method : 0.06946659088134766 length of segment : 327 time for calcul the mask position with numpy : 0.0018739700317382812 nb_pixel_total : 21604 time to create 1 rle with old method : 0.02628493309020996 length of segment : 277 time for calcul the mask position with numpy : 0.0016684532165527344 nb_pixel_total : 27710 time to create 1 rle with old method : 0.033316612243652344 length of segment : 192 time for calcul the mask position with numpy : 0.0030472278594970703 nb_pixel_total : 60338 time to create 1 rle with old method : 0.07182621955871582 length of segment : 735 time spent for convertir_results : 15.585710763931274 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 151 chid ids of type : 3594 Number RLEs to save : 50200 save missing photos in datou_result : time spend for datou_step_exec : 83.11681628227234 time spend to save output : 3.078348398208618 total time spend for step 1 : 86.19516468048096 step2:crop_condition Fri Jul 25 16:41:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 151 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 130 About to insert : list_path_to_insert length 130 new photo from crops ! About to upload 130 photos upload in portfolio : 3736932 init cache_photo without model_param we have 130 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753454551_698640 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 130 photos in the portfolio 3736932 time of upload the photos Elapsed time : 34.15656328201294 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753454589_698640 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.2839977741241455 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753454598_698640 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5783522129058838 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1373748192, 1373748159, 1373748141, 1373748103, 1373748036, 1373747743, 1373747733, 1373747716] Looping around the photos to save general results len do output : 151 /1373766976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373766999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373767228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748192', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748159', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748141', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748103', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748036', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747743', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747733', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747716', None, None, None, None, None, '3354047') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 461 time used for this insertion : 0.05848860740661621 save_final save missing photos in datou_result : time spend for datou_step_exec : 84.5186026096344 time spend to save output : 0.06222200393676758 total time spend for step 2 : 84.58082461357117 step3:rle_unique_nms_with_priority Fri Jul 25 16:43:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 151 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 3.7175917625427246 time for calcul the mask position with numpy : 0.851900577545166 nb_pixel_total : 7772327 time to create 1 rle with new method : 0.7805581092834473 time for calcul the mask position with numpy : 0.029495954513549805 nb_pixel_total : 85907 time to create 1 rle with old method : 0.1370081901550293 time for calcul the mask position with numpy : 0.027640581130981445 nb_pixel_total : 19467 time to create 1 rle with old method : 0.02294301986694336 time for calcul the mask position with numpy : 0.02754831314086914 nb_pixel_total : 45576 time to create 1 rle with old method : 0.05372166633605957 time for calcul the mask position with numpy : 0.027174949645996094 nb_pixel_total : 26903 time to create 1 rle with old method : 0.03722357749938965 time for calcul the mask position with numpy : 0.027912139892578125 nb_pixel_total : 23138 time to create 1 rle with old method : 0.027324676513671875 time for calcul the mask position with numpy : 0.02817988395690918 nb_pixel_total : 174600 time to create 1 rle with new method : 1.2295472621917725 time for calcul the mask position with numpy : 0.024839162826538086 nb_pixel_total : 29840 time to create 1 rle with old method : 0.034540653228759766 time for calcul the mask position with numpy : 0.026134729385375977 nb_pixel_total : 116642 time to create 1 rle with old method : 0.1407010555267334 create new chi : 3.602282762527466 time to delete rle : 0.03182721138000488 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 8842 TO DO : save crop sub photo not yet done ! save time : 0.5416672229766846 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 7.743192434310913 time for calcul the mask position with numpy : 0.7916924953460693 nb_pixel_total : 7332373 time to create 1 rle with new method : 0.7543859481811523 time for calcul the mask position with numpy : 0.04251718521118164 nb_pixel_total : 132083 time to create 1 rle with old method : 0.15419554710388184 time for calcul the mask position with numpy : 0.04071307182312012 nb_pixel_total : 39546 time to create 1 rle with old method : 0.04688525199890137 time for calcul the mask position with numpy : 0.0404810905456543 nb_pixel_total : 53789 time to create 1 rle with old method : 0.06406641006469727 time for calcul the mask position with numpy : 0.042276620864868164 nb_pixel_total : 26576 time to create 1 rle with old method : 0.031949520111083984 time for calcul the mask position with numpy : 0.04277825355529785 nb_pixel_total : 21738 time to create 1 rle with old method : 0.025722980499267578 time for calcul the mask position with numpy : 0.042639970779418945 nb_pixel_total : 249117 time to create 1 rle with new method : 1.0750174522399902 time for calcul the mask position with numpy : 0.04180312156677246 nb_pixel_total : 73855 time to create 1 rle with old method : 0.08677077293395996 time for calcul the mask position with numpy : 0.04481816291809082 nb_pixel_total : 78456 time to create 1 rle with old method : 0.09216833114624023 time for calcul the mask position with numpy : 0.03238058090209961 nb_pixel_total : 29724 time to create 1 rle with old method : 0.03786182403564453 time for calcul the mask position with numpy : 0.026884794235229492 nb_pixel_total : 98406 time to create 1 rle with old method : 0.11594104766845703 time for calcul the mask position with numpy : 0.025827646255493164 nb_pixel_total : 36331 time to create 1 rle with old method : 0.042806148529052734 time for calcul the mask position with numpy : 0.024909496307373047 nb_pixel_total : 19979 time to create 1 rle with old method : 0.02349543571472168 time for calcul the mask position with numpy : 0.02546548843383789 nb_pixel_total : 51323 time to create 1 rle with old method : 0.06045961380004883 time for calcul the mask position with numpy : 0.026718616485595703 nb_pixel_total : 24151 time to create 1 rle with old method : 0.029356718063354492 time for calcul the mask position with numpy : 0.028324127197265625 nb_pixel_total : 26953 time to create 1 rle with old method : 0.04133152961730957 create new chi : 4.074692249298096 time to delete rle : 0.0033926963806152344 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 12096 TO DO : save crop sub photo not yet done ! save time : 0.7752058506011963 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 12.347464799880981 time for calcul the mask position with numpy : 0.5443880558013916 nb_pixel_total : 7174866 time to create 1 rle with new method : 0.887319803237915 time for calcul the mask position with numpy : 0.03521013259887695 nb_pixel_total : 50603 time to create 1 rle with old method : 0.05927586555480957 time for calcul the mask position with numpy : 0.026973962783813477 nb_pixel_total : 87572 time to create 1 rle with old method : 0.10883283615112305 time for calcul the mask position with numpy : 0.027303218841552734 nb_pixel_total : 227703 time to create 1 rle with new method : 0.8645586967468262 time for calcul the mask position with numpy : 0.0287930965423584 nb_pixel_total : 33394 time to create 1 rle with old method : 0.0391392707824707 time for calcul the mask position with numpy : 0.02586817741394043 nb_pixel_total : 21801 time to create 1 rle with old method : 0.0257718563079834 time for calcul the mask position with numpy : 0.02624034881591797 nb_pixel_total : 128110 time to create 1 rle with old method : 0.14853787422180176 time for calcul the mask position with numpy : 0.029590129852294922 nb_pixel_total : 45931 time to create 1 rle with old method : 0.05393552780151367 time for calcul the mask position with numpy : 0.040366172790527344 nb_pixel_total : 48066 time to create 1 rle with old method : 0.05664777755737305 time for calcul the mask position with numpy : 0.04112529754638672 nb_pixel_total : 114133 time to create 1 rle with old method : 0.13660931587219238 time for calcul the mask position with numpy : 0.040570735931396484 nb_pixel_total : 42971 time to create 1 rle with old method : 0.05505013465881348 time for calcul the mask position with numpy : 0.04092907905578613 nb_pixel_total : 11033 time to create 1 rle with old method : 0.012851238250732422 time for calcul the mask position with numpy : 0.04123544692993164 nb_pixel_total : 24498 time to create 1 rle with old method : 0.02872180938720703 time for calcul the mask position with numpy : 0.04204988479614258 nb_pixel_total : 76202 time to create 1 rle with old method : 0.08904147148132324 time for calcul the mask position with numpy : 0.040451765060424805 nb_pixel_total : 26799 time to create 1 rle with old method : 0.031213998794555664 time for calcul the mask position with numpy : 0.0395359992980957 nb_pixel_total : 32163 time to create 1 rle with old method : 0.04085993766784668 time for calcul the mask position with numpy : 0.03913450241088867 nb_pixel_total : 16731 time to create 1 rle with old method : 0.01968693733215332 time for calcul the mask position with numpy : 0.03977394104003906 nb_pixel_total : 9890 time to create 1 rle with old method : 0.011578083038330078 time for calcul the mask position with numpy : 0.03692913055419922 nb_pixel_total : 27025 time to create 1 rle with old method : 0.031331777572631836 time for calcul the mask position with numpy : 0.038056373596191406 nb_pixel_total : 94909 time to create 1 rle with old method : 0.11143898963928223 create new chi : 4.107863187789917 time to delete rle : 0.004099607467651367 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 14956 TO DO : save crop sub photo not yet done ! save time : 0.9082338809967041 nb_obj : 27 nb_hashtags : 3 time to prepare the origin masks : 4.580949068069458 time for calcul the mask position with numpy : 0.9014067649841309 nb_pixel_total : 7105673 time to create 1 rle with new method : 1.5135743618011475 time for calcul the mask position with numpy : 0.03625202178955078 nb_pixel_total : 125806 time to create 1 rle with old method : 0.14696931838989258 time for calcul the mask position with numpy : 0.03723907470703125 nb_pixel_total : 35144 time to create 1 rle with old method : 0.04263949394226074 time for calcul the mask position with numpy : 0.037207603454589844 nb_pixel_total : 27685 time to create 1 rle with old method : 0.03452348709106445 time for calcul the mask position with numpy : 0.03467917442321777 nb_pixel_total : 25992 time to create 1 rle with old method : 0.03023242950439453 time for calcul the mask position with numpy : 0.034444570541381836 nb_pixel_total : 22948 time to create 1 rle with old method : 0.026735782623291016 time for calcul the mask position with numpy : 0.04021930694580078 nb_pixel_total : 93336 time to create 1 rle with old method : 0.1148228645324707 time for calcul the mask position with numpy : 0.0340425968170166 nb_pixel_total : 51367 time to create 1 rle with old method : 0.05974125862121582 time for calcul the mask position with numpy : 0.03467369079589844 nb_pixel_total : 151215 time to create 1 rle with new method : 0.8316652774810791 time for calcul the mask position with numpy : 0.035507917404174805 nb_pixel_total : 45406 time to create 1 rle with old method : 0.05327439308166504 time for calcul the mask position with numpy : 0.03517007827758789 nb_pixel_total : 113640 time to create 1 rle with old method : 0.13214921951293945 time for calcul the mask position with numpy : 0.0342259407043457 nb_pixel_total : 24378 time to create 1 rle with old method : 0.028485536575317383 time for calcul the mask position with numpy : 0.034134626388549805 nb_pixel_total : 64724 time to create 1 rle with old method : 0.07737398147583008 time for calcul the mask position with numpy : 0.03661203384399414 nb_pixel_total : 27135 time to create 1 rle with old method : 0.033353328704833984 time for calcul the mask position with numpy : 0.03500986099243164 nb_pixel_total : 12823 time to create 1 rle with old method : 0.015205621719360352 time for calcul the mask position with numpy : 0.03487396240234375 nb_pixel_total : 15136 time to create 1 rle with old method : 0.018060684204101562 time for calcul the mask position with numpy : 0.03543972969055176 nb_pixel_total : 34060 time to create 1 rle with old method : 0.03974318504333496 time for calcul the mask position with numpy : 0.03472781181335449 nb_pixel_total : 26863 time to create 1 rle with old method : 0.03166770935058594 time for calcul the mask position with numpy : 0.035524606704711914 nb_pixel_total : 21671 time to create 1 rle with old method : 0.025521039962768555 time for calcul the mask position with numpy : 0.03410482406616211 nb_pixel_total : 13495 time to create 1 rle with old method : 0.01550436019897461 time for calcul the mask position with numpy : 0.03474259376525879 nb_pixel_total : 64330 time to create 1 rle with old method : 0.07487034797668457 time for calcul the mask position with numpy : 0.03376197814941406 nb_pixel_total : 4022 time to create 1 rle with old method : 0.004962444305419922 time for calcul the mask position with numpy : 0.03514695167541504 nb_pixel_total : 11694 time to create 1 rle with old method : 0.013620138168334961 time for calcul the mask position with numpy : 0.03533005714416504 nb_pixel_total : 101092 time to create 1 rle with old method : 0.12030315399169922 time for calcul the mask position with numpy : 0.03387713432312012 nb_pixel_total : 6037 time to create 1 rle with old method : 0.007084846496582031 time for calcul the mask position with numpy : 0.04067111015319824 nb_pixel_total : 34765 time to create 1 rle with old method : 0.05412602424621582 time for calcul the mask position with numpy : 0.03490924835205078 nb_pixel_total : 9946 time to create 1 rle with old method : 0.011769294738769531 time for calcul the mask position with numpy : 0.03465890884399414 nb_pixel_total : 24017 time to create 1 rle with old method : 0.02817368507385254 create new chi : 5.513402700424194 time to delete rle : 0.0037415027618408203 batch 1 Loaded 55 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17802 TO DO : save crop sub photo not yet done ! save time : 1.0419552326202393 nb_obj : 16 nb_hashtags : 2 time to prepare the origin masks : 8.316961765289307 time for calcul the mask position with numpy : 0.9134097099304199 nb_pixel_total : 7142948 time to create 1 rle with new method : 1.833914041519165 time for calcul the mask position with numpy : 0.0486750602722168 nb_pixel_total : 38659 time to create 1 rle with old method : 0.04637622833251953 time for calcul the mask position with numpy : 0.041290998458862305 nb_pixel_total : 31089 time to create 1 rle with old method : 0.03684401512145996 time for calcul the mask position with numpy : 0.04208660125732422 nb_pixel_total : 135291 time to create 1 rle with old method : 0.15848803520202637 time for calcul the mask position with numpy : 0.04424786567687988 nb_pixel_total : 12980 time to create 1 rle with old method : 0.015405654907226562 time for calcul the mask position with numpy : 0.046251535415649414 nb_pixel_total : 30387 time to create 1 rle with old method : 0.03545355796813965 time for calcul the mask position with numpy : 0.0441741943359375 nb_pixel_total : 27624 time to create 1 rle with old method : 0.03249311447143555 time for calcul the mask position with numpy : 0.04427957534790039 nb_pixel_total : 69365 time to create 1 rle with old method : 0.0811452865600586 time for calcul the mask position with numpy : 0.04220747947692871 nb_pixel_total : 90612 time to create 1 rle with old method : 0.10624837875366211 time for calcul the mask position with numpy : 0.04119610786437988 nb_pixel_total : 21621 time to create 1 rle with old method : 0.025773286819458008 time for calcul the mask position with numpy : 0.04113483428955078 nb_pixel_total : 12669 time to create 1 rle with old method : 0.018543243408203125 time for calcul the mask position with numpy : 0.04175877571105957 nb_pixel_total : 23253 time to create 1 rle with old method : 0.02751755714416504 time for calcul the mask position with numpy : 0.042321205139160156 nb_pixel_total : 126456 time to create 1 rle with old method : 0.15148305892944336 time for calcul the mask position with numpy : 0.04206657409667969 nb_pixel_total : 160103 time to create 1 rle with new method : 1.0957281589508057 time for calcul the mask position with numpy : 0.04357290267944336 nb_pixel_total : 19410 time to create 1 rle with old method : 0.022780418395996094 time for calcul the mask position with numpy : 0.04205894470214844 nb_pixel_total : 264676 time to create 1 rle with new method : 0.8661978244781494 time for calcul the mask position with numpy : 0.03763866424560547 nb_pixel_total : 87257 time to create 1 rle with old method : 0.1214914321899414 create new chi : 6.375354766845703 time to delete rle : 0.0034286975860595703 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 13420 TO DO : save crop sub photo not yet done ! save time : 0.8065266609191895 nb_obj : 17 nb_hashtags : 2 time to prepare the origin masks : 9.909201622009277 time for calcul the mask position with numpy : 0.7735300064086914 nb_pixel_total : 7698027 time to create 1 rle with new method : 0.7264745235443115 time for calcul the mask position with numpy : 0.023802518844604492 nb_pixel_total : 15091 time to create 1 rle with old method : 0.016984939575195312 time for calcul the mask position with numpy : 0.0249025821685791 nb_pixel_total : 13480 time to create 1 rle with old method : 0.01579141616821289 time for calcul the mask position with numpy : 0.02484726905822754 nb_pixel_total : 20611 time to create 1 rle with old method : 0.023862838745117188 time for calcul the mask position with numpy : 0.02581477165222168 nb_pixel_total : 20389 time to create 1 rle with old method : 0.030707120895385742 time for calcul the mask position with numpy : 0.026079177856445312 nb_pixel_total : 34472 time to create 1 rle with old method : 0.041164398193359375 time for calcul the mask position with numpy : 0.029540061950683594 nb_pixel_total : 15669 time to create 1 rle with old method : 0.033023834228515625 time for calcul the mask position with numpy : 0.030182838439941406 nb_pixel_total : 16120 time to create 1 rle with old method : 0.025907278060913086 time for calcul the mask position with numpy : 0.024989843368530273 nb_pixel_total : 18490 time to create 1 rle with old method : 0.021778345108032227 time for calcul the mask position with numpy : 0.02597522735595703 nb_pixel_total : 76101 time to create 1 rle with old method : 0.09540605545043945 time for calcul the mask position with numpy : 0.025419235229492188 nb_pixel_total : 21245 time to create 1 rle with old method : 0.024774551391601562 time for calcul the mask position with numpy : 0.02489614486694336 nb_pixel_total : 18313 time to create 1 rle with old method : 0.020993709564208984 time for calcul the mask position with numpy : 0.030419111251831055 nb_pixel_total : 35081 time to create 1 rle with old method : 0.040332794189453125 time for calcul the mask position with numpy : 0.039515018463134766 nb_pixel_total : 22708 time to create 1 rle with old method : 0.02713799476623535 time for calcul the mask position with numpy : 0.041738033294677734 nb_pixel_total : 12354 time to create 1 rle with old method : 0.013926982879638672 time for calcul the mask position with numpy : 0.03892779350280762 nb_pixel_total : 22252 time to create 1 rle with old method : 0.024550437927246094 time for calcul the mask position with numpy : 0.0391843318939209 nb_pixel_total : 187149 time to create 1 rle with new method : 0.9339480400085449 time for calcul the mask position with numpy : 0.024126052856445312 nb_pixel_total : 46848 time to create 1 rle with old method : 0.05277872085571289 create new chi : 3.513349771499634 time to delete rle : 0.0016219615936279297 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 10147 TO DO : save crop sub photo not yet done ! save time : 0.6644718647003174 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 7.377255439758301 time for calcul the mask position with numpy : 0.8118784427642822 nb_pixel_total : 7118973 time to create 1 rle with new method : 1.1295177936553955 time for calcul the mask position with numpy : 0.024283647537231445 nb_pixel_total : 15905 time to create 1 rle with old method : 0.01798844337463379 time for calcul the mask position with numpy : 0.02458024024963379 nb_pixel_total : 86262 time to create 1 rle with old method : 0.10027265548706055 time for calcul the mask position with numpy : 0.025591135025024414 nb_pixel_total : 120061 time to create 1 rle with old method : 0.1475987434387207 time for calcul the mask position with numpy : 0.025110244750976562 nb_pixel_total : 24017 time to create 1 rle with old method : 0.02777719497680664 time for calcul the mask position with numpy : 0.023996591567993164 nb_pixel_total : 45899 time to create 1 rle with old method : 0.054605722427368164 time for calcul the mask position with numpy : 0.025763511657714844 nb_pixel_total : 34111 time to create 1 rle with old method : 0.03960895538330078 time for calcul the mask position with numpy : 0.026623964309692383 nb_pixel_total : 9494 time to create 1 rle with old method : 0.01074838638305664 time for calcul the mask position with numpy : 0.028014183044433594 nb_pixel_total : 9080 time to create 1 rle with old method : 0.010484457015991211 time for calcul the mask position with numpy : 0.025655746459960938 nb_pixel_total : 99663 time to create 1 rle with old method : 0.1115574836730957 time for calcul the mask position with numpy : 0.024471521377563477 nb_pixel_total : 10697 time to create 1 rle with old method : 0.01230764389038086 time for calcul the mask position with numpy : 0.02567267417907715 nb_pixel_total : 115737 time to create 1 rle with old method : 0.13088202476501465 time for calcul the mask position with numpy : 0.02525019645690918 nb_pixel_total : 18218 time to create 1 rle with old method : 0.020615816116333008 time for calcul the mask position with numpy : 0.02589869499206543 nb_pixel_total : 12489 time to create 1 rle with old method : 0.013863086700439453 time for calcul the mask position with numpy : 0.0280911922454834 nb_pixel_total : 402268 time to create 1 rle with new method : 0.9912512302398682 time for calcul the mask position with numpy : 0.02608776092529297 nb_pixel_total : 151433 time to create 1 rle with new method : 0.768160343170166 time for calcul the mask position with numpy : 0.02539539337158203 nb_pixel_total : 20093 time to create 1 rle with old method : 0.02238297462463379 create new chi : 4.927306890487671 time to delete rle : 0.0021059513092041016 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 14275 TO DO : save crop sub photo not yet done ! save time : 0.8650522232055664 nb_obj : 33 nb_hashtags : 2 time to prepare the origin masks : 4.831923723220825 time for calcul the mask position with numpy : 0.7289433479309082 nb_pixel_total : 6675559 time to create 1 rle with new method : 1.0688068866729736 time for calcul the mask position with numpy : 0.03437304496765137 nb_pixel_total : 33412 time to create 1 rle with old method : 0.04624295234680176 time for calcul the mask position with numpy : 0.040380239486694336 nb_pixel_total : 54800 time to create 1 rle with old method : 0.06397199630737305 time for calcul the mask position with numpy : 0.03345918655395508 nb_pixel_total : 63955 time to create 1 rle with old method : 0.07138752937316895 time for calcul the mask position with numpy : 0.03357982635498047 nb_pixel_total : 37094 time to create 1 rle with old method : 0.04229402542114258 time for calcul the mask position with numpy : 0.032694101333618164 nb_pixel_total : 1218 time to create 1 rle with old method : 0.0018031597137451172 time for calcul the mask position with numpy : 0.03219795227050781 nb_pixel_total : 27944 time to create 1 rle with old method : 0.03061699867248535 time for calcul the mask position with numpy : 0.032852888107299805 nb_pixel_total : 63849 time to create 1 rle with old method : 0.07184243202209473 time for calcul the mask position with numpy : 0.032369375228881836 nb_pixel_total : 43357 time to create 1 rle with old method : 0.048178911209106445 time for calcul the mask position with numpy : 0.03342247009277344 nb_pixel_total : 131767 time to create 1 rle with old method : 0.1481330394744873 time for calcul the mask position with numpy : 0.03247570991516113 nb_pixel_total : 25224 time to create 1 rle with old method : 0.0283050537109375 time for calcul the mask position with numpy : 0.03265881538391113 nb_pixel_total : 84266 time to create 1 rle with old method : 0.1290750503540039 time for calcul the mask position with numpy : 0.045561790466308594 nb_pixel_total : 60338 time to create 1 rle with old method : 0.10887789726257324 time for calcul the mask position with numpy : 0.036110639572143555 nb_pixel_total : 108754 time to create 1 rle with old method : 0.12616515159606934 time for calcul the mask position with numpy : 0.035620927810668945 nb_pixel_total : 37435 time to create 1 rle with old method : 0.04964852333068848 time for calcul the mask position with numpy : 0.03659868240356445 nb_pixel_total : 151589 time to create 1 rle with new method : 1.0043013095855713 time for calcul the mask position with numpy : 0.03327608108520508 nb_pixel_total : 28542 time to create 1 rle with old method : 0.03177666664123535 time for calcul the mask position with numpy : 0.032936811447143555 nb_pixel_total : 27710 time to create 1 rle with old method : 0.0311429500579834 time for calcul the mask position with numpy : 0.03272104263305664 nb_pixel_total : 62605 time to create 1 rle with old method : 0.07028818130493164 time for calcul the mask position with numpy : 0.03310227394104004 nb_pixel_total : 9980 time to create 1 rle with old method : 0.011400222778320312 time for calcul the mask position with numpy : 0.03671002388000488 nb_pixel_total : 161300 time to create 1 rle with new method : 0.882617712020874 time for calcul the mask position with numpy : 0.034487247467041016 nb_pixel_total : 119498 time to create 1 rle with old method : 0.13576316833496094 time for calcul the mask position with numpy : 0.03333425521850586 nb_pixel_total : 13814 time to create 1 rle with old method : 0.015875577926635742 time for calcul the mask position with numpy : 0.03356146812438965 nb_pixel_total : 19253 time to create 1 rle with old method : 0.022331714630126953 time for calcul the mask position with numpy : 0.03410649299621582 nb_pixel_total : 37715 time to create 1 rle with old method : 0.04288172721862793 time for calcul the mask position with numpy : 0.03421354293823242 nb_pixel_total : 32809 time to create 1 rle with old method : 0.037953853607177734 time for calcul the mask position with numpy : 0.03467893600463867 nb_pixel_total : 39167 time to create 1 rle with old method : 0.04582571983337402 time for calcul the mask position with numpy : 0.03481793403625488 nb_pixel_total : 28489 time to create 1 rle with old method : 0.03298211097717285 time for calcul the mask position with numpy : 0.03413128852844238 nb_pixel_total : 17226 time to create 1 rle with old method : 0.020125865936279297 time for calcul the mask position with numpy : 0.03457164764404297 nb_pixel_total : 21604 time to create 1 rle with old method : 0.025157451629638672 time for calcul the mask position with numpy : 0.034674882888793945 nb_pixel_total : 11028 time to create 1 rle with old method : 0.012811899185180664 time for calcul the mask position with numpy : 0.03479123115539551 nb_pixel_total : 20879 time to create 1 rle with old method : 0.02454972267150879 time for calcul the mask position with numpy : 0.034963369369506836 nb_pixel_total : 28684 time to create 1 rle with old method : 0.032872915267944336 time for calcul the mask position with numpy : 0.03338789939880371 nb_pixel_total : 13536 time to create 1 rle with old method : 0.015134096145629883 create new chi : 6.4955527782440186 time to delete rle : 0.004925727844238281 batch 1 Loaded 67 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 24710 TO DO : save crop sub photo not yet done ! save time : 1.4193787574768066 map_output_result : {1373748192: (0.0, 'Should be the crop_list due to order', 0), 1373748159: (0.0, 'Should be the crop_list due to order', 0), 1373748141: (0.0, 'Should be the crop_list due to order', 0), 1373748103: (0.0, 'Should be the crop_list due to order', 0), 1373748036: (0.0, 'Should be the crop_list due to order', 0), 1373747743: (0.0, 'Should be the crop_list due to order', 0), 1373747733: (0.0, 'Should be the crop_list due to order', 0), 1373747716: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1373748192, 1373748159, 1373748141, 1373748103, 1373748036, 1373747743, 1373747733, 1373747716] Looping around the photos to save general results len do output : 8 /1373748192.Didn't retrieve data . /1373748159.Didn't retrieve data . /1373748141.Didn't retrieve data . /1373748103.Didn't retrieve data . /1373748036.Didn't retrieve data . /1373747743.Didn't retrieve data . /1373747733.Didn't retrieve data . /1373747716.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748192', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748159', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748141', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748103', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748036', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747743', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747733', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747716', None, None, None, None, None, '3354047') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.0183413028717041 save_final save missing photos in datou_result : time spend for datou_step_exec : 105.79264450073242 time spend to save output : 0.01902294158935547 total time spend for step 3 : 105.81166744232178 step4:ventilate_hashtags_in_portfolio Fri Jul 25 16:45:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25335919 get user id for portfolio 25335919 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25335919 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','mal_croppe','pet_fonce','environnement','papier','carton','autre','flou','pehd','metal','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25335919 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','mal_croppe','pet_fonce','environnement','papier','carton','autre','flou','pehd','metal','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25335919 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','mal_croppe','pet_fonce','environnement','papier','carton','autre','flou','pehd','metal','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25336398,25336399,25336400,25336401,25336402,25336403,25336404,25336405,25336406,25336407,25336408?tags=pet_clair,mal_croppe,pet_fonce,environnement,papier,carton,autre,flou,pehd,metal,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1373748192, 1373748159, 1373748141, 1373748103, 1373748036, 1373747743, 1373747733, 1373747716] Looping around the photos to save general results len do output : 1 /25335919. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748192', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748159', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748141', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748103', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748036', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747743', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747733', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747716', None, None, None, None, None, '3354047') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01392364501953125 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6730015277862549 time spend to save output : 0.014322996139526367 total time spend for step 4 : 1.6873245239257812 step5:final Fri Jul 25 16:45:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1373748192: ('0.12560363016010806',), 1373748159: ('0.12560363016010806',), 1373748141: ('0.12560363016010806',), 1373748103: ('0.12560363016010806',), 1373748036: ('0.12560363016010806',), 1373747743: ('0.12560363016010806',), 1373747733: ('0.12560363016010806',), 1373747716: ('0.12560363016010806',)} new output for save of step final : {1373748192: ('0.12560363016010806',), 1373748159: ('0.12560363016010806',), 1373748141: ('0.12560363016010806',), 1373748103: ('0.12560363016010806',), 1373748036: ('0.12560363016010806',), 1373747743: ('0.12560363016010806',), 1373747733: ('0.12560363016010806',), 1373747716: ('0.12560363016010806',)} [1373748192, 1373748159, 1373748141, 1373748103, 1373748036, 1373747743, 1373747733, 1373747716] Looping around the photos to save general results len do output : 8 /1373748192.Didn't retrieve data . /1373748159.Didn't retrieve data . /1373748141.Didn't retrieve data . /1373748103.Didn't retrieve data . /1373748036.Didn't retrieve data . /1373747743.Didn't retrieve data . /1373747733.Didn't retrieve data . /1373747716.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748192', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748159', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748141', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748103', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748036', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747743', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747733', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747716', None, None, None, None, None, '3354047') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.01644158363342285 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12947368621826172 time spend to save output : 0.01688241958618164 total time spend for step 5 : 0.14635610580444336 step6:blur_detection Fri Jul 25 16:45:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f.jpg resize: (2160, 3840) 1373748192 -7.31857942341032 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3.jpg resize: (2160, 3840) 1373748159 -7.145985024027724 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2.jpg resize: (2160, 3840) 1373748141 -7.237493170601516 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b.jpg resize: (2160, 3840) 1373748103 -7.208842968298597 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8.jpg resize: (2160, 3840) 1373748036 -7.589169053245166 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800.jpg resize: (2160, 3840) 1373747743 -7.116063139095763 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec.jpg resize: (2160, 3840) 1373747733 -7.106202323551847 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418.jpg resize: (2160, 3840) 1373747716 -7.5045461645616305 treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036014_0.png resize: (425, 383) 1373766976 -0.9370413332143612 treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036016_0.png resize: (621, 476) 1373766977 -4.797036848461501 treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036017_0.png resize: (171, 230) 1373766979 -4.3351208290888215 treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036018_0.png resize: (117, 399) 1373766980 -1.8257627032122001 treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036019_0.png resize: (336, 258) 1373766981 -2.602786862380122 treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036020_0.png resize: (197, 148) 1373766983 -4.701376537159805 treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036021_0.png resize: (498, 329) 1373766984 -4.8530138795247115 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036022_0.png resize: (136, 267) 1373766985 -0.9065507562958615 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036023_0.png resize: (165, 204) 1373766987 0.16624313056442644 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036024_0.png resize: (250, 289) 1373766988 -3.4746727542023765 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036025_0.png resize: (184, 155) 1373766989 -1.3986192597575202 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036026_0.png resize: (353, 163) 1373766991 -4.612987988331933 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036028_0.png resize: (292, 155) 1373766992 -2.0026339128548853 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036029_0.png resize: (325, 368) 1373766993 -4.18441738868369 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036030_0.png resize: (342, 413) 1373766995 2.3163580779008135 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036031_0.png resize: (441, 1005) 1373766996 -2.9782827350814722 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036033_0.png resize: (207, 191) 1373766997 -4.800446550648465 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036034_0.png resize: (324, 293) 1373766999 -2.1555776451958644 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036036_0.png resize: (458, 478) 1373767000 -5.181465362336616 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036037_0.png resize: (337, 520) 1373767001 -4.613274995497974 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036038_0.png resize: (158, 249) 1373767003 0.8071135851896125 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036040_0.png resize: (179, 143) 1373767004 -1.6866268981212977 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036041_0.png resize: (179, 304) 1373767005 -4.141190447527167 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036042_0.png resize: (253, 179) 1373767008 0.2806019523327845 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036043_0.png resize: (424, 241) 1373767009 -1.2900054231833595 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036044_0.png resize: (250, 156) 1373767010 -3.839159039037358 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036045_0.png resize: (183, 99) 1373767012 -3.4606990958075263 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036046_0.png resize: (546, 113) 1373767013 -3.3280444033875796 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036047_0.png resize: (426, 411) 1373767014 -2.2160167663558448 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036048_0.png resize: (294, 231) 1373767016 -1.7546944749700122 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036049_0.png resize: (238, 272) 1373767017 -4.164550127457078 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036050_0.png resize: (537, 473) 1373767018 -4.040133558975384 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036051_0.png resize: (140, 230) 1373767020 0.8851061338064812 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036052_0.png resize: (232, 223) 1373767021 -4.694509427092762 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036053_0.png resize: (630, 506) 1373767022 -3.890857771394939 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036055_0.png resize: (324, 220) 1373767024 -4.205229386266501 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036056_0.png resize: (102, 155) 1373767025 -3.879402504225018 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036057_0.png resize: (237, 171) 1373767026 -2.41779851153142 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036058_0.png resize: (304, 455) 1373767028 -1.7732044969740623 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036059_0.png resize: (93, 105) 1373767029 -3.5375408259267136 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036060_0.png resize: (332, 475) 1373767030 -4.033353345189077 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036061_0.png resize: (364, 115) 1373767032 -3.7706701823749627 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036062_0.png resize: (304, 370) 1373767033 -2.1111790500143996 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036063_0.png resize: (515, 316) 1373767035 -4.249536389288582 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036064_0.png resize: (196, 172) 1373767037 -3.8252503378482356 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036068_0.png resize: (207, 163) 1373767038 0.24790285652574823 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036069_0.png resize: (547, 474) 1373767039 -0.11163764165158485 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036070_0.png resize: (138, 232) 1373767041 -4.459155753411757 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036071_0.png resize: (343, 270) 1373767042 -3.361997095118189 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036072_0.png resize: (181, 133) 1373767043 -4.428264969167562 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036073_0.png resize: (187, 176) 1373767045 -4.251681737790072 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036074_0.png resize: (168, 222) 1373767046 -3.719814690028094 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036075_0.png resize: (131, 132) 1373767047 -4.179053997398163 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036076_0.png resize: (326, 216) 1373767049 -1.516816740664891 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036077_0.png resize: (171, 155) 1373767050 -4.1447835258469725 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036078_0.png resize: (251, 168) 1373767051 -3.4901796774166445 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036079_0.png resize: (214, 222) 1373767053 -4.353197603573156 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036080_0.png resize: (432, 239) 1373767054 -4.457949434978068 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036081_0.png resize: (318, 224) 1373767055 0.4108335784319446 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036082_0.png resize: (201, 231) 1373767057 -4.558103585607967 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036083_0.png resize: (612, 200) 1373767058 -0.8126552770425267 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036084_0.png resize: (632, 745) 1373767060 -3.8303738405372965 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036086_0.png resize: (384, 609) 1373767061 -1.1664833812505464 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036087_0.png resize: (412, 536) 1373767062 1.5528881641344439 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036088_0.png resize: (200, 228) 1373767064 -4.664180937806162 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036089_0.png resize: (177, 124) 1373767065 1.0317530973188669 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036091_0.png resize: (423, 514) 1373767066 -3.760871899641884 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036093_0.png resize: (275, 144) 1373767068 -5.373052638425904 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036094_0.png resize: (227, 201) 1373767069 -0.975688355780806 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036095_0.png resize: (197, 102) 1373767070 -2.7794018449953524 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036096_0.png resize: (371, 550) 1373767072 -1.7589392343070027 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036097_0.png resize: (349, 122) 1373767073 -4.287098199922711 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036099_0.png resize: (244, 311) 1373767074 2.005694210966713 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036100_0.png resize: (773, 533) 1373767076 -1.6764758838885796 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036103_0.png resize: (159, 183) 1373767077 0.39260960823463187 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036104_0.png resize: (267, 189) 1373767078 -3.282015796925781 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036105_0.png resize: (242, 175) 1373767080 -1.4318758960227236 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036106_0.png resize: (211, 207) 1373767081 -3.0449021173841317 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036107_0.png resize: (203, 563) 1373767082 -4.159000517301608 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036108_0.png resize: (279, 91) 1373767084 -4.074898255189565 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036109_0.png resize: (143, 165) 1373767085 -2.1955662740898987 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036110_0.png resize: (135, 155) 1373767086 -4.023807708785671 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036112_0.png resize: (233, 137) 1373767088 -1.7084351879073123 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036113_0.png resize: (196, 185) 1373767089 -4.844091605411685 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036114_0.png resize: (97, 202) 1373767090 -2.9116283639437888 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036115_0.png resize: (115, 162) 1373767092 1.381799958908354 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036116_0.png resize: (121, 239) 1373767093 -2.1150029475229437 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036117_0.png resize: (422, 706) 1373767094 -0.8647509716357223 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036118_0.png resize: (828, 933) 1373767096 -2.9266401479437034 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036119_0.png resize: (230, 103) 1373767097 -3.8743734936758836 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036120_0.png resize: (295, 140) 1373767098 -3.9747207539713147 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036123_0.png resize: (525, 385) 1373767100 -3.1193533963005784 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036124_0.png resize: (159, 107) 1373767101 -1.6308634083138485 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036125_0.png resize: (78, 168) 1373767102 -1.3029374816920674 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036126_0.png resize: (281, 167) 1373767104 -4.565594760402411 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036127_0.png resize: (375, 307) 1373767105 -2.471513362526906 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036128_0.png resize: (273, 285) 1373767107 -3.3721741644132406 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036129_0.png resize: (359, 649) 1373767109 -4.227070145075551 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036130_0.png resize: (293, 448) 1373767110 -2.387777955603988 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036131_0.png resize: (204, 152) 1373767111 -3.831812633994258 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036132_0.png resize: (327, 341) 1373767113 -4.425413094270267 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036133_0.png resize: (148, 114) 1373767114 -2.254527712954642 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036134_0.png resize: (625, 346) 1373767115 -4.88748745179649 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036135_0.png resize: (125, 327) 1373767117 0.0832884749333099 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036136_0.png resize: (499, 331) 1373767118 -0.4875284335950928 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036137_0.png resize: (278, 177) 1373767119 -3.6880139558472425 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036138_0.png resize: (255, 172) 1373767121 -2.5629267183273017 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036139_0.png resize: (372, 171) 1373767122 -4.239592113416367 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036140_0.png resize: (118, 228) 1373767123 -3.3805317422416645 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036141_0.png resize: (351, 357) 1373767125 -2.0920969854479625 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036142_0.png resize: (220, 216) 1373767126 -4.0073605012181295 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036143_0.png resize: (137, 225) 1373767127 -4.375620556090278 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036144_0.png resize: (267, 202) 1373767128 -3.2649841015065277 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036145_0.png resize: (183, 175) 1373767130 -3.7815286168544318 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036146_0.png resize: (174, 156) 1373767131 -1.23121034116215 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036147_0.png resize: (253, 320) 1373767132 -4.054693103041854 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036148_0.png resize: (480, 167) 1373767134 -3.253092397790794 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036149_0.png resize: (118, 160) 1373767135 -4.178671636949461 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036150_0.png resize: (257, 224) 1373767136 -4.390730012332272 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036151_0.png resize: (673, 287) 1373767138 -4.998218433903357 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036152_0.png resize: (327, 275) 1373767140 -4.518377082627922 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036153_0.png resize: (366, 453) 1373767141 -4.268161736635613 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036155_0.png resize: (248, 200) 1373767143 -3.1814030783084957 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036156_0.png resize: (429, 642) 1373767144 -4.583364795470794 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036157_0.png resize: (127, 113) 1373767145 -3.353636787114054 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036158_0.png resize: (283, 284) 1373767147 -2.5285665951793685 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036161_0.png resize: (284, 440) 1373767148 -3.410769781719606 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036162_0.png resize: (168, 264) 1373767149 -4.405251685777043 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036163_0.png resize: (164, 268) 1373767151 1.083694006234827 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036164_0.png resize: (459, 228) 1373767152 -3.62482519923174 treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036015_0.png resize: (274, 173) 1373767201 -4.131516941302341 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036027_0.png resize: (334, 515) 1373767202 -3.7501817756243496 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036032_0.png resize: (248, 180) 1373767203 -3.666516760653281 treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036035_0.png resize: (160, 362) 1373767204 -2.8216913465422033 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036039_0.png resize: (132, 128) 1373767205 -4.345515418926291 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036065_0.png resize: (142, 198) 1373767206 -4.229989143500005 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036067_0.png resize: (196, 171) 1373767207 -3.955406279085514 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036085_0.png resize: (235, 117) 1373767208 -4.649589199498879 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036090_0.png resize: (177, 189) 1373767209 -4.745066045197296 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036092_0.png resize: (283, 378) 1373767210 -4.40390653662969 treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036098_0.png resize: (291, 165) 1373767211 -4.42130816897647 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036101_0.png resize: (153, 219) 1373767212 -4.821119213729443 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036102_0.png resize: (125, 130) 1373767213 -1.8290492119765227 treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036111_0.png resize: (235, 228) 1373767214 -4.645259650113875 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036122_0.png resize: (147, 145) 1373767215 -3.8147699159336192 treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036054_0.png resize: (348, 354) 1373767223 -2.9277701437382957 treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036066_0.png resize: (229, 717) 1373767224 -4.424953748256281 treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036121_0.png resize: (467, 466) 1373767225 -5.279444587846518 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036154_0.png resize: (300, 451) 1373767226 -3.4135314428741954 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036159_0.png resize: (152, 304) 1373767227 -2.1046407912342695 treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036160_0.png resize: (344, 301) 1373767228 -2.864321819660854 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 159 time used for this insertion : 0.02167797088623047 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 159 time used for this insertion : 0.03603339195251465 save missing photos in datou_result : time spend for datou_step_exec : 39.854034423828125 time spend to save output : 0.06377720832824707 total time spend for step 6 : 39.91781163215637 step7:brightness Fri Jul 25 16:45:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f.jpg treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3.jpg treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2.jpg treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b.jpg treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8.jpg treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800.jpg treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec.jpg treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418.jpg treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036014_0.png treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036016_0.png treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036017_0.png treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036018_0.png treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036019_0.png treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036020_0.png treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036021_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036022_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036023_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036024_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036025_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036026_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036028_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036029_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036030_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036031_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036033_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036034_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036036_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036037_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036038_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036040_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036041_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036042_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036043_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036044_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036045_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036046_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036047_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036048_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036049_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036050_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036051_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036052_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036053_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036055_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036056_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036057_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036058_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036059_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036060_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036061_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036062_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036063_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036064_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036068_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036069_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036070_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036071_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036072_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036073_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036074_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036075_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036076_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036077_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036078_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036079_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036080_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036081_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036082_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036083_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036084_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036086_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036087_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036088_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036089_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036091_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036093_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036094_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036095_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036096_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036097_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036099_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036100_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036103_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036104_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036105_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036106_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036107_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036108_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036109_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036110_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036112_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036113_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036114_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036115_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036116_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036117_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036118_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036119_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036120_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036123_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036124_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036125_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036126_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036127_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036128_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036129_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036130_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036131_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036132_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036133_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036134_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036135_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036136_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036137_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036138_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036139_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036140_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036141_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036142_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036143_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036144_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036145_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036146_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036147_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036148_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036149_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036150_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036151_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036152_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036153_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036155_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036156_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036157_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036158_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036161_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036162_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036163_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036164_0.png treat image : temp/1753454427_698640_1373748192_659abedbc936e0d135e4f9e1158f3a2f_rle_crop_3894036015_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036027_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036032_0.png treat image : temp/1753454427_698640_1373748159_1955a8db83e593b0d6329002dfcc73b3_rle_crop_3894036035_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036039_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036065_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036067_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036085_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036090_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036092_0.png treat image : temp/1753454427_698640_1373748036_31c1fb51214c450e14f110c9b35e3dd8_rle_crop_3894036098_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036101_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036102_0.png treat image : temp/1753454427_698640_1373747743_479a639a1fc94fbd0106c60f5348b800_rle_crop_3894036111_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036122_0.png treat image : temp/1753454427_698640_1373748141_614fef1bba67e4b7910c2ab21db415e2_rle_crop_3894036054_0.png treat image : temp/1753454427_698640_1373748103_6691ad4d751c286d5a7641f2c9fed24b_rle_crop_3894036066_0.png treat image : temp/1753454427_698640_1373747733_b392ceb25f53e029571a2e237ff09bec_rle_crop_3894036121_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036154_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036159_0.png treat image : temp/1753454427_698640_1373747716_d41014aebad56db4988e41ce6d2d1418_rle_crop_3894036160_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 159 time used for this insertion : 0.018434524536132812 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 159 time used for this insertion : 0.03528952598571777 save missing photos in datou_result : time spend for datou_step_exec : 9.908043146133423 time spend to save output : 0.059636592864990234 total time spend for step 7 : 9.967679738998413 step8:velours_tree Fri Jul 25 16:45:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.1746885776519775 time spend to save output : 4.029273986816406e-05 total time spend for step 8 : 1.1747288703918457 step9:send_mail_cod Fri Jul 25 16:45:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25335919_25-07-2025_16_45_58.pdf 25336398 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette253363981753454758 25336399 imagette253363991753454759 25336400 imagette253364001753454759 25336402 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette253364021753454759 25336403 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette253364031753454760 25336404 imagette253364041753454761 25336405 imagette253364051753454761 25336406 imagette253364061753454761 25336407 imagette253364071753454761 25336408 imagette253364081753454761 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25335919 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25336398,25336399,25336400,25336401,25336402,25336403,25336404,25336405,25336406,25336407,25336408?tags=pet_clair,mal_croppe,pet_fonce,environnement,papier,carton,autre,flou,pehd,metal,background args[1373748192] : ((1373748192, -7.31857942341032, 492609224), (1373748192, 2.0359833005388523, 492649241), '0.12560363016010806') We are sending mail with results at report@fotonower.com args[1373748159] : ((1373748159, -7.145985024027724, 492609224), (1373748159, 1.5257781157787123, 2107752395), '0.12560363016010806') We are sending mail with results at report@fotonower.com args[1373748141] : ((1373748141, -7.237493170601516, 492609224), (1373748141, 1.1138992205554135, 2107752395), '0.12560363016010806') We are sending mail with results at report@fotonower.com args[1373748103] : ((1373748103, -7.208842968298597, 492609224), (1373748103, 1.3193571332541532, 2107752395), '0.12560363016010806') We are sending mail with results at report@fotonower.com args[1373748036] : ((1373748036, -7.589169053245166, 492609224), (1373748036, 1.4876187897289814, 2107752395), '0.12560363016010806') We are sending mail with results at report@fotonower.com args[1373747743] : ((1373747743, -7.116063139095763, 492609224), (1373747743, 1.5064318868856061, 2107752395), '0.12560363016010806') We are sending mail with results at report@fotonower.com args[1373747733] : ((1373747733, -7.106202323551847, 492609224), (1373747733, 2.1727086737412593, 492649241), '0.12560363016010806') We are sending mail with results at report@fotonower.com args[1373747716] : ((1373747716, -7.5045461645616305, 492609224), (1373747716, 1.7508604881794598, 2107752395), '0.12560363016010806') We are sending mail with results at report@fotonower.com refus_total : 0.12560363016010806 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25335919 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25335919_25-07-2025_16_45_58.pdf results_Auto_P25335919_25-07-2025_16_45_58.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25335919_25-07-2025_16_45_58.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25335919','results_Auto_P25335919_25-07-2025_16_45_58.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25335919_25-07-2025_16_45_58.pdf','pdf','','0.58','0.12560363016010806') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25335919

https://www.fotonower.com/image?json=false&list_photos_id=1373748192
La photo est trop lumineuse, merci de reprendre une photo.(avec le score = 2.0359833005388523,le score doit entre -2 et 2)
https://www.fotonower.com/image?json=false&list_photos_id=1373748159
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373748141
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373748103
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373748036
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373747743
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373747733
La photo est trop lumineuse, merci de reprendre une photo.(avec le score = 2.1727086737412593,le score doit entre -2 et 2)
https://www.fotonower.com/image?json=false&list_photos_id=1373747716
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.56%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/25336398?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25336402?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25336403?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25335919_25-07-2025_16_45_58.pdf.

Lien vers velours :https://www.fotonower.com/velours/25336398,25336399,25336400,25336401,25336402,25336403,25336404,25336405,25336406,25336407,25336408?tags=pet_clair,mal_croppe,pet_fonce,environnement,papier,carton,autre,flou,pehd,metal,background.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 25 Jul 2025 14:46:04 GMT Content-Length: 0 Connection: close X-Message-Id: 43_OUz1RQiKMnaRMXwaNcw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1373748192, 1373748159, 1373748141, 1373748103, 1373748036, 1373747743, 1373747733, 1373747716] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748192', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748159', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748141', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748103', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748036', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747743', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747733', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747716', None, None, None, None, None, '3354047') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.015327215194702148 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.110153436660767 time spend to save output : 0.01555180549621582 total time spend for step 9 : 6.125705242156982 step10:split_time_score Fri Jul 25 16:46:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 25072025 25335919 Nombre de photos uploadées : 8 / 23040 (0%) 25072025 25335919 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 25072025 25335919 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0003829002380371094 elapsed_time : insert_dashboard_record_day_entry 0.031104087829589844 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.054167143903853805 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25312451_25-07-2025_07_32_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25312451 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25312451 AND mptpi.`type`=3726 To do Qualite : 0.06383829687305634 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25312453_25-07-2025_07_39_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25312453 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25312453 AND mptpi.`type`=3726 To do Qualite : 0.06471374068870918 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25312457_25-07-2025_07_08_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25312457 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25312457 AND mptpi.`type`=3726 To do Qualite : 0.01642281275008202 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25312459_25-07-2025_07_28_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25312459 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25312459 AND mptpi.`type`=3726 To do Qualite : 0.031425342682482246 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25319576_25-07-2025_09_43_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25319576 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25319576 AND mptpi.`type`=3726 To do Qualite : 0.1263519814573688 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25325810_25-07-2025_11_45_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25325810 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25325810 AND mptpi.`type`=3594 To do Qualite : 0.025941481421850637 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25328522_25-07-2025_14_07_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25328522 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25328522 AND mptpi.`type`=3726 To do Qualite : 0.12560363016010806 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25335919_25-07-2025_16_45_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25335919 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25335919 AND mptpi.`type`=3594 To do Qualite : 0.019653559416672774 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25335923_25-07-2025_16_42_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25335923 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25335923 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'25072025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1373748192, 1373748159, 1373748141, 1373748103, 1373748036, 1373747743, 1373747733, 1373747716] Looping around the photos to save general results len do output : 1 /25335919Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748192', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748159', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748141', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748103', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373748036', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747743', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747733', None, None, None, None, None, '3354047') ('3318', None, None, None, None, None, None, None, '3354047') ('3318', '25335919', '1373747716', None, None, None, None, None, '3354047') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.016357421875 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7554335594177246 time spend to save output : 0.01663804054260254 total time spend for step 10 : 0.7720715999603271 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 151.23user 136.32system 5:41.11elapsed 84%CPU (0avgtext+0avgdata 4641372maxresident)k 1043304inputs+119784outputs (25045major+14701887minor)pagefaults 0swaps