python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1603909 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3657660'] with mtr_portfolio_ids : ['26479238'] and first list_photo_ids : [] new path : /proc/1603909/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.8032195568084717 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Sep 3 10:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10444 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-03 10:10:33.034273: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-03 10:10:33.060667: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-03 10:10:33.062911: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4ad4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-03 10:10:33.062977: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-03 10:10:33.067288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-03 10:10:33.196853: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2fad6fd0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-03 10:10:33.196910: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-03 10:10:33.198373: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-03 10:10:33.199295: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-03 10:10:33.202415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-03 10:10:33.205444: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-03 10:10:33.205936: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-03 10:10:33.208780: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-03 10:10:33.210082: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-03 10:10:33.215220: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-03 10:10:33.216675: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-03 10:10:33.216755: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-03 10:10:33.217556: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-03 10:10:33.217573: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-03 10:10:33.217582: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-03 10:10:33.219255: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9675 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-03 10:10:33.502607: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-03 10:10:33.502710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-03 10:10:33.502737: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-03 10:10:33.502761: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-03 10:10:33.502784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-03 10:10:33.502807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-03 10:10:33.502829: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-03 10:10:33.502852: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-03 10:10:33.504512: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-03 10:10:33.506014: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-03 10:10:33.506066: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-03 10:10:33.506082: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-03 10:10:33.506097: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-03 10:10:33.506111: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-03 10:10:33.506126: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-03 10:10:33.506140: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-03 10:10:33.506154: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-03 10:10:33.507420: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-03 10:10:33.507453: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-03 10:10:33.507462: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-03 10:10:33.507470: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-03 10:10:33.508815: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9675 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-03 10:10:46.292053: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-03 10:10:46.488619: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 Detection mask done ! Trying to reset tf kernel 1604650 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 338 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9404 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.002753019332885742 nb_pixel_total : 50121 time to create 1 rle with old method : 0.057454586029052734 length of segment : 385 time for calcul the mask position with numpy : 0.014067411422729492 nb_pixel_total : 306866 time to create 1 rle with new method : 0.015897274017333984 length of segment : 714 time for calcul the mask position with numpy : 0.0025396347045898438 nb_pixel_total : 142254 time to create 1 rle with old method : 0.16772222518920898 length of segment : 405 time for calcul the mask position with numpy : 0.00047326087951660156 nb_pixel_total : 13634 time to create 1 rle with old method : 0.016167163848876953 length of segment : 148 time for calcul the mask position with numpy : 0.004095315933227539 nb_pixel_total : 190714 time to create 1 rle with new method : 0.010807037353515625 length of segment : 432 time for calcul the mask position with numpy : 0.0010929107666015625 nb_pixel_total : 33089 time to create 1 rle with old method : 0.03901195526123047 length of segment : 383 time for calcul the mask position with numpy : 0.0033104419708251953 nb_pixel_total : 123794 time to create 1 rle with old method : 0.14612412452697754 length of segment : 778 time for calcul the mask position with numpy : 0.004316568374633789 nb_pixel_total : 182632 time to create 1 rle with new method : 0.009307861328125 length of segment : 330 time for calcul the mask position with numpy : 0.0017313957214355469 nb_pixel_total : 74159 time to create 1 rle with old method : 0.08753728866577148 length of segment : 320 time for calcul the mask position with numpy : 0.0012669563293457031 nb_pixel_total : 32949 time to create 1 rle with old method : 0.04398679733276367 length of segment : 191 time for calcul the mask position with numpy : 0.0008182525634765625 nb_pixel_total : 23691 time to create 1 rle with old method : 0.027970314025878906 length of segment : 257 time for calcul the mask position with numpy : 0.0010781288146972656 nb_pixel_total : 41909 time to create 1 rle with old method : 0.04973149299621582 length of segment : 260 time for calcul the mask position with numpy : 0.0021398067474365234 nb_pixel_total : 89616 time to create 1 rle with old method : 0.10665154457092285 length of segment : 331 time for calcul the mask position with numpy : 0.0005338191986083984 nb_pixel_total : 19286 time to create 1 rle with old method : 0.02305293083190918 length of segment : 165 time for calcul the mask position with numpy : 0.00041294097900390625 nb_pixel_total : 11009 time to create 1 rle with old method : 0.013506412506103516 length of segment : 104 time for calcul the mask position with numpy : 0.0006504058837890625 nb_pixel_total : 28342 time to create 1 rle with old method : 0.03380417823791504 length of segment : 148 time for calcul the mask position with numpy : 0.00040650367736816406 nb_pixel_total : 12470 time to create 1 rle with old method : 0.015022516250610352 length of segment : 110 time for calcul the mask position with numpy : 0.002177715301513672 nb_pixel_total : 109600 time to create 1 rle with old method : 0.1257953643798828 length of segment : 519 time for calcul the mask position with numpy : 0.0027370452880859375 nb_pixel_total : 75255 time to create 1 rle with old method : 0.10669660568237305 length of segment : 333 time for calcul the mask position with numpy : 0.0015058517456054688 nb_pixel_total : 35390 time to create 1 rle with old method : 0.05815863609313965 length of segment : 202 time for calcul the mask position with numpy : 0.0008957386016845703 nb_pixel_total : 39710 time to create 1 rle with old method : 0.046353816986083984 length of segment : 243 time for calcul the mask position with numpy : 0.0006394386291503906 nb_pixel_total : 21211 time to create 1 rle with old method : 0.025134801864624023 length of segment : 180 time for calcul the mask position with numpy : 0.0020847320556640625 nb_pixel_total : 67459 time to create 1 rle with old method : 0.07998847961425781 length of segment : 426 time for calcul the mask position with numpy : 0.000659942626953125 nb_pixel_total : 27176 time to create 1 rle with old method : 0.0324101448059082 length of segment : 142 time for calcul the mask position with numpy : 0.0002410411834716797 nb_pixel_total : 8264 time to create 1 rle with old method : 0.01003408432006836 length of segment : 90 time for calcul the mask position with numpy : 0.0006017684936523438 nb_pixel_total : 16381 time to create 1 rle with old method : 0.01958441734313965 length of segment : 130 time for calcul the mask position with numpy : 0.00047278404235839844 nb_pixel_total : 12436 time to create 1 rle with old method : 0.014998435974121094 length of segment : 105 time for calcul the mask position with numpy : 0.0006422996520996094 nb_pixel_total : 23287 time to create 1 rle with old method : 0.027438879013061523 length of segment : 254 time for calcul the mask position with numpy : 0.001741647720336914 nb_pixel_total : 82336 time to create 1 rle with old method : 0.09644007682800293 length of segment : 482 time for calcul the mask position with numpy : 0.0003998279571533203 nb_pixel_total : 9856 time to create 1 rle with old method : 0.011913537979125977 length of segment : 97 time for calcul the mask position with numpy : 0.000408172607421875 nb_pixel_total : 16700 time to create 1 rle with old method : 0.020055055618286133 length of segment : 112 time for calcul the mask position with numpy : 0.0005784034729003906 nb_pixel_total : 18087 time to create 1 rle with old method : 0.021865129470825195 length of segment : 143 time for calcul the mask position with numpy : 0.0006246566772460938 nb_pixel_total : 9950 time to create 1 rle with old method : 0.01211690902709961 length of segment : 96 time for calcul the mask position with numpy : 0.0013272762298583984 nb_pixel_total : 63245 time to create 1 rle with old method : 0.07877349853515625 length of segment : 267 time for calcul the mask position with numpy : 0.00205230712890625 nb_pixel_total : 70214 time to create 1 rle with old method : 0.08186197280883789 length of segment : 306 time for calcul the mask position with numpy : 0.0005633831024169922 nb_pixel_total : 16049 time to create 1 rle with old method : 0.01921391487121582 length of segment : 132 time for calcul the mask position with numpy : 0.0012812614440917969 nb_pixel_total : 44760 time to create 1 rle with old method : 0.05272030830383301 length of segment : 243 time for calcul the mask position with numpy : 0.001188516616821289 nb_pixel_total : 35623 time to create 1 rle with old method : 0.0420231819152832 length of segment : 296 time for calcul the mask position with numpy : 0.0005583763122558594 nb_pixel_total : 19079 time to create 1 rle with old method : 0.02287006378173828 length of segment : 125 time for calcul the mask position with numpy : 0.002859354019165039 nb_pixel_total : 82712 time to create 1 rle with old method : 0.09660768508911133 length of segment : 359 time for calcul the mask position with numpy : 0.002052783966064453 nb_pixel_total : 61137 time to create 1 rle with old method : 0.0714566707611084 length of segment : 388 time for calcul the mask position with numpy : 0.002584695816040039 nb_pixel_total : 66355 time to create 1 rle with old method : 0.07947063446044922 length of segment : 502 time for calcul the mask position with numpy : 0.002105236053466797 nb_pixel_total : 65137 time to create 1 rle with old method : 0.08017992973327637 length of segment : 242 time for calcul the mask position with numpy : 0.0021886825561523438 nb_pixel_total : 63042 time to create 1 rle with old method : 0.07415437698364258 length of segment : 445 time for calcul the mask position with numpy : 0.0008852481842041016 nb_pixel_total : 23150 time to create 1 rle with old method : 0.027374982833862305 length of segment : 202 time for calcul the mask position with numpy : 0.0004665851593017578 nb_pixel_total : 17237 time to create 1 rle with old method : 0.02066969871520996 length of segment : 139 time for calcul the mask position with numpy : 0.0008664131164550781 nb_pixel_total : 26867 time to create 1 rle with old method : 0.03163576126098633 length of segment : 186 time for calcul the mask position with numpy : 0.0006582736968994141 nb_pixel_total : 25405 time to create 1 rle with old method : 0.03132820129394531 length of segment : 180 time for calcul the mask position with numpy : 0.0005216598510742188 nb_pixel_total : 11795 time to create 1 rle with old method : 0.014089107513427734 length of segment : 168 time for calcul the mask position with numpy : 0.0007181167602539062 nb_pixel_total : 45150 time to create 1 rle with old method : 0.05331277847290039 length of segment : 257 time for calcul the mask position with numpy : 0.0013818740844726562 nb_pixel_total : 83364 time to create 1 rle with old method : 0.10071110725402832 length of segment : 467 time for calcul the mask position with numpy : 0.028254032135009766 nb_pixel_total : 554934 time to create 1 rle with new method : 0.0400390625 length of segment : 797 time for calcul the mask position with numpy : 0.0007865428924560547 nb_pixel_total : 21351 time to create 1 rle with old method : 0.026299238204956055 length of segment : 124 time for calcul the mask position with numpy : 0.0024166107177734375 nb_pixel_total : 94276 time to create 1 rle with old method : 0.11453533172607422 length of segment : 374 time for calcul the mask position with numpy : 0.0009095668792724609 nb_pixel_total : 23126 time to create 1 rle with old method : 0.030012130737304688 length of segment : 197 time for calcul the mask position with numpy : 0.0011425018310546875 nb_pixel_total : 37125 time to create 1 rle with old method : 0.05264425277709961 length of segment : 266 time for calcul the mask position with numpy : 0.0011820793151855469 nb_pixel_total : 24548 time to create 1 rle with old method : 0.029730558395385742 length of segment : 232 time for calcul the mask position with numpy : 0.00153350830078125 nb_pixel_total : 60362 time to create 1 rle with old method : 0.07472491264343262 length of segment : 270 time for calcul the mask position with numpy : 0.0009691715240478516 nb_pixel_total : 41591 time to create 1 rle with old method : 0.05074572563171387 length of segment : 382 time for calcul the mask position with numpy : 0.0005373954772949219 nb_pixel_total : 29081 time to create 1 rle with old method : 0.04150247573852539 length of segment : 268 time for calcul the mask position with numpy : 0.0008134841918945312 nb_pixel_total : 52768 time to create 1 rle with old method : 0.06261157989501953 length of segment : 334 time for calcul the mask position with numpy : 0.0006344318389892578 nb_pixel_total : 28564 time to create 1 rle with old method : 0.034002065658569336 length of segment : 246 time for calcul the mask position with numpy : 0.0009846687316894531 nb_pixel_total : 57685 time to create 1 rle with old method : 0.06724667549133301 length of segment : 347 time for calcul the mask position with numpy : 0.0005211830139160156 nb_pixel_total : 31545 time to create 1 rle with old method : 0.03775215148925781 length of segment : 224 time for calcul the mask position with numpy : 0.0008466243743896484 nb_pixel_total : 39679 time to create 1 rle with old method : 0.047991275787353516 length of segment : 295 time for calcul the mask position with numpy : 0.0006246566772460938 nb_pixel_total : 18763 time to create 1 rle with old method : 0.02251291275024414 length of segment : 186 time for calcul the mask position with numpy : 0.0006971359252929688 nb_pixel_total : 42992 time to create 1 rle with old method : 0.05138897895812988 length of segment : 206 time for calcul the mask position with numpy : 0.000766754150390625 nb_pixel_total : 39046 time to create 1 rle with old method : 0.047487735748291016 length of segment : 286 time for calcul the mask position with numpy : 0.0006654262542724609 nb_pixel_total : 41004 time to create 1 rle with old method : 0.04871964454650879 length of segment : 225 time for calcul the mask position with numpy : 0.0013511180877685547 nb_pixel_total : 29501 time to create 1 rle with old method : 0.03676342964172363 length of segment : 284 time for calcul the mask position with numpy : 0.0024056434631347656 nb_pixel_total : 64743 time to create 1 rle with old method : 0.0800774097442627 length of segment : 465 time for calcul the mask position with numpy : 0.0007574558258056641 nb_pixel_total : 9503 time to create 1 rle with old method : 0.011794090270996094 length of segment : 154 time for calcul the mask position with numpy : 0.0005884170532226562 nb_pixel_total : 17208 time to create 1 rle with old method : 0.020713090896606445 length of segment : 125 time for calcul the mask position with numpy : 0.0009675025939941406 nb_pixel_total : 21857 time to create 1 rle with old method : 0.028201580047607422 length of segment : 232 time for calcul the mask position with numpy : 0.0049130916595458984 nb_pixel_total : 183711 time to create 1 rle with new method : 0.008546113967895508 length of segment : 504 time for calcul the mask position with numpy : 0.0011146068572998047 nb_pixel_total : 25812 time to create 1 rle with old method : 0.032805681228637695 length of segment : 225 time for calcul the mask position with numpy : 0.0007016658782958984 nb_pixel_total : 17441 time to create 1 rle with old method : 0.020656585693359375 length of segment : 214 time for calcul the mask position with numpy : 0.00289154052734375 nb_pixel_total : 101197 time to create 1 rle with old method : 0.18215394020080566 length of segment : 354 time for calcul the mask position with numpy : 0.0007321834564208984 nb_pixel_total : 18019 time to create 1 rle with old method : 0.021418094635009766 length of segment : 229 time for calcul the mask position with numpy : 0.0005018711090087891 nb_pixel_total : 9153 time to create 1 rle with old method : 0.01139521598815918 length of segment : 131 time for calcul the mask position with numpy : 0.0011186599731445312 nb_pixel_total : 33474 time to create 1 rle with old method : 0.03977036476135254 length of segment : 269 time for calcul the mask position with numpy : 0.002333402633666992 nb_pixel_total : 54045 time to create 1 rle with old method : 0.08713841438293457 length of segment : 425 time for calcul the mask position with numpy : 0.0019164085388183594 nb_pixel_total : 53364 time to create 1 rle with old method : 0.06262779235839844 length of segment : 296 time for calcul the mask position with numpy : 0.0018229484558105469 nb_pixel_total : 45267 time to create 1 rle with old method : 0.05465412139892578 length of segment : 287 time for calcul the mask position with numpy : 0.0015749931335449219 nb_pixel_total : 43484 time to create 1 rle with old method : 0.051679134368896484 length of segment : 365 time for calcul the mask position with numpy : 0.0005478858947753906 nb_pixel_total : 18386 time to create 1 rle with old method : 0.022091388702392578 length of segment : 106 time for calcul the mask position with numpy : 0.0007598400115966797 nb_pixel_total : 23447 time to create 1 rle with old method : 0.02859807014465332 length of segment : 173 time for calcul the mask position with numpy : 0.0006651878356933594 nb_pixel_total : 27651 time to create 1 rle with old method : 0.032807111740112305 length of segment : 255 time for calcul the mask position with numpy : 0.00040459632873535156 nb_pixel_total : 12561 time to create 1 rle with old method : 0.015253067016601562 length of segment : 171 time for calcul the mask position with numpy : 0.0007379055023193359 nb_pixel_total : 18460 time to create 1 rle with old method : 0.02264094352722168 length of segment : 177 time for calcul the mask position with numpy : 0.0008037090301513672 nb_pixel_total : 32003 time to create 1 rle with old method : 0.03797554969787598 length of segment : 348 time for calcul the mask position with numpy : 0.0007042884826660156 nb_pixel_total : 29823 time to create 1 rle with old method : 0.03531146049499512 length of segment : 248 time for calcul the mask position with numpy : 0.0009868144989013672 nb_pixel_total : 15066 time to create 1 rle with old method : 0.018094778060913086 length of segment : 237 time for calcul the mask position with numpy : 0.004008293151855469 nb_pixel_total : 162169 time to create 1 rle with new method : 0.006465911865234375 length of segment : 689 time for calcul the mask position with numpy : 0.0009784698486328125 nb_pixel_total : 29283 time to create 1 rle with old method : 0.03468513488769531 length of segment : 235 time for calcul the mask position with numpy : 0.0015399456024169922 nb_pixel_total : 65909 time to create 1 rle with old method : 0.07768559455871582 length of segment : 284 time for calcul the mask position with numpy : 0.0005388259887695312 nb_pixel_total : 19101 time to create 1 rle with old method : 0.022731781005859375 length of segment : 207 time for calcul the mask position with numpy : 0.0007214546203613281 nb_pixel_total : 34291 time to create 1 rle with old method : 0.049674034118652344 length of segment : 317 time for calcul the mask position with numpy : 0.0008432865142822266 nb_pixel_total : 19918 time to create 1 rle with old method : 0.028972864151000977 length of segment : 156 time spent for convertir_results : 9.586331129074097 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 99 chid ids of type : 3594 Number RLEs to save : 27340 save missing photos in datou_result : time spend for datou_step_exec : 60.30572819709778 time spend to save output : 1.622138261795044 total time spend for step 1 : 61.92786645889282 step2:crop_condition Wed Sep 3 10:11:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 99 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 77 About to insert : list_path_to_insert length 77 new photo from crops ! About to upload 77 photos upload in portfolio : 3736932 init cache_photo without model_param we have 77 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756887113_1603909 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 77 photos in the portfolio 3736932 time of upload the photos Elapsed time : 21.865102529525757 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756887138_1603909 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.9582607746124268 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756887145_1603909 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.8932173252105713 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756887150_1603909 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.4714906215667725 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1381041935, 1381041701, 1381041625, 1381041602, 1381041600, 1381041586, 1381041512, 1381041503, 1381041492, 1381041473] Looping around the photos to save general results len do output : 99 /1381055659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381055885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041935', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041701', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041625', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041602', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041600', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041586', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041512', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041503', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041492', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041473', None, None, None, None, None, '3657660') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 307 time used for this insertion : 0.026309490203857422 save_final save missing photos in datou_result : time spend for datou_step_exec : 59.67109203338623 time spend to save output : 0.03017282485961914 total time spend for step 2 : 59.70126485824585 step3:rle_unique_nms_with_priority Wed Sep 3 10:12:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 99 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 3.67087984085083 time for calcul the mask position with numpy : 0.6157746315002441 nb_pixel_total : 7251296 time to create 1 rle with new method : 0.6086068153381348 time for calcul the mask position with numpy : 0.028655290603637695 nb_pixel_total : 182632 time to create 1 rle with new method : 0.821608304977417 time for calcul the mask position with numpy : 0.029031991958618164 nb_pixel_total : 123794 time to create 1 rle with old method : 0.1515195369720459 time for calcul the mask position with numpy : 0.025762557983398438 nb_pixel_total : 33089 time to create 1 rle with old method : 0.03784680366516113 time for calcul the mask position with numpy : 0.0264132022857666 nb_pixel_total : 190714 time to create 1 rle with new method : 0.8341100215911865 time for calcul the mask position with numpy : 0.02673935890197754 nb_pixel_total : 13634 time to create 1 rle with old method : 0.015862226486206055 time for calcul the mask position with numpy : 0.026630401611328125 nb_pixel_total : 142254 time to create 1 rle with old method : 0.1689896583557129 time for calcul the mask position with numpy : 0.026095151901245117 nb_pixel_total : 306866 time to create 1 rle with new method : 0.6683552265167236 time for calcul the mask position with numpy : 0.027406692504882812 nb_pixel_total : 50121 time to create 1 rle with old method : 0.05943918228149414 create new chi : 4.325716495513916 time to delete rle : 0.02911663055419922 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 9310 TO DO : save crop sub photo not yet done ! save time : 0.5717227458953857 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 4.469234466552734 time for calcul the mask position with numpy : 0.6745994091033936 nb_pixel_total : 7851369 time to create 1 rle with new method : 0.9048876762390137 time for calcul the mask position with numpy : 0.025658130645751953 nb_pixel_total : 109600 time to create 1 rle with old method : 0.12581276893615723 time for calcul the mask position with numpy : 0.024108171463012695 nb_pixel_total : 12470 time to create 1 rle with old method : 0.014393091201782227 time for calcul the mask position with numpy : 0.024643898010253906 nb_pixel_total : 28342 time to create 1 rle with old method : 0.0325322151184082 time for calcul the mask position with numpy : 0.027130603790283203 nb_pixel_total : 11009 time to create 1 rle with old method : 0.012549400329589844 time for calcul the mask position with numpy : 0.02425408363342285 nb_pixel_total : 19286 time to create 1 rle with old method : 0.02341938018798828 time for calcul the mask position with numpy : 0.03068685531616211 nb_pixel_total : 89616 time to create 1 rle with old method : 0.09946131706237793 time for calcul the mask position with numpy : 0.026267290115356445 nb_pixel_total : 41909 time to create 1 rle with old method : 0.047470808029174805 time for calcul the mask position with numpy : 0.025100231170654297 nb_pixel_total : 23691 time to create 1 rle with old method : 0.02701091766357422 time for calcul the mask position with numpy : 0.028412580490112305 nb_pixel_total : 32949 time to create 1 rle with old method : 0.038976430892944336 time for calcul the mask position with numpy : 0.026547670364379883 nb_pixel_total : 74159 time to create 1 rle with old method : 0.09737944602966309 create new chi : 2.4130465984344482 time to delete rle : 0.001087188720703125 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 6970 TO DO : save crop sub photo not yet done ! save time : 0.41081809997558594 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 4.788434267044067 time for calcul the mask position with numpy : 0.7862465381622314 nb_pixel_total : 7875639 time to create 1 rle with new method : 0.9187517166137695 time for calcul the mask position with numpy : 0.028276920318603516 nb_pixel_total : 9856 time to create 1 rle with old method : 0.013813018798828125 time for calcul the mask position with numpy : 0.026123523712158203 nb_pixel_total : 82336 time to create 1 rle with old method : 0.09249567985534668 time for calcul the mask position with numpy : 0.02555680274963379 nb_pixel_total : 23287 time to create 1 rle with old method : 0.026287317276000977 time for calcul the mask position with numpy : 0.02448296546936035 nb_pixel_total : 12436 time to create 1 rle with old method : 0.014483928680419922 time for calcul the mask position with numpy : 0.026956558227539062 nb_pixel_total : 16381 time to create 1 rle with old method : 0.01862049102783203 time for calcul the mask position with numpy : 0.02451944351196289 nb_pixel_total : 8264 time to create 1 rle with old method : 0.009676933288574219 time for calcul the mask position with numpy : 0.025997400283813477 nb_pixel_total : 27176 time to create 1 rle with old method : 0.03085803985595703 time for calcul the mask position with numpy : 0.025004863739013672 nb_pixel_total : 67459 time to create 1 rle with old method : 0.07568240165710449 time for calcul the mask position with numpy : 0.02528214454650879 nb_pixel_total : 21211 time to create 1 rle with old method : 0.024636030197143555 time for calcul the mask position with numpy : 0.025147438049316406 nb_pixel_total : 39710 time to create 1 rle with old method : 0.04542064666748047 time for calcul the mask position with numpy : 0.02572178840637207 nb_pixel_total : 35390 time to create 1 rle with old method : 0.04033708572387695 time for calcul the mask position with numpy : 0.02803516387939453 nb_pixel_total : 75255 time to create 1 rle with old method : 0.08547306060791016 create new chi : 2.544240951538086 time to delete rle : 0.0010781288146972656 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 7528 TO DO : save crop sub photo not yet done ! save time : 0.47835612297058105 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 2.154688596725464 time for calcul the mask position with numpy : 0.516732931137085 nb_pixel_total : 8186418 time to create 1 rle with new method : 0.5750942230224609 time for calcul the mask position with numpy : 0.024663209915161133 nb_pixel_total : 63245 time to create 1 rle with old method : 0.07369542121887207 time for calcul the mask position with numpy : 0.026008129119873047 nb_pixel_total : 9950 time to create 1 rle with old method : 0.01179647445678711 time for calcul the mask position with numpy : 0.02875518798828125 nb_pixel_total : 18087 time to create 1 rle with old method : 0.021246671676635742 time for calcul the mask position with numpy : 0.026358842849731445 nb_pixel_total : 16700 time to create 1 rle with old method : 0.019901752471923828 create new chi : 1.369724988937378 time to delete rle : 0.0004913806915283203 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3396 TO DO : save crop sub photo not yet done ! save time : 0.23525261878967285 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 5.900933265686035 time for calcul the mask position with numpy : 0.4755094051361084 nb_pixel_total : 7668292 time to create 1 rle with new method : 0.8416647911071777 time for calcul the mask position with numpy : 0.026016950607299805 nb_pixel_total : 11795 time to create 1 rle with old method : 0.013902902603149414 time for calcul the mask position with numpy : 0.02647852897644043 nb_pixel_total : 25405 time to create 1 rle with old method : 0.03215193748474121 time for calcul the mask position with numpy : 0.02693653106689453 nb_pixel_total : 26867 time to create 1 rle with old method : 0.03354501724243164 time for calcul the mask position with numpy : 0.026276826858520508 nb_pixel_total : 17237 time to create 1 rle with old method : 0.021430253982543945 time for calcul the mask position with numpy : 0.02643299102783203 nb_pixel_total : 23150 time to create 1 rle with old method : 0.02862858772277832 time for calcul the mask position with numpy : 0.027083873748779297 nb_pixel_total : 60588 time to create 1 rle with old method : 0.07371306419372559 time for calcul the mask position with numpy : 0.024847745895385742 nb_pixel_total : 65137 time to create 1 rle with old method : 0.07578563690185547 time for calcul the mask position with numpy : 0.02661728858947754 nb_pixel_total : 66355 time to create 1 rle with old method : 0.07548117637634277 time for calcul the mask position with numpy : 0.024643659591674805 nb_pixel_total : 61137 time to create 1 rle with old method : 0.06920075416564941 time for calcul the mask position with numpy : 0.025332212448120117 nb_pixel_total : 82712 time to create 1 rle with old method : 0.09272146224975586 time for calcul the mask position with numpy : 0.02541518211364746 nb_pixel_total : 19079 time to create 1 rle with old method : 0.021807432174682617 time for calcul the mask position with numpy : 0.025090932846069336 nb_pixel_total : 35623 time to create 1 rle with old method : 0.03957319259643555 time for calcul the mask position with numpy : 0.02481365203857422 nb_pixel_total : 44760 time to create 1 rle with old method : 0.050328969955444336 time for calcul the mask position with numpy : 0.024805307388305664 nb_pixel_total : 16049 time to create 1 rle with old method : 0.02128314971923828 time for calcul the mask position with numpy : 0.025112152099609375 nb_pixel_total : 70214 time to create 1 rle with old method : 0.0781404972076416 create new chi : 2.4798812866210938 time to delete rle : 0.0013546943664550781 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 9888 TO DO : save crop sub photo not yet done ! save time : 0.6059849262237549 nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 4.143157720565796 time for calcul the mask position with numpy : 0.4353201389312744 nb_pixel_total : 7350164 time to create 1 rle with new method : 0.6877379417419434 time for calcul the mask position with numpy : 0.023279905319213867 nb_pixel_total : 60362 time to create 1 rle with old method : 0.06370115280151367 time for calcul the mask position with numpy : 0.02326059341430664 nb_pixel_total : 24548 time to create 1 rle with old method : 0.02743244171142578 time for calcul the mask position with numpy : 0.02467632293701172 nb_pixel_total : 37125 time to create 1 rle with old method : 0.0416569709777832 time for calcul the mask position with numpy : 0.0244143009185791 nb_pixel_total : 23126 time to create 1 rle with old method : 0.02566981315612793 time for calcul the mask position with numpy : 0.024707317352294922 nb_pixel_total : 94276 time to create 1 rle with old method : 0.09986734390258789 time for calcul the mask position with numpy : 0.023437976837158203 nb_pixel_total : 21351 time to create 1 rle with old method : 0.023610830307006836 time for calcul the mask position with numpy : 0.02879643440246582 nb_pixel_total : 554934 time to create 1 rle with new method : 0.6652071475982666 time for calcul the mask position with numpy : 0.02617025375366211 nb_pixel_total : 83364 time to create 1 rle with old method : 0.0922393798828125 time for calcul the mask position with numpy : 0.024312257766723633 nb_pixel_total : 45150 time to create 1 rle with old method : 0.04968833923339844 create new chi : 2.5027718544006348 time to delete rle : 0.0011637210845947266 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 8128 TO DO : save crop sub photo not yet done ! save time : 0.5120031833648682 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 6.281381368637085 time for calcul the mask position with numpy : 0.49440884590148926 nb_pixel_total : 7750727 time to create 1 rle with new method : 0.5810146331787109 time for calcul the mask position with numpy : 0.02672719955444336 nb_pixel_total : 17208 time to create 1 rle with old method : 0.02871394157409668 time for calcul the mask position with numpy : 0.027097225189208984 nb_pixel_total : 9503 time to create 1 rle with old method : 0.011353731155395508 time for calcul the mask position with numpy : 0.025183439254760742 nb_pixel_total : 64743 time to create 1 rle with old method : 0.0755929946899414 time for calcul the mask position with numpy : 0.029325246810913086 nb_pixel_total : 29501 time to create 1 rle with old method : 0.03357243537902832 time for calcul the mask position with numpy : 0.024599790573120117 nb_pixel_total : 41004 time to create 1 rle with old method : 0.05661320686340332 time for calcul the mask position with numpy : 0.026924848556518555 nb_pixel_total : 39046 time to create 1 rle with old method : 0.05163741111755371 time for calcul the mask position with numpy : 0.02588677406311035 nb_pixel_total : 42992 time to create 1 rle with old method : 0.04914093017578125 time for calcul the mask position with numpy : 0.025234222412109375 nb_pixel_total : 18763 time to create 1 rle with old method : 0.020542621612548828 time for calcul the mask position with numpy : 0.027320384979248047 nb_pixel_total : 39679 time to create 1 rle with old method : 0.0458674430847168 time for calcul the mask position with numpy : 0.024013757705688477 nb_pixel_total : 31545 time to create 1 rle with old method : 0.03697466850280762 time for calcul the mask position with numpy : 0.025419235229492188 nb_pixel_total : 57685 time to create 1 rle with old method : 0.0650331974029541 time for calcul the mask position with numpy : 0.024762392044067383 nb_pixel_total : 28564 time to create 1 rle with old method : 0.03239774703979492 time for calcul the mask position with numpy : 0.02525496482849121 nb_pixel_total : 52768 time to create 1 rle with old method : 0.059766530990600586 time for calcul the mask position with numpy : 0.025689125061035156 nb_pixel_total : 29081 time to create 1 rle with old method : 0.0388638973236084 time for calcul the mask position with numpy : 0.0258481502532959 nb_pixel_total : 41591 time to create 1 rle with old method : 0.05756068229675293 create new chi : 2.175262451171875 time to delete rle : 0.001592397689819336 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 10214 TO DO : save crop sub photo not yet done ! save time : 0.6330792903900146 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 5.303517818450928 time for calcul the mask position with numpy : 0.6350266933441162 nb_pixel_total : 7732184 time to create 1 rle with new method : 0.860328197479248 time for calcul the mask position with numpy : 0.02506113052368164 nb_pixel_total : 45267 time to create 1 rle with old method : 0.05285382270812988 time for calcul the mask position with numpy : 0.02518153190612793 nb_pixel_total : 53364 time to create 1 rle with old method : 0.061600446701049805 time for calcul the mask position with numpy : 0.024857759475708008 nb_pixel_total : 54045 time to create 1 rle with old method : 0.06252789497375488 time for calcul the mask position with numpy : 0.024947166442871094 nb_pixel_total : 33474 time to create 1 rle with old method : 0.04058384895324707 time for calcul the mask position with numpy : 0.02517104148864746 nb_pixel_total : 9153 time to create 1 rle with old method : 0.010736703872680664 time for calcul the mask position with numpy : 0.025408029556274414 nb_pixel_total : 18019 time to create 1 rle with old method : 0.02056121826171875 time for calcul the mask position with numpy : 0.025725603103637695 nb_pixel_total : 101197 time to create 1 rle with old method : 0.11260843276977539 time for calcul the mask position with numpy : 0.02439427375793457 nb_pixel_total : 17441 time to create 1 rle with old method : 0.019858121871948242 time for calcul the mask position with numpy : 0.024019956588745117 nb_pixel_total : 24688 time to create 1 rle with old method : 0.036391496658325195 time for calcul the mask position with numpy : 0.028564453125 nb_pixel_total : 183711 time to create 1 rle with new method : 0.6949164867401123 time for calcul the mask position with numpy : 0.024842500686645508 nb_pixel_total : 21857 time to create 1 rle with old method : 0.02410149574279785 create new chi : 2.979562520980835 time to delete rle : 0.001157522201538086 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 8381 TO DO : save crop sub photo not yet done ! save time : 0.5321576595306396 nb_obj : 9 nb_hashtags : 1 time to prepare the origin masks : 3.2478888034820557 time for calcul the mask position with numpy : 0.6510372161865234 nb_pixel_total : 8073519 time to create 1 rle with new method : 0.7054362297058105 time for calcul the mask position with numpy : 0.02534937858581543 nb_pixel_total : 15066 time to create 1 rle with old method : 0.017239809036254883 time for calcul the mask position with numpy : 0.025081157684326172 nb_pixel_total : 29823 time to create 1 rle with old method : 0.03424358367919922 time for calcul the mask position with numpy : 0.02537393569946289 nb_pixel_total : 32003 time to create 1 rle with old method : 0.035981178283691406 time for calcul the mask position with numpy : 0.024765491485595703 nb_pixel_total : 18460 time to create 1 rle with old method : 0.030701160430908203 time for calcul the mask position with numpy : 0.026771068572998047 nb_pixel_total : 12561 time to create 1 rle with old method : 0.018926382064819336 time for calcul the mask position with numpy : 0.02420520782470703 nb_pixel_total : 27651 time to create 1 rle with old method : 0.030919313430786133 time for calcul the mask position with numpy : 0.024149179458618164 nb_pixel_total : 23447 time to create 1 rle with old method : 0.026027441024780273 time for calcul the mask position with numpy : 0.024044036865234375 nb_pixel_total : 18386 time to create 1 rle with old method : 0.020723819732666016 time for calcul the mask position with numpy : 0.025135040283203125 nb_pixel_total : 43484 time to create 1 rle with old method : 0.04734182357788086 create new chi : 1.8880374431610107 time to delete rle : 0.0008447170257568359 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++Number RLEs to save : 6320 TO DO : save crop sub photo not yet done ! save time : 0.4360778331756592 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 2.5134146213531494 time for calcul the mask position with numpy : 0.5553398132324219 nb_pixel_total : 7963752 time to create 1 rle with new method : 0.789421558380127 time for calcul the mask position with numpy : 0.024280071258544922 nb_pixel_total : 19918 time to create 1 rle with old method : 0.021943330764770508 time for calcul the mask position with numpy : 0.02346181869506836 nb_pixel_total : 34268 time to create 1 rle with old method : 0.03932905197143555 time for calcul the mask position with numpy : 0.022658348083496094 nb_pixel_total : 19101 time to create 1 rle with old method : 0.02104330062866211 time for calcul the mask position with numpy : 0.023565053939819336 nb_pixel_total : 65909 time to create 1 rle with old method : 0.07462835311889648 time for calcul the mask position with numpy : 0.024880647659301758 nb_pixel_total : 29283 time to create 1 rle with old method : 0.032731056213378906 time for calcul the mask position with numpy : 0.0269010066986084 nb_pixel_total : 162169 time to create 1 rle with new method : 0.6270549297332764 create new chi : 2.3740601539611816 time to delete rle : 0.0008933544158935547 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 5923 TO DO : save crop sub photo not yet done ! save time : 0.3733973503112793 map_output_result : {1381041935: (0.0, 'Should be the crop_list due to order', 0), 1381041701: (0.0, 'Should be the crop_list due to order', 0), 1381041625: (0.0, 'Should be the crop_list due to order', 0), 1381041602: (0.0, 'Should be the crop_list due to order', 0), 1381041600: (0.0, 'Should be the crop_list due to order', 0), 1381041586: (0.0, 'Should be the crop_list due to order', 0), 1381041512: (0.0, 'Should be the crop_list due to order', 0), 1381041503: (0.0, 'Should be the crop_list due to order', 0), 1381041492: (0.0, 'Should be the crop_list due to order', 0), 1381041473: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1381041935, 1381041701, 1381041625, 1381041602, 1381041600, 1381041586, 1381041512, 1381041503, 1381041492, 1381041473] Looping around the photos to save general results len do output : 10 /1381041935.Didn't retrieve data . /1381041701.Didn't retrieve data . /1381041625.Didn't retrieve data . /1381041602.Didn't retrieve data . /1381041600.Didn't retrieve data . /1381041586.Didn't retrieve data . /1381041512.Didn't retrieve data . /1381041503.Didn't retrieve data . /1381041492.Didn't retrieve data . /1381041473.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041935', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041701', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041625', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041602', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041600', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041586', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041512', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041503', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041492', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041473', None, None, None, None, None, '3657660') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.017124414443969727 save_final save missing photos in datou_result : time spend for datou_step_exec : 73.6194121837616 time spend to save output : 0.017531633377075195 total time spend for step 3 : 73.63694381713867 step4:ventilate_hashtags_in_portfolio Wed Sep 3 10:13:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26479238 get user id for portfolio 26479238 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26479238 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','carton','mal_croppe','autre','papier','metal','pehd','pet_clair','environnement','background','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26479238 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','carton','mal_croppe','autre','papier','metal','pehd','pet_clair','environnement','background','flou')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26479238 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','carton','mal_croppe','autre','papier','metal','pehd','pet_clair','environnement','background','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26479979,26479980,26479981,26479982,26479983,26479984,26479985,26479986,26479987,26479988,26479989?tags=pet_fonce,carton,mal_croppe,autre,papier,metal,pehd,pet_clair,environnement,background,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1381041935, 1381041701, 1381041625, 1381041602, 1381041600, 1381041586, 1381041512, 1381041503, 1381041492, 1381041473] Looping around the photos to save general results len do output : 1 /26479238. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041935', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041701', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041625', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041602', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041600', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041586', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041512', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041503', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041492', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041473', None, None, None, None, None, '3657660') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.025253772735595703 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8035416603088379 time spend to save output : 0.02898383140563965 total time spend for step 4 : 0.8325254917144775 step5:final Wed Sep 3 10:13:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1381041935: ('0.06318287037037035',), 1381041701: ('0.06318287037037035',), 1381041625: ('0.06318287037037035',), 1381041602: ('0.06318287037037035',), 1381041600: ('0.06318287037037035',), 1381041586: ('0.06318287037037035',), 1381041512: ('0.06318287037037035',), 1381041503: ('0.06318287037037035',), 1381041492: ('0.06318287037037035',), 1381041473: ('0.06318287037037035',)} new output for save of step final : {1381041935: ('0.06318287037037035',), 1381041701: ('0.06318287037037035',), 1381041625: ('0.06318287037037035',), 1381041602: ('0.06318287037037035',), 1381041600: ('0.06318287037037035',), 1381041586: ('0.06318287037037035',), 1381041512: ('0.06318287037037035',), 1381041503: ('0.06318287037037035',), 1381041492: ('0.06318287037037035',), 1381041473: ('0.06318287037037035',)} [1381041935, 1381041701, 1381041625, 1381041602, 1381041600, 1381041586, 1381041512, 1381041503, 1381041492, 1381041473] Looping around the photos to save general results len do output : 10 /1381041935.Didn't retrieve data . /1381041701.Didn't retrieve data . /1381041625.Didn't retrieve data . /1381041602.Didn't retrieve data . /1381041600.Didn't retrieve data . /1381041586.Didn't retrieve data . /1381041512.Didn't retrieve data . /1381041503.Didn't retrieve data . /1381041492.Didn't retrieve data . /1381041473.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041935', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041701', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041625', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041602', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041600', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041586', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041512', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041503', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041492', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041473', None, None, None, None, None, '3657660') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.014100790023803711 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13587164878845215 time spend to save output : 0.014597654342651367 total time spend for step 5 : 0.15046930313110352 step6:blur_detection Wed Sep 3 10:13:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5.jpg resize: (2160, 3840) 1381041935 -3.96417864815387 treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27.jpg resize: (2160, 3840) 1381041701 -6.1273804086689205 treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9.jpg resize: (2160, 3840) 1381041625 -6.166887367169499 treat image : temp/1756887028_1603909_1381041602_19960fae144082a8d8d38db3bca78d5d.jpg resize: (2160, 3840) 1381041602 -7.006235203670016 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899.jpg resize: (2160, 3840) 1381041600 -7.046275563691219 treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b.jpg resize: (2160, 3840) 1381041586 -7.012646309368264 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e.jpg resize: (2160, 3840) 1381041512 -6.88018539920849 treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57.jpg resize: (2160, 3840) 1381041503 -6.955301051297578 treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4.jpg resize: (2160, 3840) 1381041492 -6.933003540728826 treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28.jpg resize: (2160, 3840) 1381041473 -7.1270298020757945 treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843092_0.png resize: (385, 274) 1381055659 -3.089279656996578 treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843093_0.png resize: (633, 664) 1381055660 -5.403698855497169 treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843094_0.png resize: (403, 541) 1381055661 -2.24953089601033 treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843095_0.png resize: (148, 134) 1381055663 -3.6048402408745326 treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843097_0.png resize: (377, 198) 1381055664 -3.3019774991189044 treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843098_0.png resize: (561, 505) 1381055665 -3.5570135809053 treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843100_0.png resize: (320, 399) 1381055667 -4.1393942748990895 treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843101_0.png resize: (183, 367) 1381055668 -3.876514597061417 treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843102_0.png resize: (257, 126) 1381055669 -4.616165041975831 treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843103_0.png resize: (258, 219) 1381055671 -2.9493433231920623 treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843104_0.png resize: (322, 453) 1381055672 -4.359544478341354 treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843106_0.png resize: (104, 167) 1381055673 -4.397992465614398 treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843109_0.png resize: (450, 373) 1381055675 -4.082856226156444 treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843110_0.png resize: (333, 402) 1381055676 -4.1693199507875764 treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843111_0.png resize: (271, 377) 1381055677 -3.1436537580046715 treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843112_0.png resize: (236, 217) 1381055679 -3.1662778473242374 treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843114_0.png resize: (353, 444) 1381055680 -3.5728406175774903 treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843117_0.png resize: (130, 155) 1381055681 -2.5037876763193667 treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843119_0.png resize: (254, 128) 1381055682 -4.61987036550991 treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843120_0.png resize: (450, 278) 1381055684 -4.0018171250942975 treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843121_0.png resize: (97, 156) 1381055685 -4.578978287277429 treat image : temp/1756887028_1603909_1381041602_19960fae144082a8d8d38db3bca78d5d_rle_crop_3941843122_0.png resize: (112, 192) 1381055686 -3.4455939436821446 treat image : temp/1756887028_1603909_1381041602_19960fae144082a8d8d38db3bca78d5d_rle_crop_3941843123_0.png resize: (141, 198) 1381055688 -3.165467050855757 treat image : temp/1756887028_1603909_1381041602_19960fae144082a8d8d38db3bca78d5d_rle_crop_3941843124_0.png resize: (95, 183) 1381055689 -4.164078800234414 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843126_0.png resize: (304, 323) 1381055690 -3.9041678156769333 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843127_0.png resize: (127, 164) 1381055692 -2.741725312683368 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843128_0.png resize: (243, 307) 1381055693 -3.487612388363954 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843129_0.png resize: (295, 197) 1381055694 -4.340145481327075 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843130_0.png resize: (124, 177) 1381055696 -2.4154075164460007 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843131_0.png resize: (358, 338) 1381055697 -4.411552953737598 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843132_0.png resize: (329, 310) 1381055698 -4.495398820220396 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843133_0.png resize: (372, 308) 1381055700 -4.756939782222776 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843135_0.png resize: (404, 342) 1381055701 -4.037920322755507 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843136_0.png resize: (202, 195) 1381055703 -2.9892997662736525 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843138_0.png resize: (182, 210) 1381055705 -4.005783342855211 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843139_0.png resize: (178, 172) 1381055706 -1.5966862576038194 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843140_0.png resize: (167, 105) 1381055707 -3.262652403815156 treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843141_0.png resize: (257, 282) 1381055709 -3.504405753249586 treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843142_0.png resize: (339, 347) 1381055710 -3.609908080722966 treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843143_0.png resize: (700, 1086) 1381055711 -5.557158238691115 treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843147_0.png resize: (264, 228) 1381055713 -3.8374306889153567 treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843148_0.png resize: (232, 221) 1381055714 -4.408400783710073 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843150_0.png resize: (352, 237) 1381055715 -3.140124178536144 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843151_0.png resize: (266, 190) 1381055717 2.6462009348655484 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843152_0.png resize: (334, 217) 1381055718 -2.421079594946371 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843153_0.png resize: (245, 250) 1381055719 -4.0494938316468785 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843154_0.png resize: (347, 257) 1381055721 -4.176032083609783 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843155_0.png resize: (208, 188) 1381055722 -3.305574244867745 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843157_0.png resize: (166, 199) 1381055723 -2.0271292513000234 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843158_0.png resize: (189, 279) 1381055725 -4.430154634854084 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843160_0.png resize: (214, 248) 1381055726 -3.860412641204849 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843161_0.png resize: (284, 159) 1381055727 -2.5174628034021262 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843162_0.png resize: (346, 280) 1381055729 -4.142355212888937 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843163_0.png resize: (119, 152) 1381055730 -3.7328389381773808 treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843165_0.png resize: (232, 159) 1381055731 -2.9131343991686918 treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843166_0.png resize: (409, 624) 1381055733 -4.988792704299671 treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843167_0.png resize: (222, 212) 1381055734 -3.8387476409919823 treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843168_0.png resize: (213, 131) 1381055736 -2.914987452478753 treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843170_0.png resize: (229, 111) 1381055738 -3.579988058656649 treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843171_0.png resize: (135, 116) 1381055739 -3.2970382117916985 treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843172_0.png resize: (269, 178) 1381055741 -3.5614656323410707 treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843173_0.png resize: (412, 202) 1381055743 -5.4820619748057355 treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843174_0.png resize: (296, 288) 1381055745 -4.528261510695882 treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843176_0.png resize: (391, 204) 1381055747 -2.822784373128898 treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843177_0.png resize: (102, 221) 1381055748 -0.02811605227713132 treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843178_0.png resize: (168, 179) 1381055750 0.6081647364565026 treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843179_0.png resize: (243, 164) 1381055752 -2.624420874325323 treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843180_0.png resize: (167, 130) 1381055753 -2.873978716849824 treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843181_0.png resize: (176, 164) 1381055754 -0.022844966056054957 treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843182_0.png resize: (339, 148) 1381055756 -2.193406685426183 treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843183_0.png resize: (248, 200) 1381055757 -3.999074452368652 treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843184_0.png resize: (227, 115) 1381055758 -2.446890312036181 treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28_rle_crop_3941843185_0.png resize: (608, 432) 1381055760 -4.513792084774671 treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28_rle_crop_3941843186_0.png resize: (235, 194) 1381055761 -2.43444432413691 treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28_rle_crop_3941843187_0.png resize: (282, 361) 1381055762 -4.51036029130614 treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28_rle_crop_3941843189_0.png resize: (313, 181) 1381055764 -3.204044785115593 treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28_rle_crop_3941843190_0.png resize: (155, 181) 1381055766 -2.819267638224532 treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843096_0.png resize: (425, 752) 1381055818 -2.6957383002492246 treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843099_0.png resize: (296, 779) 1381055819 -3.122623162768104 treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843107_0.png resize: (145, 240) 1381055821 -4.040659903017443 treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843108_0.png resize: (109, 158) 1381055822 -3.64500866009352 treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843115_0.png resize: (138, 234) 1381055823 -3.5780592894043712 treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843118_0.png resize: (105, 160) 1381055825 -3.1299108478162965 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843156_0.png resize: (265, 232) 1381055826 -3.3906257608941353 treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28_rle_crop_3941843188_0.png resize: (206, 142) 1381055827 -2.2358947305592536 treat image : temp/1756887028_1603909_1381041602_19960fae144082a8d8d38db3bca78d5d_rle_crop_3941843125_0.png resize: (256, 325) 1381055858 -4.462201734183641 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843134_0.png resize: (219, 495) 1381055859 -4.049016453503614 treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843144_0.png resize: (124, 277) 1381055860 -3.9407449822144507 treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843145_0.png resize: (366, 348) 1381055861 -5.919638388632704 treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843146_0.png resize: (191, 178) 1381055862 -3.231016895556213 treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843149_0.png resize: (202, 489) 1381055863 -4.005670819743091 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843159_0.png resize: (258, 199) 1381055864 -4.467512081487737 treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843169_0.png resize: (345, 390) 1381055865 -3.2485499608554047 treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843175_0.png resize: (232, 335) 1381055866 -1.927461915248163 treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843105_0.png resize: (165, 149) 1381055881 -4.5793903795594995 treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843113_0.png resize: (179, 149) 1381055882 -4.7239041991137976 treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843116_0.png resize: (90, 112) 1381055883 -2.007885140606536 treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843137_0.png resize: (139, 154) 1381055884 -3.668066373153995 treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843164_0.png resize: (123, 167) 1381055885 -2.662318802742269 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 109 time used for this insertion : 0.019070148468017578 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 109 time used for this insertion : 0.03500723838806152 save missing photos in datou_result : time spend for datou_step_exec : 38.77949571609497 time spend to save output : 0.05901360511779785 total time spend for step 6 : 38.83850932121277 step7:brightness Wed Sep 3 10:14:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5.jpg treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27.jpg treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9.jpg treat image : temp/1756887028_1603909_1381041602_19960fae144082a8d8d38db3bca78d5d.jpg treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899.jpg treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b.jpg treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e.jpg treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57.jpg treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4.jpg treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28.jpg treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843092_0.png treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843093_0.png treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843094_0.png treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843095_0.png treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843097_0.png treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843098_0.png treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843100_0.png treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843101_0.png treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843102_0.png treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843103_0.png treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843104_0.png treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843106_0.png treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843109_0.png treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843110_0.png treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843111_0.png treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843112_0.png treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843114_0.png treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843117_0.png treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843119_0.png treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843120_0.png treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843121_0.png treat image : temp/1756887028_1603909_1381041602_19960fae144082a8d8d38db3bca78d5d_rle_crop_3941843122_0.png treat image : temp/1756887028_1603909_1381041602_19960fae144082a8d8d38db3bca78d5d_rle_crop_3941843123_0.png treat image : temp/1756887028_1603909_1381041602_19960fae144082a8d8d38db3bca78d5d_rle_crop_3941843124_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843126_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843127_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843128_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843129_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843130_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843131_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843132_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843133_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843135_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843136_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843138_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843139_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843140_0.png treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843141_0.png treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843142_0.png treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843143_0.png treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843147_0.png treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843148_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843150_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843151_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843152_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843153_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843154_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843155_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843157_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843158_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843160_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843161_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843162_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843163_0.png treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843165_0.png treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843166_0.png treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843167_0.png treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843168_0.png treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843170_0.png treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843171_0.png treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843172_0.png treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843173_0.png treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843174_0.png treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843176_0.png treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843177_0.png treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843178_0.png treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843179_0.png treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843180_0.png treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843181_0.png treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843182_0.png treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843183_0.png treat image : temp/1756887028_1603909_1381041492_14e54df6c0fd0ffc9b7b97717cd26be4_rle_crop_3941843184_0.png treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28_rle_crop_3941843185_0.png treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28_rle_crop_3941843186_0.png treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28_rle_crop_3941843187_0.png treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28_rle_crop_3941843189_0.png treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28_rle_crop_3941843190_0.png treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843096_0.png treat image : temp/1756887028_1603909_1381041935_b361be81127c02cbf99e602e6a719bb5_rle_crop_3941843099_0.png treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843107_0.png treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843108_0.png treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843115_0.png treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843118_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843156_0.png treat image : temp/1756887028_1603909_1381041473_8ed0be18cc3dadfd652120ab1f0a5c28_rle_crop_3941843188_0.png treat image : temp/1756887028_1603909_1381041602_19960fae144082a8d8d38db3bca78d5d_rle_crop_3941843125_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843134_0.png treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843144_0.png treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843145_0.png treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843146_0.png treat image : temp/1756887028_1603909_1381041586_d2d82eb37731186ee0392a7608e4b62b_rle_crop_3941843149_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843159_0.png treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843169_0.png treat image : temp/1756887028_1603909_1381041503_5c7626ce03fa3a21dcbb3a8451263b57_rle_crop_3941843175_0.png treat image : temp/1756887028_1603909_1381041701_eedacc439e7a3515ea1cfb380b785f27_rle_crop_3941843105_0.png treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843113_0.png treat image : temp/1756887028_1603909_1381041625_415b53e02a3dcd5efa21fc30a933a9b9_rle_crop_3941843116_0.png treat image : temp/1756887028_1603909_1381041600_929d1d6ceb64417467240aa6955c5899_rle_crop_3941843137_0.png treat image : temp/1756887028_1603909_1381041512_f708144a0e068b814d4d04c93293925e_rle_crop_3941843164_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 109 time used for this insertion : 0.01514744758605957 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 109 time used for this insertion : 0.029598712921142578 save missing photos in datou_result : time spend for datou_step_exec : 11.61079216003418 time spend to save output : 0.049933433532714844 total time spend for step 7 : 11.660725593566895 step8:velours_tree Wed Sep 3 10:14:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.18317723274230957 time spend to save output : 3.910064697265625e-05 total time spend for step 8 : 0.18321633338928223 step9:send_mail_cod Wed Sep 3 10:14:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26479238_03-09-2025_10_14_37.pdf 26479979 imagette264799791756887277 26479980 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264799801756887277 26479981 imagette264799811756887278 26479982 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264799821756887278 26479983 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264799831756887278 26479984 imagette264799841756887281 26479985 imagette264799851756887281 26479986 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264799861756887281 26479988 imagette264799881756887282 26479989 imagette264799891756887282 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26479238 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26479979,26479980,26479981,26479982,26479983,26479984,26479985,26479986,26479987,26479988,26479989?tags=pet_fonce,carton,mal_croppe,autre,papier,metal,pehd,pet_clair,environnement,background,flou args[1381041935] : ((1381041935, -3.96417864815387, 492609224), (1381041935, -0.9821659685921837, 501862349), '0.06318287037037035') We are sending mail with results at report@fotonower.com args[1381041701] : ((1381041701, -6.1273804086689205, 492609224), (1381041701, -0.09437121198610007, 496442774), '0.06318287037037035') We are sending mail with results at report@fotonower.com args[1381041625] : ((1381041625, -6.166887367169499, 492609224), (1381041625, -0.08470674248759395, 496442774), '0.06318287037037035') We are sending mail with results at report@fotonower.com args[1381041602] : ((1381041602, -7.006235203670016, 492609224), (1381041602, 0.5764284199538441, 2107752395), '0.06318287037037035') We are sending mail with results at report@fotonower.com args[1381041600] : ((1381041600, -7.046275563691219, 492609224), (1381041600, 0.48602109208894084, 2107752395), '0.06318287037037035') We are sending mail with results at report@fotonower.com args[1381041586] : ((1381041586, -7.012646309368264, 492609224), (1381041586, 0.6040876424636867, 2107752395), '0.06318287037037035') We are sending mail with results at report@fotonower.com args[1381041512] : ((1381041512, -6.88018539920849, 492609224), (1381041512, 0.7913806826185189, 2107752395), '0.06318287037037035') We are sending mail with results at report@fotonower.com args[1381041503] : ((1381041503, -6.955301051297578, 492609224), (1381041503, 0.8380187597966, 2107752395), '0.06318287037037035') We are sending mail with results at report@fotonower.com args[1381041492] : ((1381041492, -6.933003540728826, 492609224), (1381041492, 0.6950164915725946, 2107752395), '0.06318287037037035') We are sending mail with results at report@fotonower.com args[1381041473] : ((1381041473, -7.1270298020757945, 492609224), (1381041473, 0.8154003539652108, 2107752395), '0.06318287037037035') We are sending mail with results at report@fotonower.com refus_total : 0.06318287037037035 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26479238 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26479238_03-09-2025_10_14_37.pdf results_Auto_P26479238_03-09-2025_10_14_37.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26479238_03-09-2025_10_14_37.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26479238','results_Auto_P26479238_03-09-2025_10_14_37.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26479238_03-09-2025_10_14_37.pdf','pdf','','0.61','0.06318287037037035') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26479238

https://www.fotonower.com/image?json=false&list_photos_id=1381041935
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381041701
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381041625
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381041602
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381041600
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381041586
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381041512
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381041503
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381041492
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381041473
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 6.32%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/26479980?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26479982?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26479983?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26479986?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26479238_03-09-2025_10_14_37.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26479979,26479980,26479981,26479982,26479983,26479984,26479985,26479986,26479987,26479988,26479989?tags=pet_fonce,carton,mal_croppe,autre,papier,metal,pehd,pet_clair,environnement,background,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 03 Sep 2025 08:14:45 GMT Content-Length: 0 Connection: close X-Message-Id: iHxjSDvoQiWV6a_Dn9iMtw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1381041935, 1381041701, 1381041625, 1381041602, 1381041600, 1381041586, 1381041512, 1381041503, 1381041492, 1381041473] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041935', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041701', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041625', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041602', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041600', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041586', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041512', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041503', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041492', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041473', None, None, None, None, None, '3657660') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.015606880187988281 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.107409954071045 time spend to save output : 0.015819072723388672 total time spend for step 9 : 8.123229026794434 step10:split_time_score Wed Sep 3 10:14:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03092025 26479238 Nombre de photos uploadées : 10 / 23040 (0%) 03092025 26479238 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 03092025 26479238 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005130767822265625 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.22088408470153809 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.033641923365876306 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26474311_03-09-2025_07_36_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26474311 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26474311 AND mptpi.`type`=3726 To do Qualite : 0.06318287037037035 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26479238_03-09-2025_10_14_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26479238 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26479238 AND mptpi.`type`=3594 To do Qualite : 0.03993974264039564 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26479246_03-09-2025_10_13_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26479246 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26479246 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03092025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1381041935, 1381041701, 1381041625, 1381041602, 1381041600, 1381041586, 1381041512, 1381041503, 1381041492, 1381041473] Looping around the photos to save general results len do output : 1 /26479238Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041935', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041701', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041625', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041602', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041600', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041586', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041512', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041503', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041492', None, None, None, None, None, '3657660') ('3318', None, None, None, None, None, None, None, '3657660') ('3318', '26479238', '1381041473', None, None, None, None, None, '3657660') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.015009641647338867 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5737576484680176 time spend to save output : 0.015193939208984375 total time spend for step 10 : 0.588951587677002 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 118.92user 101.64system 4:21.53elapsed 84%CPU (0avgtext+0avgdata 4030736maxresident)k 691784inputs+107872outputs (9314major+11054598minor)pagefaults 0swaps