python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1062292 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3512838'] with mtr_portfolio_ids : ['25915172'] and first list_photo_ids : [] new path : /proc/1062292/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 37 ; length of list_pids : 37 ; length of list_args : 37 time to download the photos : 9.64489459991455 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Aug 12 15:00:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10801 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-12 15:00:40.268083: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-12 15:00:40.299445: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-12 15:00:40.301793: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f149c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-12 15:00:40.301833: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-12 15:00:40.306247: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-12 15:00:40.457220: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1de86bd0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-12 15:00:40.457278: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-12 15:00:40.458369: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-12 15:00:40.458817: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 15:00:40.461842: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 15:00:40.464704: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-12 15:00:40.465191: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-12 15:00:40.468381: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-12 15:00:40.469433: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-12 15:00:40.473906: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-12 15:00:40.475238: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-12 15:00:40.475325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 15:00:40.476025: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-12 15:00:40.476042: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-12 15:00:40.476065: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-12 15:00:40.477261: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6974 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-12 15:00:40.733514: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-12 15:00:40.733644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 15:00:40.733668: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 15:00:40.733689: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-12 15:00:40.733709: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-12 15:00:40.733729: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-12 15:00:40.733748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-12 15:00:40.733768: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-12 15:00:40.735245: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-12 15:00:40.736628: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-12 15:00:40.736669: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 15:00:40.736688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 15:00:40.736705: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-12 15:00:40.736723: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-12 15:00:40.736743: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-12 15:00:40.736765: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-12 15:00:40.736784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-12 15:00:40.738220: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-12 15:00:40.738262: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-12 15:00:40.738273: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-12 15:00:40.738284: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-12 15:00:40.739826: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6974 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-12 15:00:51.801990: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 15:00:51.992296: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 37 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 1062849 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 695 tf kernel not reseted sub process len(results) : 37 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 37 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5984 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0003628730773925781 nb_pixel_total : 9562 time to create 1 rle with old method : 0.014293193817138672 length of segment : 124 time for calcul the mask position with numpy : 0.002252340316772461 nb_pixel_total : 100925 time to create 1 rle with old method : 0.11440443992614746 length of segment : 509 time for calcul the mask position with numpy : 0.00021648406982421875 nb_pixel_total : 9688 time to create 1 rle with old method : 0.011919736862182617 length of segment : 120 time for calcul the mask position with numpy : 0.0002300739288330078 nb_pixel_total : 12427 time to create 1 rle with old method : 0.014982461929321289 length of segment : 112 time for calcul the mask position with numpy : 0.001859903335571289 nb_pixel_total : 115173 time to create 1 rle with old method : 0.13567805290222168 length of segment : 549 time for calcul the mask position with numpy : 0.00014638900756835938 nb_pixel_total : 5596 time to create 1 rle with old method : 0.006751298904418945 length of segment : 112 time for calcul the mask position with numpy : 0.00016927719116210938 nb_pixel_total : 9463 time to create 1 rle with old method : 0.011599540710449219 length of segment : 97 time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 8801 time to create 1 rle with old method : 0.01064920425415039 length of segment : 121 time for calcul the mask position with numpy : 0.0015556812286376953 nb_pixel_total : 108161 time to create 1 rle with old method : 0.12251687049865723 length of segment : 537 time for calcul the mask position with numpy : 0.0004372596740722656 nb_pixel_total : 29353 time to create 1 rle with old method : 0.03377699851989746 length of segment : 139 time for calcul the mask position with numpy : 0.0014414787292480469 nb_pixel_total : 107008 time to create 1 rle with old method : 0.11788249015808105 length of segment : 741 time for calcul the mask position with numpy : 0.0005004405975341797 nb_pixel_total : 35353 time to create 1 rle with old method : 0.04050254821777344 length of segment : 207 time for calcul the mask position with numpy : 0.0003864765167236328 nb_pixel_total : 27959 time to create 1 rle with old method : 0.032457590103149414 length of segment : 223 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 2273 time to create 1 rle with old method : 0.002843141555786133 length of segment : 60 time for calcul the mask position with numpy : 0.0014226436614990234 nb_pixel_total : 109471 time to create 1 rle with old method : 0.12305092811584473 length of segment : 524 time for calcul the mask position with numpy : 0.001504659652709961 nb_pixel_total : 50915 time to create 1 rle with old method : 0.05712747573852539 length of segment : 462 time for calcul the mask position with numpy : 0.00023436546325683594 nb_pixel_total : 5683 time to create 1 rle with old method : 0.006619453430175781 length of segment : 105 time for calcul the mask position with numpy : 0.0019991397857666016 nb_pixel_total : 78498 time to create 1 rle with old method : 0.08801484107971191 length of segment : 470 time for calcul the mask position with numpy : 0.0008287429809570312 nb_pixel_total : 35474 time to create 1 rle with old method : 0.03927135467529297 length of segment : 297 time for calcul the mask position with numpy : 0.0002532005310058594 nb_pixel_total : 7709 time to create 1 rle with old method : 0.009142160415649414 length of segment : 86 time for calcul the mask position with numpy : 0.0025415420532226562 nb_pixel_total : 105675 time to create 1 rle with old method : 0.11768817901611328 length of segment : 542 time for calcul the mask position with numpy : 0.0024449825286865234 nb_pixel_total : 112573 time to create 1 rle with old method : 0.12421512603759766 length of segment : 553 time for calcul the mask position with numpy : 0.003214120864868164 nb_pixel_total : 124701 time to create 1 rle with old method : 0.1391289234161377 length of segment : 559 time for calcul the mask position with numpy : 0.0003364086151123047 nb_pixel_total : 7191 time to create 1 rle with old method : 0.008381366729736328 length of segment : 119 time for calcul the mask position with numpy : 0.0026373863220214844 nb_pixel_total : 104671 time to create 1 rle with old method : 0.1159060001373291 length of segment : 520 time for calcul the mask position with numpy : 0.00019860267639160156 nb_pixel_total : 4106 time to create 1 rle with old method : 0.004836559295654297 length of segment : 60 time for calcul the mask position with numpy : 0.0002543926239013672 nb_pixel_total : 5053 time to create 1 rle with old method : 0.005682706832885742 length of segment : 123 time for calcul the mask position with numpy : 0.0005006790161132812 nb_pixel_total : 14597 time to create 1 rle with old method : 0.016289710998535156 length of segment : 214 time for calcul the mask position with numpy : 0.0003631114959716797 nb_pixel_total : 21154 time to create 1 rle with old method : 0.02324056625366211 length of segment : 173 time for calcul the mask position with numpy : 0.0007455348968505859 nb_pixel_total : 25451 time to create 1 rle with old method : 0.0283966064453125 length of segment : 157 time for calcul the mask position with numpy : 0.0001690387725830078 nb_pixel_total : 3804 time to create 1 rle with old method : 0.004362821578979492 length of segment : 64 time for calcul the mask position with numpy : 0.0023355484008789062 nb_pixel_total : 107351 time to create 1 rle with old method : 0.11761903762817383 length of segment : 532 time for calcul the mask position with numpy : 0.00031185150146484375 nb_pixel_total : 6270 time to create 1 rle with old method : 0.007559299468994141 length of segment : 125 time for calcul the mask position with numpy : 0.0003464221954345703 nb_pixel_total : 22011 time to create 1 rle with old method : 0.02509927749633789 length of segment : 166 time for calcul the mask position with numpy : 0.00024080276489257812 nb_pixel_total : 12916 time to create 1 rle with old method : 0.014626502990722656 length of segment : 176 time for calcul the mask position with numpy : 0.0022897720336914062 nb_pixel_total : 102037 time to create 1 rle with old method : 0.11935234069824219 length of segment : 508 time for calcul the mask position with numpy : 0.0005023479461669922 nb_pixel_total : 11332 time to create 1 rle with old method : 0.012988090515136719 length of segment : 144 time for calcul the mask position with numpy : 0.00025773048400878906 nb_pixel_total : 4753 time to create 1 rle with old method : 0.005791425704956055 length of segment : 129 time for calcul the mask position with numpy : 0.0040493011474609375 nb_pixel_total : 118940 time to create 1 rle with old method : 0.13283467292785645 length of segment : 543 time for calcul the mask position with numpy : 0.0009517669677734375 nb_pixel_total : 26335 time to create 1 rle with old method : 0.036269187927246094 length of segment : 301 time for calcul the mask position with numpy : 0.0003044605255126953 nb_pixel_total : 10703 time to create 1 rle with old method : 0.012729883193969727 length of segment : 121 time for calcul the mask position with numpy : 0.00012612342834472656 nb_pixel_total : 3652 time to create 1 rle with old method : 0.0044100284576416016 length of segment : 104 time for calcul the mask position with numpy : 0.00021457672119140625 nb_pixel_total : 4358 time to create 1 rle with old method : 0.0052073001861572266 length of segment : 120 time for calcul the mask position with numpy : 0.0002219676971435547 nb_pixel_total : 7974 time to create 1 rle with old method : 0.00939035415649414 length of segment : 126 time for calcul the mask position with numpy : 0.0002636909484863281 nb_pixel_total : 4842 time to create 1 rle with old method : 0.005732297897338867 length of segment : 132 time for calcul the mask position with numpy : 0.0003631114959716797 nb_pixel_total : 11887 time to create 1 rle with old method : 0.014243841171264648 length of segment : 136 time for calcul the mask position with numpy : 0.05999016761779785 nb_pixel_total : 1199979 time to create 1 rle with new method : 0.08109569549560547 length of segment : 1613 time for calcul the mask position with numpy : 0.0001659393310546875 nb_pixel_total : 6283 time to create 1 rle with old method : 0.007416725158691406 length of segment : 128 time for calcul the mask position with numpy : 0.0026726722717285156 nb_pixel_total : 109156 time to create 1 rle with old method : 0.11887764930725098 length of segment : 527 time for calcul the mask position with numpy : 0.0001926422119140625 nb_pixel_total : 5697 time to create 1 rle with old method : 0.006906270980834961 length of segment : 82 time for calcul the mask position with numpy : 0.0003333091735839844 nb_pixel_total : 10432 time to create 1 rle with old method : 0.012248992919921875 length of segment : 135 time for calcul the mask position with numpy : 0.0003292560577392578 nb_pixel_total : 8141 time to create 1 rle with old method : 0.009225606918334961 length of segment : 156 time for calcul the mask position with numpy : 0.0003039836883544922 nb_pixel_total : 6208 time to create 1 rle with old method : 0.007343292236328125 length of segment : 134 time for calcul the mask position with numpy : 0.0009298324584960938 nb_pixel_total : 33819 time to create 1 rle with old method : 0.03885531425476074 length of segment : 277 time for calcul the mask position with numpy : 0.0003178119659423828 nb_pixel_total : 6195 time to create 1 rle with old method : 0.007306575775146484 length of segment : 96 time for calcul the mask position with numpy : 0.00035309791564941406 nb_pixel_total : 10063 time to create 1 rle with old method : 0.011931896209716797 length of segment : 94 time for calcul the mask position with numpy : 0.0012204647064208984 nb_pixel_total : 24652 time to create 1 rle with old method : 0.028536319732666016 length of segment : 368 time for calcul the mask position with numpy : 0.0001811981201171875 nb_pixel_total : 3638 time to create 1 rle with old method : 0.004357099533081055 length of segment : 71 time for calcul the mask position with numpy : 0.00048804283142089844 nb_pixel_total : 17147 time to create 1 rle with old method : 0.019428014755249023 length of segment : 154 time for calcul the mask position with numpy : 0.00018167495727539062 nb_pixel_total : 4025 time to create 1 rle with old method : 0.0054779052734375 length of segment : 75 time for calcul the mask position with numpy : 0.0013687610626220703 nb_pixel_total : 55350 time to create 1 rle with old method : 0.06392168998718262 length of segment : 365 time for calcul the mask position with numpy : 0.002732515335083008 nb_pixel_total : 109434 time to create 1 rle with old method : 0.12321949005126953 length of segment : 541 time for calcul the mask position with numpy : 0.002461671829223633 nb_pixel_total : 112654 time to create 1 rle with old method : 0.12513256072998047 length of segment : 533 time for calcul the mask position with numpy : 0.00034618377685546875 nb_pixel_total : 13157 time to create 1 rle with old method : 0.015526533126831055 length of segment : 124 time for calcul the mask position with numpy : 0.0006146430969238281 nb_pixel_total : 21269 time to create 1 rle with old method : 0.023828744888305664 length of segment : 266 time for calcul the mask position with numpy : 0.0005321502685546875 nb_pixel_total : 18429 time to create 1 rle with old method : 0.020715951919555664 length of segment : 245 time for calcul the mask position with numpy : 0.00028586387634277344 nb_pixel_total : 10397 time to create 1 rle with old method : 0.012309789657592773 length of segment : 83 time for calcul the mask position with numpy : 0.0020711421966552734 nb_pixel_total : 106784 time to create 1 rle with old method : 0.11615753173828125 length of segment : 516 time for calcul the mask position with numpy : 0.033251285552978516 nb_pixel_total : 1407290 time to create 1 rle with new method : 0.08687067031860352 length of segment : 1455 time for calcul the mask position with numpy : 0.0018665790557861328 nb_pixel_total : 102251 time to create 1 rle with old method : 0.1149449348449707 length of segment : 531 time for calcul the mask position with numpy : 0.002022981643676758 nb_pixel_total : 106195 time to create 1 rle with old method : 0.1187281608581543 length of segment : 536 time for calcul the mask position with numpy : 0.0002162456512451172 nb_pixel_total : 4696 time to create 1 rle with old method : 0.005413055419921875 length of segment : 114 time spent for convertir_results : 6.883019685745239 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 72 chid ids of type : 3594 Number RLEs to save : 21261 save missing photos in datou_result : time spend for datou_step_exec : 43.46669316291809 time spend to save output : 1.284860610961914 total time spend for step 1 : 44.751553773880005 step2:crop_condition Tue Aug 12 15:01:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 37 ! batch 1 Loaded 72 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755003683_1062292 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1867926120758057 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755003686_1062292 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3754191398620605 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755003689_1062292 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.719480037689209 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 47 About to insert : list_path_to_insert length 47 new photo from crops ! About to upload 47 photos upload in portfolio : 3736932 init cache_photo without model_param we have 47 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755003710_1062292 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 47 photos in the portfolio 3736932 time of upload the photos Elapsed time : 15.060293912887573 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755003727_1062292 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.956294298171997 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1376607106, 1376607103, 1376607100, 1376606812, 1376606810, 1376606807, 1376606805, 1376606802, 1376606797, 1376606676, 1376606674, 1376606673, 1376606671, 1376606666, 1376606593, 1376606589, 1376606586, 1376606584, 1376606582, 1376606576, 1376603540, 1376603539, 1376603538, 1376603537, 1376603534, 1376603531, 1376603456, 1376603453, 1376603448, 1376603445, 1376603441, 1376603355, 1376603353, 1376603351, 1376603350, 1376603348, 1376603327] Looping around the photos to save general results len do output : 72 /1376620181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376620502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607106', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607103', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607100', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606812', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606810', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606807', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606805', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606802', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606797', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606676', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606674', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606673', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606671', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606666', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606593', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606589', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606586', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606584', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606582', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606576', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603540', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603539', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603538', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603537', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603534', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603531', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603456', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603453', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603448', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603445', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603441', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603355', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603353', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603351', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603350', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603348', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603327', None, None, None, None, None, '3512838') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 253 time used for this insertion : 0.03639411926269531 save_final save missing photos in datou_result : time spend for datou_step_exec : 47.55339813232422 time spend to save output : 0.039604902267456055 total time spend for step 2 : 47.593003034591675 step3:rle_unique_nms_with_priority Tue Aug 12 15:02:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 72 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.11778020858764648 time for calcul the mask position with numpy : 0.03302812576293945 nb_pixel_total : 1963113 time to create 1 rle with new method : 0.3045773506164551 time for calcul the mask position with numpy : 0.006708621978759766 nb_pixel_total : 100925 time to create 1 rle with old method : 0.1129143238067627 time for calcul the mask position with numpy : 0.006325721740722656 nb_pixel_total : 9562 time to create 1 rle with old method : 0.010867595672607422 create new chi : 0.4749107360839844 time to delete rle : 0.024694204330444336 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2346 TO DO : save crop sub photo not yet done ! save time : 0.16251397132873535 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.06664538383483887 time for calcul the mask position with numpy : 0.018758535385131836 nb_pixel_total : 1921253 time to create 1 rle with new method : 0.303469181060791 time for calcul the mask position with numpy : 0.006295442581176758 nb_pixel_total : 9463 time to create 1 rle with old method : 0.010787248611450195 time for calcul the mask position with numpy : 0.006493806838989258 nb_pixel_total : 5596 time to create 1 rle with old method : 0.006426572799682617 time for calcul the mask position with numpy : 0.0069234371185302734 nb_pixel_total : 115173 time to create 1 rle with old method : 0.12941431999206543 time for calcul the mask position with numpy : 0.006597757339477539 nb_pixel_total : 12427 time to create 1 rle with old method : 0.014154911041259766 time for calcul the mask position with numpy : 0.007295846939086914 nb_pixel_total : 9688 time to create 1 rle with old method : 0.010951519012451172 create new chi : 0.5386083126068115 time to delete rle : 0.0004911422729492188 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3060 TO DO : save crop sub photo not yet done ! save time : 0.21173858642578125 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.033049583435058594 time for calcul the mask position with numpy : 0.019696474075317383 nb_pixel_total : 2064799 time to create 1 rle with new method : 0.028829336166381836 time for calcul the mask position with numpy : 0.0063207149505615234 nb_pixel_total : 8801 time to create 1 rle with old method : 0.01003265380859375 create new chi : 0.06511163711547852 time to delete rle : 0.0002167224884033203 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1322 TO DO : save crop sub photo not yet done ! save time : 0.122833251953125 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04326176643371582 time for calcul the mask position with numpy : 0.018873929977416992 nb_pixel_total : 1936086 time to create 1 rle with new method : 0.0948483943939209 time for calcul the mask position with numpy : 0.0067958831787109375 nb_pixel_total : 29353 time to create 1 rle with old method : 0.0442657470703125 time for calcul the mask position with numpy : 0.0071027278900146484 nb_pixel_total : 108161 time to create 1 rle with old method : 0.1215507984161377 create new chi : 0.29395341873168945 time to delete rle : 0.0003561973571777344 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2432 TO DO : save crop sub photo not yet done ! save time : 0.18641972541809082 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.037564992904663086 time for calcul the mask position with numpy : 0.020525455474853516 nb_pixel_total : 1966592 time to create 1 rle with new method : 0.03158974647521973 time for calcul the mask position with numpy : 0.007744312286376953 nb_pixel_total : 107008 time to create 1 rle with old method : 0.12157249450683594 create new chi : 0.1818981170654297 time to delete rle : 0.0003829002380371094 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 2562 TO DO : save crop sub photo not yet done ! save time : 0.20532584190368652 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05638885498046875 time for calcul the mask position with numpy : 0.024582862854003906 nb_pixel_total : 2008015 time to create 1 rle with new method : 0.1719965934753418 time for calcul the mask position with numpy : 0.007050991058349609 nb_pixel_total : 2273 time to create 1 rle with old method : 0.0025839805603027344 time for calcul the mask position with numpy : 0.006122112274169922 nb_pixel_total : 27959 time to create 1 rle with old method : 0.03158760070800781 time for calcul the mask position with numpy : 0.006197690963745117 nb_pixel_total : 35353 time to create 1 rle with old method : 0.041139841079711914 create new chi : 0.2916297912597656 time to delete rle : 0.00039505958557128906 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2060 TO DO : save crop sub photo not yet done ! save time : 0.28229832649230957 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03453636169433594 time for calcul the mask position with numpy : 0.01944255828857422 nb_pixel_total : 1964129 time to create 1 rle with new method : 0.02869701385498047 time for calcul the mask position with numpy : 0.00656890869140625 nb_pixel_total : 109471 time to create 1 rle with old method : 0.1221163272857666 create new chi : 0.17717981338500977 time to delete rle : 0.0003135204315185547 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2128 TO DO : save crop sub photo not yet done ! save time : 0.17948579788208008 No data in photo_id : 1376606802 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03515434265136719 time for calcul the mask position with numpy : 0.01950216293334961 nb_pixel_total : 2022685 time to create 1 rle with new method : 0.030502796173095703 time for calcul the mask position with numpy : 0.0065593719482421875 nb_pixel_total : 50915 time to create 1 rle with old method : 0.057923078536987305 create new chi : 0.1148531436920166 time to delete rle : 0.0003299713134765625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2004 TO DO : save crop sub photo not yet done ! save time : 0.16660785675048828 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03391408920288086 time for calcul the mask position with numpy : 0.01953601837158203 nb_pixel_total : 2067917 time to create 1 rle with new method : 0.02893972396850586 time for calcul the mask position with numpy : 0.006073474884033203 nb_pixel_total : 5683 time to create 1 rle with old method : 0.006411552429199219 create new chi : 0.06117534637451172 time to delete rle : 0.0002624988555908203 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1290 TO DO : save crop sub photo not yet done ! save time : 0.11376786231994629 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04055476188659668 time for calcul the mask position with numpy : 0.01878499984741211 nb_pixel_total : 1959628 time to create 1 rle with new method : 0.029614686965942383 time for calcul the mask position with numpy : 0.0063762664794921875 nb_pixel_total : 35474 time to create 1 rle with old method : 0.04005622863769531 time for calcul the mask position with numpy : 0.0065762996673583984 nb_pixel_total : 78498 time to create 1 rle with old method : 0.08871912956237793 create new chi : 0.1905381679534912 time to delete rle : 0.000392913818359375 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2614 TO DO : save crop sub photo not yet done ! save time : 0.20260095596313477 No data in photo_id : 1376606673 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03333449363708496 time for calcul the mask position with numpy : 0.020461320877075195 nb_pixel_total : 2065891 time to create 1 rle with new method : 0.028718233108520508 time for calcul the mask position with numpy : 0.00623321533203125 nb_pixel_total : 7709 time to create 1 rle with old method : 0.008855342864990234 create new chi : 0.06447577476501465 time to delete rle : 0.00025200843811035156 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1252 TO DO : save crop sub photo not yet done ! save time : 0.12646150588989258 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03888654708862305 time for calcul the mask position with numpy : 0.020015478134155273 nb_pixel_total : 1967925 time to create 1 rle with new method : 0.030417919158935547 time for calcul the mask position with numpy : 0.00697016716003418 nb_pixel_total : 105675 time to create 1 rle with old method : 0.1210174560546875 create new chi : 0.17880582809448242 time to delete rle : 0.0003910064697265625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2164 TO DO : save crop sub photo not yet done ! save time : 0.16449403762817383 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03650355339050293 time for calcul the mask position with numpy : 0.020750999450683594 nb_pixel_total : 1961027 time to create 1 rle with new method : 0.03152942657470703 time for calcul the mask position with numpy : 0.007016181945800781 nb_pixel_total : 112573 time to create 1 rle with old method : 0.12563514709472656 create new chi : 0.18532156944274902 time to delete rle : 0.00039649009704589844 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2186 TO DO : save crop sub photo not yet done ! save time : 0.17712116241455078 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03512907028198242 time for calcul the mask position with numpy : 0.02097797393798828 nb_pixel_total : 1948899 time to create 1 rle with new method : 0.03013443946838379 time for calcul the mask position with numpy : 0.006890296936035156 nb_pixel_total : 124701 time to create 1 rle with old method : 0.16581249237060547 create new chi : 0.22419142723083496 time to delete rle : 0.00037550926208496094 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2198 TO DO : save crop sub photo not yet done ! save time : 0.1738576889038086 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.06617021560668945 time for calcul the mask position with numpy : 0.021192550659179688 nb_pixel_total : 1952579 time to create 1 rle with new method : 0.24859333038330078 time for calcul the mask position with numpy : 0.00643467903137207 nb_pixel_total : 5053 time to create 1 rle with old method : 0.005748271942138672 time for calcul the mask position with numpy : 0.0069446563720703125 nb_pixel_total : 4106 time to create 1 rle with old method : 0.004484891891479492 time for calcul the mask position with numpy : 0.0066111087799072266 nb_pixel_total : 104671 time to create 1 rle with old method : 0.11652898788452148 time for calcul the mask position with numpy : 0.006194114685058594 nb_pixel_total : 7191 time to create 1 rle with old method : 0.008455276489257812 create new chi : 0.4423987865447998 time to delete rle : 0.0003578662872314453 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2724 TO DO : save crop sub photo not yet done ! save time : 0.23291587829589844 No data in photo_id : 1376606584 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05349993705749512 time for calcul the mask position with numpy : 0.019657135009765625 nb_pixel_total : 2012398 time to create 1 rle with new method : 0.09638404846191406 time for calcul the mask position with numpy : 0.006167888641357422 nb_pixel_total : 25451 time to create 1 rle with old method : 0.028603315353393555 time for calcul the mask position with numpy : 0.006021261215209961 nb_pixel_total : 21154 time to create 1 rle with old method : 0.023619413375854492 time for calcul the mask position with numpy : 0.006238698959350586 nb_pixel_total : 14597 time to create 1 rle with old method : 0.01649022102355957 create new chi : 0.20360136032104492 time to delete rle : 0.0003650188446044922 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2168 TO DO : save crop sub photo not yet done ! save time : 0.1782090663909912 No data in photo_id : 1376606576 No data in photo_id : 1376603540 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.039048194885253906 time for calcul the mask position with numpy : 0.01800823211669922 nb_pixel_total : 1962445 time to create 1 rle with new method : 0.02891063690185547 time for calcul the mask position with numpy : 0.006506443023681641 nb_pixel_total : 107351 time to create 1 rle with old method : 0.11740875244140625 time for calcul the mask position with numpy : 0.006362438201904297 nb_pixel_total : 3804 time to create 1 rle with old method : 0.0043756961822509766 create new chi : 0.18192553520202637 time to delete rle : 0.00043463706970214844 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2272 TO DO : save crop sub photo not yet done ! save time : 0.17919206619262695 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.032525062561035156 time for calcul the mask position with numpy : 0.01956486701965332 nb_pixel_total : 2067330 time to create 1 rle with new method : 0.02768874168395996 time for calcul the mask position with numpy : 0.005902290344238281 nb_pixel_total : 6270 time to create 1 rle with old method : 0.0070343017578125 create new chi : 0.060408592224121094 time to delete rle : 0.0002181529998779297 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1330 TO DO : save crop sub photo not yet done ! save time : 0.12208867073059082 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.041699886322021484 time for calcul the mask position with numpy : 0.018489599227905273 nb_pixel_total : 2038673 time to create 1 rle with new method : 0.027686357498168945 time for calcul the mask position with numpy : 0.006531715393066406 nb_pixel_total : 12916 time to create 1 rle with old method : 0.0145111083984375 time for calcul the mask position with numpy : 0.006022214889526367 nb_pixel_total : 22011 time to create 1 rle with old method : 0.02425670623779297 create new chi : 0.09776926040649414 time to delete rle : 0.0003046989440917969 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1764 TO DO : save crop sub photo not yet done ! save time : 0.1500411033630371 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.0498659610748291 time for calcul the mask position with numpy : 0.018087148666381836 nb_pixel_total : 1955478 time to create 1 rle with new method : 0.05857491493225098 time for calcul the mask position with numpy : 0.005883455276489258 nb_pixel_total : 4753 time to create 1 rle with old method : 0.005394458770751953 time for calcul the mask position with numpy : 0.00589752197265625 nb_pixel_total : 11332 time to create 1 rle with old method : 0.012486934661865234 time for calcul the mask position with numpy : 0.006426095962524414 nb_pixel_total : 102037 time to create 1 rle with old method : 0.11080121994018555 create new chi : 0.23119354248046875 time to delete rle : 0.0004105567932128906 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2642 TO DO : save crop sub photo not yet done ! save time : 0.19283342361450195 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.26569199562072754 time for calcul the mask position with numpy : 0.12003231048583984 nb_pixel_total : 1901638 time to create 1 rle with new method : 0.10948848724365234 time for calcul the mask position with numpy : 0.00615692138671875 nb_pixel_total : 7974 time to create 1 rle with old method : 0.009107112884521484 time for calcul the mask position with numpy : 0.006178855895996094 nb_pixel_total : 4358 time to create 1 rle with old method : 0.00467681884765625 time for calcul the mask position with numpy : 0.006076335906982422 nb_pixel_total : 3652 time to create 1 rle with old method : 0.004421234130859375 time for calcul the mask position with numpy : 0.006158351898193359 nb_pixel_total : 10703 time to create 1 rle with old method : 0.011922836303710938 time for calcul the mask position with numpy : 0.0061872005462646484 nb_pixel_total : 26335 time to create 1 rle with old method : 0.02876567840576172 time for calcul the mask position with numpy : 0.006585121154785156 nb_pixel_total : 118940 time to create 1 rle with old method : 0.130692720413208 create new chi : 0.46760082244873047 time to delete rle : 0.0005972385406494141 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3710 TO DO : save crop sub photo not yet done ! save time : 0.2681593894958496 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.061765432357788086 time for calcul the mask position with numpy : 0.011281251907348633 nb_pixel_total : 853910 time to create 1 rle with new method : 0.13798093795776367 time for calcul the mask position with numpy : 0.006262779235839844 nb_pixel_total : 6283 time to create 1 rle with old method : 0.006935596466064453 time for calcul the mask position with numpy : 0.013608455657958984 nb_pixel_total : 1196678 time to create 1 rle with new method : 0.03000950813293457 time for calcul the mask position with numpy : 0.006556034088134766 nb_pixel_total : 11887 time to create 1 rle with old method : 0.0130767822265625 time for calcul the mask position with numpy : 0.006028652191162109 nb_pixel_total : 4842 time to create 1 rle with old method : 0.005265235900878906 create new chi : 0.23778796195983887 time to delete rle : 0.0008401870727539062 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 5065 TO DO : save crop sub photo not yet done ! save time : 0.3262057304382324 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06816434860229492 time for calcul the mask position with numpy : 0.01824474334716797 nb_pixel_total : 1948315 time to create 1 rle with new method : 0.8187966346740723 time for calcul the mask position with numpy : 0.005835533142089844 nb_pixel_total : 10432 time to create 1 rle with old method : 0.010912656784057617 time for calcul the mask position with numpy : 0.005850076675415039 nb_pixel_total : 5697 time to create 1 rle with old method : 0.006155490875244141 time for calcul the mask position with numpy : 0.010729312896728516 nb_pixel_total : 109156 time to create 1 rle with old method : 0.11720395088195801 create new chi : 1.0010392665863037 time to delete rle : 0.00045228004455566406 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2568 TO DO : save crop sub photo not yet done ! save time : 0.20437240600585938 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.31809020042419434 time for calcul the mask position with numpy : 0.07367110252380371 nb_pixel_total : 1984522 time to create 1 rle with new method : 0.23024415969848633 time for calcul the mask position with numpy : 0.006285905838012695 nb_pixel_total : 24652 time to create 1 rle with old method : 0.026720523834228516 time for calcul the mask position with numpy : 0.005847930908203125 nb_pixel_total : 10063 time to create 1 rle with old method : 0.011069059371948242 time for calcul the mask position with numpy : 0.006288051605224609 nb_pixel_total : 6195 time to create 1 rle with old method : 0.008066654205322266 time for calcul the mask position with numpy : 0.0061130523681640625 nb_pixel_total : 33819 time to create 1 rle with old method : 0.038649797439575195 time for calcul the mask position with numpy : 0.0060100555419921875 nb_pixel_total : 6208 time to create 1 rle with old method : 0.0065155029296875 time for calcul the mask position with numpy : 0.005773305892944336 nb_pixel_total : 8141 time to create 1 rle with old method : 0.009048223495483398 create new chi : 0.45114779472351074 time to delete rle : 0.0005934238433837891 batch 1 Loaded 13 chid ids of type : 3594 ++++++++++Number RLEs to save : 3330 TO DO : save crop sub photo not yet done ! save time : 0.2803778648376465 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.03951096534729004 time for calcul the mask position with numpy : 0.018874645233154297 nb_pixel_total : 2052815 time to create 1 rle with new method : 0.058480262756347656 time for calcul the mask position with numpy : 0.006847381591796875 nb_pixel_total : 17147 time to create 1 rle with old method : 0.019335269927978516 time for calcul the mask position with numpy : 0.006378173828125 nb_pixel_total : 3638 time to create 1 rle with old method : 0.004208803176879883 create new chi : 0.11441922187805176 time to delete rle : 0.0003294944763183594 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1530 TO DO : save crop sub photo not yet done ! save time : 0.15107297897338867 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.052745819091796875 time for calcul the mask position with numpy : 0.02047562599182129 nb_pixel_total : 1904791 time to create 1 rle with new method : 0.23621106147766113 time for calcul the mask position with numpy : 0.0068624019622802734 nb_pixel_total : 109434 time to create 1 rle with old method : 0.12283182144165039 time for calcul the mask position with numpy : 0.006700754165649414 nb_pixel_total : 55350 time to create 1 rle with old method : 0.062233924865722656 time for calcul the mask position with numpy : 0.006093025207519531 nb_pixel_total : 4025 time to create 1 rle with old method : 0.004712581634521484 create new chi : 0.4738273620605469 time to delete rle : 0.0005657672882080078 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 3042 TO DO : save crop sub photo not yet done ! save time : 0.2401409149169922 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.042876243591308594 time for calcul the mask position with numpy : 0.01934647560119629 nb_pixel_total : 1947789 time to create 1 rle with new method : 0.10223841667175293 time for calcul the mask position with numpy : 0.005833864212036133 nb_pixel_total : 13157 time to create 1 rle with old method : 0.016423940658569336 time for calcul the mask position with numpy : 0.006797313690185547 nb_pixel_total : 112654 time to create 1 rle with old method : 0.13040876388549805 create new chi : 0.28142404556274414 time to delete rle : 0.00038242340087890625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2394 TO DO : save crop sub photo not yet done ! save time : 0.19099974632263184 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.0444183349609375 time for calcul the mask position with numpy : 0.020998001098632812 nb_pixel_total : 2033902 time to create 1 rle with new method : 0.030534029006958008 time for calcul the mask position with numpy : 0.006474018096923828 nb_pixel_total : 18429 time to create 1 rle with old method : 0.02153754234313965 time for calcul the mask position with numpy : 0.006559133529663086 nb_pixel_total : 21269 time to create 1 rle with old method : 0.025851964950561523 create new chi : 0.11247730255126953 time to delete rle : 0.00040602684020996094 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2102 TO DO : save crop sub photo not yet done ! save time : 0.17359542846679688 No data in photo_id : 1376603351 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.08270859718322754 time for calcul the mask position with numpy : 0.010318994522094727 nb_pixel_total : 549953 time to create 1 rle with new method : 0.032587289810180664 time for calcul the mask position with numpy : 0.017571210861206055 nb_pixel_total : 1406466 time to create 1 rle with new method : 0.030658245086669922 time for calcul the mask position with numpy : 0.007084369659423828 nb_pixel_total : 106784 time to create 1 rle with old method : 0.12276506423950195 time for calcul the mask position with numpy : 0.006674051284790039 nb_pixel_total : 10397 time to create 1 rle with old method : 0.011855840682983398 create new chi : 0.24031591415405273 time to delete rle : 0.0008749961853027344 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 5104 TO DO : save crop sub photo not yet done ! save time : 0.36334729194641113 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03494977951049805 time for calcul the mask position with numpy : 0.02577972412109375 nb_pixel_total : 1971349 time to create 1 rle with new method : 0.030324935913085938 time for calcul the mask position with numpy : 0.007155418395996094 nb_pixel_total : 102251 time to create 1 rle with old method : 0.11464548110961914 create new chi : 0.1782982349395752 time to delete rle : 0.0003764629364013672 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 2142 TO DO : save crop sub photo not yet done ! save time : 0.1900923252105713 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.045148372650146484 time for calcul the mask position with numpy : 0.02100229263305664 nb_pixel_total : 1962709 time to create 1 rle with new method : 0.03597450256347656 time for calcul the mask position with numpy : 0.006892204284667969 nb_pixel_total : 4696 time to create 1 rle with old method : 0.0074498653411865234 time for calcul the mask position with numpy : 0.007568836212158203 nb_pixel_total : 106195 time to create 1 rle with old method : 0.17158031463623047 create new chi : 0.251007080078125 time to delete rle : 0.00045943260192871094 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2380 TO DO : save crop sub photo not yet done ! save time : 0.19091558456420898 map_output_result : {1376607106: (0.0, 'Should be the crop_list due to order', 0), 1376607103: (0.0, 'Should be the crop_list due to order', 0), 1376607100: (0.0, 'Should be the crop_list due to order', 0), 1376606812: (0.0, 'Should be the crop_list due to order', 0), 1376606810: (0.0, 'Should be the crop_list due to order', 0), 1376606807: (0.0, 'Should be the crop_list due to order', 0), 1376606805: (0.0, 'Should be the crop_list due to order', 0), 1376606802: (0.0, 'Should be the crop_list due to order', 0.0), 1376606797: (0.0, 'Should be the crop_list due to order', 0), 1376606676: (0.0, 'Should be the crop_list due to order', 0), 1376606674: (0.0, 'Should be the crop_list due to order', 0), 1376606673: (0.0, 'Should be the crop_list due to order', 0.0), 1376606671: (0.0, 'Should be the crop_list due to order', 0), 1376606666: (0.0, 'Should be the crop_list due to order', 0), 1376606593: (0.0, 'Should be the crop_list due to order', 0), 1376606589: (0.0, 'Should be the crop_list due to order', 0), 1376606586: (0.0, 'Should be the crop_list due to order', 0), 1376606584: (0.0, 'Should be the crop_list due to order', 0.0), 1376606582: (0.0, 'Should be the crop_list due to order', 0), 1376606576: (0.0, 'Should be the crop_list due to order', 0.0), 1376603540: (0.0, 'Should be the crop_list due to order', 0.0), 1376603539: (0.0, 'Should be the crop_list due to order', 0), 1376603538: (0.0, 'Should be the crop_list due to order', 0), 1376603537: (0.0, 'Should be the crop_list due to order', 0), 1376603534: (0.0, 'Should be the crop_list due to order', 0), 1376603531: (0.0, 'Should be the crop_list due to order', 0), 1376603456: (0.0, 'Should be the crop_list due to order', 0), 1376603453: (0.0, 'Should be the crop_list due to order', 0), 1376603448: (0.0, 'Should be the crop_list due to order', 0), 1376603445: (0.0, 'Should be the crop_list due to order', 0), 1376603441: (0.0, 'Should be the crop_list due to order', 0), 1376603355: (0.0, 'Should be the crop_list due to order', 0), 1376603353: (0.0, 'Should be the crop_list due to order', 0), 1376603351: (0.0, 'Should be the crop_list due to order', 0.0), 1376603350: (0.0, 'Should be the crop_list due to order', 0), 1376603348: (0.0, 'Should be the crop_list due to order', 0), 1376603327: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1376607106, 1376607103, 1376607100, 1376606812, 1376606810, 1376606807, 1376606805, 1376606802, 1376606797, 1376606676, 1376606674, 1376606673, 1376606671, 1376606666, 1376606593, 1376606589, 1376606586, 1376606584, 1376606582, 1376606576, 1376603540, 1376603539, 1376603538, 1376603537, 1376603534, 1376603531, 1376603456, 1376603453, 1376603448, 1376603445, 1376603441, 1376603355, 1376603353, 1376603351, 1376603350, 1376603348, 1376603327] Looping around the photos to save general results len do output : 37 /1376607106.Didn't retrieve data . /1376607103.Didn't retrieve data . /1376607100.Didn't retrieve data . /1376606812.Didn't retrieve data . /1376606810.Didn't retrieve data . /1376606807.Didn't retrieve data . /1376606805.Didn't retrieve data . /1376606802.Didn't retrieve data . /1376606797.Didn't retrieve data . /1376606676.Didn't retrieve data . /1376606674.Didn't retrieve data . /1376606673.Didn't retrieve data . /1376606671.Didn't retrieve data . /1376606666.Didn't retrieve data . /1376606593.Didn't retrieve data . /1376606589.Didn't retrieve data . /1376606586.Didn't retrieve data . /1376606584.Didn't retrieve data . /1376606582.Didn't retrieve data . /1376606576.Didn't retrieve data . /1376603540.Didn't retrieve data . /1376603539.Didn't retrieve data . /1376603538.Didn't retrieve data . /1376603537.Didn't retrieve data . /1376603534.Didn't retrieve data . /1376603531.Didn't retrieve data . /1376603456.Didn't retrieve data . /1376603453.Didn't retrieve data . /1376603448.Didn't retrieve data . /1376603445.Didn't retrieve data . /1376603441.Didn't retrieve data . /1376603355.Didn't retrieve data . /1376603353.Didn't retrieve data . /1376603351.Didn't retrieve data . /1376603350.Didn't retrieve data . /1376603348.Didn't retrieve data . /1376603327.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607106', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607103', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607100', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606812', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606810', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606807', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606805', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606802', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606797', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606676', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606674', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606673', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606671', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606666', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606593', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606589', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606586', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606584', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606582', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606576', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603540', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603539', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603538', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603537', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603534', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603531', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603456', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603453', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603448', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603445', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603441', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603355', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603353', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603351', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603350', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603348', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603327', None, None, None, None, None, '3512838') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 111 time used for this insertion : 0.017403125762939453 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.099982500076294 time spend to save output : 0.01878523826599121 total time spend for step 3 : 17.118767738342285 step4:ventilate_hashtags_in_portfolio Tue Aug 12 15:02:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25915172 get user id for portfolio 25915172 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915172 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','pehd','flou','carton','autre','environnement','papier','pet_clair','mal_croppe','metal','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915172 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','pehd','flou','carton','autre','environnement','papier','pet_clair','mal_croppe','metal','background')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915172 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','pehd','flou','carton','autre','environnement','papier','pet_clair','mal_croppe','metal','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25916077,25916078,25916079,25916080,25916081,25916082,25916083,25916084,25916085,25916086,25916087?tags=pet_fonce,pehd,flou,carton,autre,environnement,papier,pet_clair,mal_croppe,metal,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1376607106, 1376607103, 1376607100, 1376606812, 1376606810, 1376606807, 1376606805, 1376606802, 1376606797, 1376606676, 1376606674, 1376606673, 1376606671, 1376606666, 1376606593, 1376606589, 1376606586, 1376606584, 1376606582, 1376606576, 1376603540, 1376603539, 1376603538, 1376603537, 1376603534, 1376603531, 1376603456, 1376603453, 1376603448, 1376603445, 1376603441, 1376603355, 1376603353, 1376603351, 1376603350, 1376603348, 1376603327] Looping around the photos to save general results len do output : 1 /25915172. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607106', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607103', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607100', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606812', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606810', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606807', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606805', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606802', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606797', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606676', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606674', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606673', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606671', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606666', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606593', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606589', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606586', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606584', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606582', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606576', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603540', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603539', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603538', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603537', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603534', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603531', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603456', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603453', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603448', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603445', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603441', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603355', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603353', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603351', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603350', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603348', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603327', None, None, None, None, None, '3512838') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 38 time used for this insertion : 0.02199697494506836 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.685736894607544 time spend to save output : 0.022403955459594727 total time spend for step 4 : 0.7081408500671387 step5:final Tue Aug 12 15:02:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1376607106: ('0.0699012163204872',), 1376607103: ('0.0699012163204872',), 1376607100: ('0.0699012163204872',), 1376606812: ('0.0699012163204872',), 1376606810: ('0.0699012163204872',), 1376606807: ('0.0699012163204872',), 1376606805: ('0.0699012163204872',), 1376606802: ('0.0699012163204872',), 1376606797: ('0.0699012163204872',), 1376606676: ('0.0699012163204872',), 1376606674: ('0.0699012163204872',), 1376606673: ('0.0699012163204872',), 1376606671: ('0.0699012163204872',), 1376606666: ('0.0699012163204872',), 1376606593: ('0.0699012163204872',), 1376606589: ('0.0699012163204872',), 1376606586: ('0.0699012163204872',), 1376606584: ('0.0699012163204872',), 1376606582: ('0.0699012163204872',), 1376606576: ('0.0699012163204872',), 1376603540: ('0.0699012163204872',), 1376603539: ('0.0699012163204872',), 1376603538: ('0.0699012163204872',), 1376603537: ('0.0699012163204872',), 1376603534: ('0.0699012163204872',), 1376603531: ('0.0699012163204872',), 1376603456: ('0.0699012163204872',), 1376603453: ('0.0699012163204872',), 1376603448: ('0.0699012163204872',), 1376603445: ('0.0699012163204872',), 1376603441: ('0.0699012163204872',), 1376603355: ('0.0699012163204872',), 1376603353: ('0.0699012163204872',), 1376603351: ('0.0699012163204872',), 1376603350: ('0.0699012163204872',), 1376603348: ('0.0699012163204872',), 1376603327: ('0.0699012163204872',)} new output for save of step final : {1376607106: ('0.0699012163204872',), 1376607103: ('0.0699012163204872',), 1376607100: ('0.0699012163204872',), 1376606812: ('0.0699012163204872',), 1376606810: ('0.0699012163204872',), 1376606807: ('0.0699012163204872',), 1376606805: ('0.0699012163204872',), 1376606802: ('0.0699012163204872',), 1376606797: ('0.0699012163204872',), 1376606676: ('0.0699012163204872',), 1376606674: ('0.0699012163204872',), 1376606673: ('0.0699012163204872',), 1376606671: ('0.0699012163204872',), 1376606666: ('0.0699012163204872',), 1376606593: ('0.0699012163204872',), 1376606589: ('0.0699012163204872',), 1376606586: ('0.0699012163204872',), 1376606584: ('0.0699012163204872',), 1376606582: ('0.0699012163204872',), 1376606576: ('0.0699012163204872',), 1376603540: ('0.0699012163204872',), 1376603539: ('0.0699012163204872',), 1376603538: ('0.0699012163204872',), 1376603537: ('0.0699012163204872',), 1376603534: ('0.0699012163204872',), 1376603531: ('0.0699012163204872',), 1376603456: ('0.0699012163204872',), 1376603453: ('0.0699012163204872',), 1376603448: ('0.0699012163204872',), 1376603445: ('0.0699012163204872',), 1376603441: ('0.0699012163204872',), 1376603355: ('0.0699012163204872',), 1376603353: ('0.0699012163204872',), 1376603351: ('0.0699012163204872',), 1376603350: ('0.0699012163204872',), 1376603348: ('0.0699012163204872',), 1376603327: ('0.0699012163204872',)} [1376607106, 1376607103, 1376607100, 1376606812, 1376606810, 1376606807, 1376606805, 1376606802, 1376606797, 1376606676, 1376606674, 1376606673, 1376606671, 1376606666, 1376606593, 1376606589, 1376606586, 1376606584, 1376606582, 1376606576, 1376603540, 1376603539, 1376603538, 1376603537, 1376603534, 1376603531, 1376603456, 1376603453, 1376603448, 1376603445, 1376603441, 1376603355, 1376603353, 1376603351, 1376603350, 1376603348, 1376603327] Looping around the photos to save general results len do output : 37 /1376607106.Didn't retrieve data . /1376607103.Didn't retrieve data . /1376607100.Didn't retrieve data . /1376606812.Didn't retrieve data . /1376606810.Didn't retrieve data . /1376606807.Didn't retrieve data . /1376606805.Didn't retrieve data . /1376606802.Didn't retrieve data . /1376606797.Didn't retrieve data . /1376606676.Didn't retrieve data . /1376606674.Didn't retrieve data . /1376606673.Didn't retrieve data . /1376606671.Didn't retrieve data . /1376606666.Didn't retrieve data . /1376606593.Didn't retrieve data . /1376606589.Didn't retrieve data . /1376606586.Didn't retrieve data . /1376606584.Didn't retrieve data . /1376606582.Didn't retrieve data . /1376606576.Didn't retrieve data . /1376603540.Didn't retrieve data . /1376603539.Didn't retrieve data . /1376603538.Didn't retrieve data . /1376603537.Didn't retrieve data . /1376603534.Didn't retrieve data . /1376603531.Didn't retrieve data . /1376603456.Didn't retrieve data . /1376603453.Didn't retrieve data . /1376603448.Didn't retrieve data . /1376603445.Didn't retrieve data . /1376603441.Didn't retrieve data . /1376603355.Didn't retrieve data . /1376603353.Didn't retrieve data . /1376603351.Didn't retrieve data . /1376603350.Didn't retrieve data . /1376603348.Didn't retrieve data . /1376603327.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607106', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607103', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607100', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606812', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606810', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606807', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606805', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606802', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606797', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606676', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606674', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606673', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606671', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606666', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606593', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606589', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606586', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606584', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606582', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606576', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603540', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603539', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603538', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603537', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603534', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603531', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603456', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603453', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603448', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603445', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603441', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603355', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603353', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603351', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603350', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603348', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603327', None, None, None, None, None, '3512838') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 111 time used for this insertion : 0.019817352294921875 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1287229061126709 time spend to save output : 0.02135014533996582 total time spend for step 5 : 0.15007305145263672 step6:blur_detection Tue Aug 12 15:02:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1755003627_1062292_1376607106_106d9a199298301a4913d0b0ab551d4f.jpg resize: (1080, 1920) 1376607106 1.6756328596411427 treat image : temp/1755003627_1062292_1376607103_06060a316142c82dc3e8309397420306.jpg resize: (1080, 1920) 1376607103 0.3506540363824218 treat image : temp/1755003627_1062292_1376607100_35ae8cfeca05075096536e896034ba88.jpg resize: (1080, 1920) 1376607100 -2.304117338621696 treat image : temp/1755003627_1062292_1376606812_6d9887cc2d586c6e0f1e47291d5acaa5.jpg resize: (1080, 1920) 1376606812 -2.5036029320135924 treat image : temp/1755003627_1062292_1376606810_2bf52a6c4dd5465a93cbbd1ead1c577f.jpg resize: (1080, 1920) 1376606810 -2.2792916628241997 treat image : temp/1755003627_1062292_1376606807_02b3556937785beedba677e59eb6c3b4.jpg resize: (1080, 1920) 1376606807 -1.2681854918916757 treat image : temp/1755003627_1062292_1376606805_1c9adda14929ca7e5d88d076aa4523cd.jpg resize: (1080, 1920) 1376606805 -2.2186467579221394 treat image : temp/1755003627_1062292_1376606802_f15b6a5ae58153eedc3779d7039710a3.jpg resize: (1080, 1920) 1376606802 -2.110035369319159 treat image : temp/1755003627_1062292_1376606797_110dcf7a02d23e6dc6e39b8f94fa3a18.jpg resize: (1080, 1920) 1376606797 -2.410539235219464 treat image : temp/1755003627_1062292_1376606676_26076964c9fdc63411fe2a5c53f1b74c.jpg resize: (1080, 1920) 1376606676 -1.4222715018806336 treat image : temp/1755003627_1062292_1376606674_151fc625c461d4ca5f064c3cdce0908a.jpg resize: (1080, 1920) 1376606674 -2.5574172463401763 treat image : temp/1755003627_1062292_1376606673_6187e978350a8befa04f8a1a9cc39f90.jpg resize: (1080, 1920) 1376606673 0.6187605599018794 treat image : temp/1755003627_1062292_1376606671_5e2fb1db566932f9491dd3939265372b.jpg resize: (1080, 1920) 1376606671 -0.7070600577807016 treat image : temp/1755003627_1062292_1376606666_897b21427c5e6b65dc3d4e0a37b2ca32.jpg resize: (1080, 1920) 1376606666 -4.057421413303308 treat image : temp/1755003627_1062292_1376606593_5505c2e57612fcb969525f60b4a8089e.jpg resize: (1080, 1920) 1376606593 0.9156255215407406 treat image : temp/1755003627_1062292_1376606589_1eae65a5b6f74edd6c1b7b740e0aec28.jpg resize: (1080, 1920) 1376606589 -2.069154346289819 treat image : temp/1755003627_1062292_1376606586_dea9577bc18c624519d214ead6c3a03b.jpg resize: (1080, 1920) 1376606586 -1.597245890204201 treat image : temp/1755003627_1062292_1376606584_e0707bd05962419b37584c597f36c1e6.jpg resize: (1080, 1920) 1376606584 -2.4798315416548675 treat image : temp/1755003627_1062292_1376606582_fee5dd8e250f202b7977a812bc3635ae.jpg resize: (1080, 1920) 1376606582 -0.5650939506509688 treat image : temp/1755003627_1062292_1376606576_ec51dda9e96c4b882aefa12d6af2f811.jpg resize: (1080, 1920) 1376606576 -2.1870517963414757 treat image : temp/1755003627_1062292_1376603540_d43431388a4656940c8ecd4d10367174.jpg resize: (1080, 1920) 1376603540 -2.6333390407668564 treat image : temp/1755003627_1062292_1376603539_0d9ce7ee0471a94a8d880249096bf8ad.jpg resize: (1080, 1920) 1376603539 -2.4040008326496314 treat image : temp/1755003627_1062292_1376603538_8e9c112fe93ddda30b8faf326492fd5c.jpg resize: (1080, 1920) 1376603538 -2.811380955848009 treat image : temp/1755003627_1062292_1376603537_0cec8f0ba76be1ad2d919357171eb233.jpg resize: (1080, 1920) 1376603537 -2.503163434908198 treat image : temp/1755003627_1062292_1376603534_8246a32d2789a6265bcd59ea7f732666.jpg resize: (1080, 1920) 1376603534 -2.568015124323713 treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3.jpg resize: (1080, 1920) 1376603531 -2.717528349491422 treat image : temp/1755003627_1062292_1376603456_a73c84918bfc11decfa922d7d6b06300.jpg resize: (1080, 1920) 1376603456 -1.7691080962403225 treat image : temp/1755003627_1062292_1376603453_593cc30dc7892b77856311a5774e9ffb.jpg resize: (1080, 1920) 1376603453 -4.472225003001496 treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26.jpg resize: (1080, 1920) 1376603448 -2.1657313814187136 treat image : temp/1755003627_1062292_1376603445_6c3b7ee8fc527fadfd98de666235ca4d.jpg resize: (1080, 1920) 1376603445 -2.7929938999758077 treat image : temp/1755003627_1062292_1376603441_6558336625dacd9334e0df6e36f5bdd7.jpg resize: (1080, 1920) 1376603441 -0.6258065113935203 treat image : temp/1755003627_1062292_1376603355_588851376997f0df5d7c6a816b8d8f6e.jpg resize: (1080, 1920) 1376603355 -2.99633201833263 treat image : temp/1755003627_1062292_1376603353_0cd2367cb09f4d99c18c1da1e18c70ee.jpg resize: (1080, 1920) 1376603353 -2.5094155419775883 treat image : temp/1755003627_1062292_1376603351_3ddbca009636a37b60aa71c293c64294.jpg resize: (1080, 1920) 1376603351 -1.929393427532553 treat image : temp/1755003627_1062292_1376603350_d6cbde0441cb8d04dc8d238b5a77cfcb.jpg resize: (1080, 1920) 1376603350 -1.8269104424349096 treat image : temp/1755003627_1062292_1376603348_826fe1f2af91d20e49e25b07f7b8b2df.jpg resize: (1080, 1920) 1376603348 -2.9932330532744342 treat image : temp/1755003627_1062292_1376603327_831312b56a5207615b62ad9c62900606.jpg resize: (1080, 1920) 1376603327 -0.9796413218647424 treat image : temp/1755003627_1062292_1376606586_dea9577bc18c624519d214ead6c3a03b_rle_crop_3912151557_0.png resize: (118, 104) 1376620181 -1.5100633037794267 treat image : temp/1755003627_1062292_1376606586_dea9577bc18c624519d214ead6c3a03b_rle_crop_3912151559_0.png resize: (58, 94) 1376620183 -2.348409872639586 treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3_rle_crop_3912151577_0.png resize: (126, 77) 1376620184 0.5635350884851621 treat image : temp/1755003627_1062292_1376603355_588851376997f0df5d7c6a816b8d8f6e_rle_crop_3912151597_0.png resize: (111, 173) 1376620185 -1.333450652442422 treat image : temp/1755003627_1062292_1376607106_106d9a199298301a4913d0b0ab551d4f_rle_crop_3912151535_0.png resize: (509, 351) 1376620187 0.39662977176922126 treat image : temp/1755003627_1062292_1376607103_06060a316142c82dc3e8309397420306_rle_crop_3912151539_0.png resize: (107, 92) 1376620188 -1.4933469161747677 treat image : temp/1755003627_1062292_1376603539_0d9ce7ee0471a94a8d880249096bf8ad_rle_crop_3912151564_0.png resize: (64, 73) 1376620189 0.7205700953814792 treat image : temp/1755003627_1062292_1376603538_8e9c112fe93ddda30b8faf326492fd5c_rle_crop_3912151566_0.png resize: (125, 69) 1376620190 -0.9064212221895186 treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3_rle_crop_3912151574_0.png resize: (119, 114) 1376620191 -0.5351619012136494 treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3_rle_crop_3912151575_0.png resize: (104, 48) 1376620192 1.0103877527232115 treat image : temp/1755003627_1062292_1376603456_a73c84918bfc11decfa922d7d6b06300_rle_crop_3912151581_0.png resize: (128, 89) 1376620193 -1.7884885503281216 treat image : temp/1755003627_1062292_1376603445_6c3b7ee8fc527fadfd98de666235ca4d_rle_crop_3912151591_0.png resize: (71, 70) 1376620194 -0.432330814218154 treat image : temp/1755003627_1062292_1376603441_6558336625dacd9334e0df6e36f5bdd7_rle_crop_3912151593_0.png resize: (75, 74) 1376620195 -0.40201162308889676 treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26_rle_crop_3912151588_0.png resize: (96, 119) 1376620198 -1.8899159026135162 treat image : temp/1755003627_1062292_1376607103_06060a316142c82dc3e8309397420306_rle_crop_3912151537_0.png resize: (111, 150) 1376620399 -0.9200878522909808 treat image : temp/1755003627_1062292_1376607103_06060a316142c82dc3e8309397420306_rle_crop_3912151538_0.png resize: (545, 364) 1376620400 0.24514292597312873 treat image : temp/1755003627_1062292_1376607103_06060a316142c82dc3e8309397420306_rle_crop_3912151540_0.png resize: (97, 142) 1376620401 -3.1209966770770805 treat image : temp/1755003627_1062292_1376607100_35ae8cfeca05075096536e896034ba88_rle_crop_3912151541_0.png resize: (120, 112) 1376620403 -2.3543003246317062 treat image : temp/1755003627_1062292_1376606812_6d9887cc2d586c6e0f1e47291d5acaa5_rle_crop_3912151542_0.png resize: (529, 344) 1376620404 -0.16860359287035878 treat image : temp/1755003627_1062292_1376606812_6d9887cc2d586c6e0f1e47291d5acaa5_rle_crop_3912151543_0.png resize: (134, 286) 1376620405 -2.4098087753183486 treat image : temp/1755003627_1062292_1376606810_2bf52a6c4dd5465a93cbbd1ead1c577f_rle_crop_3912151544_0.png resize: (533, 349) 1376620407 -1.1825424273050005 treat image : temp/1755003627_1062292_1376606807_02b3556937785beedba677e59eb6c3b4_rle_crop_3912151545_0.png resize: (155, 314) 1376620408 -1.9360866384452744 treat image : temp/1755003627_1062292_1376606807_02b3556937785beedba677e59eb6c3b4_rle_crop_3912151546_0.png resize: (201, 214) 1376620409 -3.7879157600992674 treat image : temp/1755003627_1062292_1376606807_02b3556937785beedba677e59eb6c3b4_rle_crop_3912151547_0.png resize: (58, 47) 1376620411 -1.2676427862698094 treat image : temp/1755003627_1062292_1376606805_1c9adda14929ca7e5d88d076aa4523cd_rle_crop_3912151548_0.png resize: (523, 348) 1376620412 0.014687363611315701 treat image : temp/1755003627_1062292_1376606797_110dcf7a02d23e6dc6e39b8f94fa3a18_rle_crop_3912151549_0.png resize: (458, 149) 1376620413 -1.7471126403398454 treat image : temp/1755003627_1062292_1376606676_26076964c9fdc63411fe2a5c53f1b74c_rle_crop_3912151550_0.png resize: (105, 67) 1376620415 -3.9759818143917056 treat image : temp/1755003627_1062292_1376606674_151fc625c461d4ca5f064c3cdce0908a_rle_crop_3912151551_0.png resize: (464, 335) 1376620416 -0.6483828173398445 treat image : temp/1755003627_1062292_1376606671_5e2fb1db566932f9491dd3939265372b_rle_crop_3912151553_0.png resize: (85, 121) 1376620417 -3.299638813003513 treat image : temp/1755003627_1062292_1376606666_897b21427c5e6b65dc3d4e0a37b2ca32_rle_crop_3912151554_0.png resize: (540, 345) 1376620419 0.3541288618982708 treat image : temp/1755003627_1062292_1376606593_5505c2e57612fcb969525f60b4a8089e_rle_crop_3912151555_0.png resize: (549, 351) 1376620420 0.13177092202434604 treat image : temp/1755003627_1062292_1376606589_1eae65a5b6f74edd6c1b7b740e0aec28_rle_crop_3912151556_0.png resize: (554, 369) 1376620421 0.07225317561821916 treat image : temp/1755003627_1062292_1376606586_dea9577bc18c624519d214ead6c3a03b_rle_crop_3912151558_0.png resize: (519, 346) 1376620423 0.2645476581230432 treat image : temp/1755003627_1062292_1376606582_fee5dd8e250f202b7977a812bc3635ae_rle_crop_3912151561_0.png resize: (167, 136) 1376620424 -2.3352311239827 treat image : temp/1755003627_1062292_1376606582_fee5dd8e250f202b7977a812bc3635ae_rle_crop_3912151562_0.png resize: (171, 163) 1376620425 -0.6678753652795447 treat image : temp/1755003627_1062292_1376606582_fee5dd8e250f202b7977a812bc3635ae_rle_crop_3912151563_0.png resize: (157, 232) 1376620427 -1.4985813820875937 treat image : temp/1755003627_1062292_1376603539_0d9ce7ee0471a94a8d880249096bf8ad_rle_crop_3912151565_0.png resize: (522, 356) 1376620428 -0.5717322802576438 treat image : temp/1755003627_1062292_1376603537_0cec8f0ba76be1ad2d919357171eb233_rle_crop_3912151567_0.png resize: (164, 173) 1376620429 -2.4467110661149247 treat image : temp/1755003627_1062292_1376603537_0cec8f0ba76be1ad2d919357171eb233_rle_crop_3912151568_0.png resize: (161, 118) 1376620431 -2.1465859403664003 treat image : temp/1755003627_1062292_1376603534_8246a32d2789a6265bcd59ea7f732666_rle_crop_3912151569_0.png resize: (503, 322) 1376620432 0.2622575651329817 treat image : temp/1755003627_1062292_1376603534_8246a32d2789a6265bcd59ea7f732666_rle_crop_3912151570_0.png resize: (144, 120) 1376620433 -3.704344542192547 treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3_rle_crop_3912151572_0.png resize: (513, 363) 1376620435 -0.388457964905547 treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3_rle_crop_3912151573_0.png resize: (298, 139) 1376620436 -3.791613873580172 treat image : temp/1755003627_1062292_1376603456_a73c84918bfc11decfa922d7d6b06300_rle_crop_3912151579_0.png resize: (131, 168) 1376620437 -2.9410525637646323 treat image : temp/1755003627_1062292_1376603456_a73c84918bfc11decfa922d7d6b06300_rle_crop_3912151580_0.png resize: (941, 1661) 1376620439 -1.0834762816583174 treat image : temp/1755003627_1062292_1376603453_593cc30dc7892b77856311a5774e9ffb_rle_crop_3912151582_0.png resize: (527, 350) 1376620441 0.11091763587224254 treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26_rle_crop_3912151585_0.png resize: (156, 63) 1376620442 -3.622125545651998 treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26_rle_crop_3912151586_0.png resize: (126, 84) 1376620444 -3.296008768637234 treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26_rle_crop_3912151589_0.png resize: (94, 155) 1376620445 -3.3088973816309797 treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26_rle_crop_3912151590_0.png resize: (275, 230) 1376620447 -3.109226092723783 treat image : temp/1755003627_1062292_1376603445_6c3b7ee8fc527fadfd98de666235ca4d_rle_crop_3912151592_0.png resize: (152, 150) 1376620449 -4.3355629311843735 treat image : temp/1755003627_1062292_1376603441_6558336625dacd9334e0df6e36f5bdd7_rle_crop_3912151594_0.png resize: (364, 199) 1376620450 -1.850833373401528 treat image : temp/1755003627_1062292_1376603441_6558336625dacd9334e0df6e36f5bdd7_rle_crop_3912151595_0.png resize: (518, 357) 1376620451 -0.18562090507828893 treat image : temp/1755003627_1062292_1376603355_588851376997f0df5d7c6a816b8d8f6e_rle_crop_3912151596_0.png resize: (532, 354) 1376620453 0.37589717110044735 treat image : temp/1755003627_1062292_1376603353_0cd2367cb09f4d99c18c1da1e18c70ee_rle_crop_3912151598_0.png resize: (266, 131) 1376620454 -3.5709292758159443 treat image : temp/1755003627_1062292_1376603353_0cd2367cb09f4d99c18c1da1e18c70ee_rle_crop_3912151599_0.png resize: (245, 91) 1376620455 -1.2938199572006666 treat image : temp/1755003627_1062292_1376603350_d6cbde0441cb8d04dc8d238b5a77cfcb_rle_crop_3912151600_0.png resize: (81, 208) 1376620457 -2.1241031688105156 treat image : temp/1755003627_1062292_1376603350_d6cbde0441cb8d04dc8d238b5a77cfcb_rle_crop_3912151601_0.png resize: (514, 350) 1376620458 0.1721348164484974 treat image : temp/1755003627_1062292_1376603350_d6cbde0441cb8d04dc8d238b5a77cfcb_rle_crop_3912151602_0.png resize: (967, 1720) 1376620459 -1.196526786624636 treat image : temp/1755003627_1062292_1376603348_826fe1f2af91d20e49e25b07f7b8b2df_rle_crop_3912151603_0.png resize: (501, 346) 1376620461 -0.47481678269699745 treat image : temp/1755003627_1062292_1376603327_831312b56a5207615b62ad9c62900606_rle_crop_3912151604_0.png resize: (525, 344) 1376620462 -0.23390598402845236 treat image : temp/1755003627_1062292_1376607106_106d9a199298301a4913d0b0ab551d4f_rle_crop_3912151534_0.png resize: (124, 110) 1376620487 -2.2247795119493956 treat image : temp/1755003627_1062292_1376607103_06060a316142c82dc3e8309397420306_rle_crop_3912151536_0.png resize: (119, 119) 1376620488 -2.812538611247609 treat image : temp/1755003627_1062292_1376606674_151fc625c461d4ca5f064c3cdce0908a_rle_crop_3912151552_0.png resize: (295, 168) 1376620490 -0.7590821475050404 treat image : temp/1755003627_1062292_1376606586_dea9577bc18c624519d214ead6c3a03b_rle_crop_3912151560_0.png resize: (123, 55) 1376620491 -2.1459280426827236 treat image : temp/1755003627_1062292_1376603534_8246a32d2789a6265bcd59ea7f732666_rle_crop_3912151571_0.png resize: (129, 50) 1376620492 -1.2491613902070655 treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3_rle_crop_3912151576_0.png resize: (120, 52) 1376620494 -2.2376260226837013 treat image : temp/1755003627_1062292_1376603456_a73c84918bfc11decfa922d7d6b06300_rle_crop_3912151578_0.png resize: (132, 49) 1376620495 -1.4159547307476104 treat image : temp/1755003627_1062292_1376603453_593cc30dc7892b77856311a5774e9ffb_rle_crop_3912151583_0.png resize: (79, 99) 1376620497 -4.900660948101223 treat image : temp/1755003627_1062292_1376603453_593cc30dc7892b77856311a5774e9ffb_rle_crop_3912151584_0.png resize: (134, 113) 1376620499 -3.0789612132718105 treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26_rle_crop_3912151587_0.png resize: (239, 170) 1376620500 -0.7774382408054353 treat image : temp/1755003627_1062292_1376603327_831312b56a5207615b62ad9c62900606_rle_crop_3912151605_0.png resize: (114, 56) 1376620502 -1.6393146487011199 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 109 time used for this insertion : 0.019986391067504883 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 109 time used for this insertion : 0.03153109550476074 save missing photos in datou_result : time spend for datou_step_exec : 31.10685133934021 time spend to save output : 0.05686664581298828 total time spend for step 6 : 31.1637179851532 step7:brightness Tue Aug 12 15:02:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1755003627_1062292_1376607106_106d9a199298301a4913d0b0ab551d4f.jpg treat image : temp/1755003627_1062292_1376607103_06060a316142c82dc3e8309397420306.jpg treat image : temp/1755003627_1062292_1376607100_35ae8cfeca05075096536e896034ba88.jpg treat image : temp/1755003627_1062292_1376606812_6d9887cc2d586c6e0f1e47291d5acaa5.jpg treat image : temp/1755003627_1062292_1376606810_2bf52a6c4dd5465a93cbbd1ead1c577f.jpg treat image : temp/1755003627_1062292_1376606807_02b3556937785beedba677e59eb6c3b4.jpg treat image : temp/1755003627_1062292_1376606805_1c9adda14929ca7e5d88d076aa4523cd.jpg treat image : temp/1755003627_1062292_1376606802_f15b6a5ae58153eedc3779d7039710a3.jpg treat image : temp/1755003627_1062292_1376606797_110dcf7a02d23e6dc6e39b8f94fa3a18.jpg treat image : temp/1755003627_1062292_1376606676_26076964c9fdc63411fe2a5c53f1b74c.jpg treat image : temp/1755003627_1062292_1376606674_151fc625c461d4ca5f064c3cdce0908a.jpg treat image : temp/1755003627_1062292_1376606673_6187e978350a8befa04f8a1a9cc39f90.jpg treat image : temp/1755003627_1062292_1376606671_5e2fb1db566932f9491dd3939265372b.jpg treat image : temp/1755003627_1062292_1376606666_897b21427c5e6b65dc3d4e0a37b2ca32.jpg treat image : temp/1755003627_1062292_1376606593_5505c2e57612fcb969525f60b4a8089e.jpg treat image : temp/1755003627_1062292_1376606589_1eae65a5b6f74edd6c1b7b740e0aec28.jpg treat image : temp/1755003627_1062292_1376606586_dea9577bc18c624519d214ead6c3a03b.jpg treat image : temp/1755003627_1062292_1376606584_e0707bd05962419b37584c597f36c1e6.jpg treat image : temp/1755003627_1062292_1376606582_fee5dd8e250f202b7977a812bc3635ae.jpg treat image : temp/1755003627_1062292_1376606576_ec51dda9e96c4b882aefa12d6af2f811.jpg treat image : temp/1755003627_1062292_1376603540_d43431388a4656940c8ecd4d10367174.jpg treat image : temp/1755003627_1062292_1376603539_0d9ce7ee0471a94a8d880249096bf8ad.jpg treat image : temp/1755003627_1062292_1376603538_8e9c112fe93ddda30b8faf326492fd5c.jpg treat image : temp/1755003627_1062292_1376603537_0cec8f0ba76be1ad2d919357171eb233.jpg treat image : temp/1755003627_1062292_1376603534_8246a32d2789a6265bcd59ea7f732666.jpg treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3.jpg treat image : temp/1755003627_1062292_1376603456_a73c84918bfc11decfa922d7d6b06300.jpg treat image : temp/1755003627_1062292_1376603453_593cc30dc7892b77856311a5774e9ffb.jpg treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26.jpg treat image : temp/1755003627_1062292_1376603445_6c3b7ee8fc527fadfd98de666235ca4d.jpg treat image : temp/1755003627_1062292_1376603441_6558336625dacd9334e0df6e36f5bdd7.jpg treat image : temp/1755003627_1062292_1376603355_588851376997f0df5d7c6a816b8d8f6e.jpg treat image : temp/1755003627_1062292_1376603353_0cd2367cb09f4d99c18c1da1e18c70ee.jpg treat image : temp/1755003627_1062292_1376603351_3ddbca009636a37b60aa71c293c64294.jpg treat image : temp/1755003627_1062292_1376603350_d6cbde0441cb8d04dc8d238b5a77cfcb.jpg treat image : temp/1755003627_1062292_1376603348_826fe1f2af91d20e49e25b07f7b8b2df.jpg treat image : temp/1755003627_1062292_1376603327_831312b56a5207615b62ad9c62900606.jpg treat image : temp/1755003627_1062292_1376606586_dea9577bc18c624519d214ead6c3a03b_rle_crop_3912151557_0.png treat image : temp/1755003627_1062292_1376606586_dea9577bc18c624519d214ead6c3a03b_rle_crop_3912151559_0.png treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3_rle_crop_3912151577_0.png treat image : temp/1755003627_1062292_1376603355_588851376997f0df5d7c6a816b8d8f6e_rle_crop_3912151597_0.png treat image : temp/1755003627_1062292_1376607106_106d9a199298301a4913d0b0ab551d4f_rle_crop_3912151535_0.png treat image : temp/1755003627_1062292_1376607103_06060a316142c82dc3e8309397420306_rle_crop_3912151539_0.png treat image : temp/1755003627_1062292_1376603539_0d9ce7ee0471a94a8d880249096bf8ad_rle_crop_3912151564_0.png treat image : temp/1755003627_1062292_1376603538_8e9c112fe93ddda30b8faf326492fd5c_rle_crop_3912151566_0.png treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3_rle_crop_3912151574_0.png treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3_rle_crop_3912151575_0.png treat image : temp/1755003627_1062292_1376603456_a73c84918bfc11decfa922d7d6b06300_rle_crop_3912151581_0.png treat image : temp/1755003627_1062292_1376603445_6c3b7ee8fc527fadfd98de666235ca4d_rle_crop_3912151591_0.png treat image : temp/1755003627_1062292_1376603441_6558336625dacd9334e0df6e36f5bdd7_rle_crop_3912151593_0.png treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26_rle_crop_3912151588_0.png treat image : temp/1755003627_1062292_1376607103_06060a316142c82dc3e8309397420306_rle_crop_3912151537_0.png treat image : temp/1755003627_1062292_1376607103_06060a316142c82dc3e8309397420306_rle_crop_3912151538_0.png treat image : temp/1755003627_1062292_1376607103_06060a316142c82dc3e8309397420306_rle_crop_3912151540_0.png treat image : temp/1755003627_1062292_1376607100_35ae8cfeca05075096536e896034ba88_rle_crop_3912151541_0.png treat image : temp/1755003627_1062292_1376606812_6d9887cc2d586c6e0f1e47291d5acaa5_rle_crop_3912151542_0.png treat image : temp/1755003627_1062292_1376606812_6d9887cc2d586c6e0f1e47291d5acaa5_rle_crop_3912151543_0.png treat image : temp/1755003627_1062292_1376606810_2bf52a6c4dd5465a93cbbd1ead1c577f_rle_crop_3912151544_0.png treat image : temp/1755003627_1062292_1376606807_02b3556937785beedba677e59eb6c3b4_rle_crop_3912151545_0.png treat image : temp/1755003627_1062292_1376606807_02b3556937785beedba677e59eb6c3b4_rle_crop_3912151546_0.png treat image : temp/1755003627_1062292_1376606807_02b3556937785beedba677e59eb6c3b4_rle_crop_3912151547_0.png treat image : temp/1755003627_1062292_1376606805_1c9adda14929ca7e5d88d076aa4523cd_rle_crop_3912151548_0.png treat image : temp/1755003627_1062292_1376606797_110dcf7a02d23e6dc6e39b8f94fa3a18_rle_crop_3912151549_0.png treat image : temp/1755003627_1062292_1376606676_26076964c9fdc63411fe2a5c53f1b74c_rle_crop_3912151550_0.png treat image : temp/1755003627_1062292_1376606674_151fc625c461d4ca5f064c3cdce0908a_rle_crop_3912151551_0.png treat image : temp/1755003627_1062292_1376606671_5e2fb1db566932f9491dd3939265372b_rle_crop_3912151553_0.png treat image : temp/1755003627_1062292_1376606666_897b21427c5e6b65dc3d4e0a37b2ca32_rle_crop_3912151554_0.png treat image : temp/1755003627_1062292_1376606593_5505c2e57612fcb969525f60b4a8089e_rle_crop_3912151555_0.png treat image : temp/1755003627_1062292_1376606589_1eae65a5b6f74edd6c1b7b740e0aec28_rle_crop_3912151556_0.png treat image : temp/1755003627_1062292_1376606586_dea9577bc18c624519d214ead6c3a03b_rle_crop_3912151558_0.png treat image : temp/1755003627_1062292_1376606582_fee5dd8e250f202b7977a812bc3635ae_rle_crop_3912151561_0.png treat image : temp/1755003627_1062292_1376606582_fee5dd8e250f202b7977a812bc3635ae_rle_crop_3912151562_0.png treat image : temp/1755003627_1062292_1376606582_fee5dd8e250f202b7977a812bc3635ae_rle_crop_3912151563_0.png treat image : temp/1755003627_1062292_1376603539_0d9ce7ee0471a94a8d880249096bf8ad_rle_crop_3912151565_0.png treat image : temp/1755003627_1062292_1376603537_0cec8f0ba76be1ad2d919357171eb233_rle_crop_3912151567_0.png treat image : temp/1755003627_1062292_1376603537_0cec8f0ba76be1ad2d919357171eb233_rle_crop_3912151568_0.png treat image : temp/1755003627_1062292_1376603534_8246a32d2789a6265bcd59ea7f732666_rle_crop_3912151569_0.png treat image : temp/1755003627_1062292_1376603534_8246a32d2789a6265bcd59ea7f732666_rle_crop_3912151570_0.png treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3_rle_crop_3912151572_0.png treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3_rle_crop_3912151573_0.png treat image : temp/1755003627_1062292_1376603456_a73c84918bfc11decfa922d7d6b06300_rle_crop_3912151579_0.png treat image : temp/1755003627_1062292_1376603456_a73c84918bfc11decfa922d7d6b06300_rle_crop_3912151580_0.png treat image : temp/1755003627_1062292_1376603453_593cc30dc7892b77856311a5774e9ffb_rle_crop_3912151582_0.png treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26_rle_crop_3912151585_0.png treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26_rle_crop_3912151586_0.png treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26_rle_crop_3912151589_0.png treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26_rle_crop_3912151590_0.png treat image : temp/1755003627_1062292_1376603445_6c3b7ee8fc527fadfd98de666235ca4d_rle_crop_3912151592_0.png treat image : temp/1755003627_1062292_1376603441_6558336625dacd9334e0df6e36f5bdd7_rle_crop_3912151594_0.png treat image : temp/1755003627_1062292_1376603441_6558336625dacd9334e0df6e36f5bdd7_rle_crop_3912151595_0.png treat image : temp/1755003627_1062292_1376603355_588851376997f0df5d7c6a816b8d8f6e_rle_crop_3912151596_0.png treat image : temp/1755003627_1062292_1376603353_0cd2367cb09f4d99c18c1da1e18c70ee_rle_crop_3912151598_0.png treat image : temp/1755003627_1062292_1376603353_0cd2367cb09f4d99c18c1da1e18c70ee_rle_crop_3912151599_0.png treat image : temp/1755003627_1062292_1376603350_d6cbde0441cb8d04dc8d238b5a77cfcb_rle_crop_3912151600_0.png treat image : temp/1755003627_1062292_1376603350_d6cbde0441cb8d04dc8d238b5a77cfcb_rle_crop_3912151601_0.png treat image : temp/1755003627_1062292_1376603350_d6cbde0441cb8d04dc8d238b5a77cfcb_rle_crop_3912151602_0.png treat image : temp/1755003627_1062292_1376603348_826fe1f2af91d20e49e25b07f7b8b2df_rle_crop_3912151603_0.png treat image : temp/1755003627_1062292_1376603327_831312b56a5207615b62ad9c62900606_rle_crop_3912151604_0.png treat image : temp/1755003627_1062292_1376607106_106d9a199298301a4913d0b0ab551d4f_rle_crop_3912151534_0.png treat image : temp/1755003627_1062292_1376607103_06060a316142c82dc3e8309397420306_rle_crop_3912151536_0.png treat image : temp/1755003627_1062292_1376606674_151fc625c461d4ca5f064c3cdce0908a_rle_crop_3912151552_0.png treat image : temp/1755003627_1062292_1376606586_dea9577bc18c624519d214ead6c3a03b_rle_crop_3912151560_0.png treat image : temp/1755003627_1062292_1376603534_8246a32d2789a6265bcd59ea7f732666_rle_crop_3912151571_0.png treat image : temp/1755003627_1062292_1376603531_6ca3a5965fad7290f97c3bcb7a5fbda3_rle_crop_3912151576_0.png treat image : temp/1755003627_1062292_1376603456_a73c84918bfc11decfa922d7d6b06300_rle_crop_3912151578_0.png treat image : temp/1755003627_1062292_1376603453_593cc30dc7892b77856311a5774e9ffb_rle_crop_3912151583_0.png treat image : temp/1755003627_1062292_1376603453_593cc30dc7892b77856311a5774e9ffb_rle_crop_3912151584_0.png treat image : temp/1755003627_1062292_1376603448_a9113a5d471267aa918f6156e583ae26_rle_crop_3912151587_0.png treat image : temp/1755003627_1062292_1376603327_831312b56a5207615b62ad9c62900606_rle_crop_3912151605_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 109 time used for this insertion : 0.01807379722595215 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 109 time used for this insertion : 0.029565811157226562 save missing photos in datou_result : time spend for datou_step_exec : 8.92557168006897 time spend to save output : 0.05245041847229004 total time spend for step 7 : 8.97802209854126 step8:velours_tree Tue Aug 12 15:03:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.0900413990020752 time spend to save output : 3.838539123535156e-05 total time spend for step 8 : 0.09007978439331055 step9:send_mail_cod Tue Aug 12 15:03:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25915172_12-08-2025_15_03_08.pdf 25916077 imagette259160771755003788 25916078 imagette259160781755003788 25916079 imagette259160791755003788 25916080 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259160801755003788 25916081 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259160811755003788 25916083 change filename to text .change filename to text .change filename to text .change filename to text .imagette259160831755003789 25916084 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259160841755003789 25916085 imagette259160851755003790 25916086 change filename to text .imagette259160861755003790 25916087 imagette259160871755003790 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25915172 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25916077,25916078,25916079,25916080,25916081,25916082,25916083,25916084,25916085,25916086,25916087?tags=pet_fonce,pehd,flou,carton,autre,environnement,papier,pet_clair,mal_croppe,metal,background args[1376607106] : ((1376607106, 1.6756328596411427, 492688767), (1376607106, 0.24237862860532278, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376607103] : ((1376607103, 0.3506540363824218, 492688767), (1376607103, 0.4824057683144793, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376607100] : ((1376607100, -2.304117338621696, 492609224), (1376607100, 0.47020985028421874, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606812] : ((1376606812, -2.5036029320135924, 492609224), (1376606812, 0.6590243851751427, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606810] : ((1376606810, -2.2792916628241997, 492609224), (1376606810, 0.4312460390686724, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606807] : ((1376606807, -1.2681854918916757, 492688767), (1376606807, 0.41718834311221537, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606805] : ((1376606805, -2.2186467579221394, 492609224), (1376606805, 0.43695425816111516, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606802] : ((1376606802, -2.110035369319159, 492609224), (1376606802, 0.6007828549157426, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606797] : ((1376606797, -2.410539235219464, 492609224), (1376606797, 0.5420780526441553, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606676] : ((1376606676, -1.4222715018806336, 492688767), (1376606676, 0.5793395490937202, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606674] : ((1376606674, -2.5574172463401763, 492609224), (1376606674, 0.5761116199840403, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606673] : ((1376606673, 0.6187605599018794, 492688767), (1376606673, 0.600710497935542, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606671] : ((1376606671, -0.7070600577807016, 492688767), (1376606671, 0.3538570509359368, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606666] : ((1376606666, -4.057421413303308, 492609224), (1376606666, 0.3091289571444732, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606593] : ((1376606593, 0.9156255215407406, 492688767), (1376606593, 0.48513628378828694, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606589] : ((1376606589, -2.069154346289819, 492609224), (1376606589, 0.5051378720465001, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606586] : ((1376606586, -1.597245890204201, 492688767), (1376606586, 0.40676159987247557, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606584] : ((1376606584, -2.4798315416548675, 492609224), (1376606584, 0.5583764687349106, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606582] : ((1376606582, -0.5650939506509688, 492688767), (1376606582, 0.670903094649227, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376606576] : ((1376606576, -2.1870517963414757, 492609224), (1376606576, 0.8119994986062368, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603540] : ((1376603540, -2.6333390407668564, 492609224), (1376603540, 0.6374693737824921, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603539] : ((1376603539, -2.4040008326496314, 492609224), (1376603539, 0.7955204374251308, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603538] : ((1376603538, -2.811380955848009, 492609224), (1376603538, 0.7460187612112282, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603537] : ((1376603537, -2.503163434908198, 492609224), (1376603537, 0.4618125641665539, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603534] : ((1376603534, -2.568015124323713, 492609224), (1376603534, 0.4568644991246398, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603531] : ((1376603531, -2.717528349491422, 492609224), (1376603531, 0.42723061738747886, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603456] : ((1376603456, -1.7691080962403225, 492688767), (1376603456, 0.3675486025027332, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603453] : ((1376603453, -4.472225003001496, 492609224), (1376603453, 0.3943095559612297, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603448] : ((1376603448, -2.1657313814187136, 492609224), (1376603448, 0.560170104431115, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603445] : ((1376603445, -2.7929938999758077, 492609224), (1376603445, 0.6368101859505283, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603441] : ((1376603441, -0.6258065113935203, 492688767), (1376603441, 0.7502669306085942, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603355] : ((1376603355, -2.99633201833263, 492609224), (1376603355, 0.3317882466901315, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603353] : ((1376603353, -2.5094155419775883, 492609224), (1376603353, 0.5323901453807284, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603351] : ((1376603351, -1.929393427532553, 492688767), (1376603351, 0.5152759870710906, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603350] : ((1376603350, -1.8269104424349096, 492688767), (1376603350, 0.2890867355997466, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603348] : ((1376603348, -2.9932330532744342, 492609224), (1376603348, 0.3447606776857829, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com args[1376603327] : ((1376603327, -0.9796413218647424, 492688767), (1376603327, 0.365887209621589, 2107752395), '0.0699012163204872') We are sending mail with results at report@fotonower.com refus_total : 0.0699012163204872 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25915172 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915172_12-08-2025_15_03_08.pdf results_Auto_P25915172_12-08-2025_15_03_08.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915172_12-08-2025_15_03_08.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25915172','results_Auto_P25915172_12-08-2025_15_03_08.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915172_12-08-2025_15_03_08.pdf','pdf','','0.49','0.0699012163204872') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25915172

https://www.fotonower.com/image?json=false&list_photos_id=1376607106
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.6756328596411427)
https://www.fotonower.com/image?json=false&list_photos_id=1376607103
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376607100
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606812
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606810
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606807
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606805
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606802
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606797
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606676
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606674
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606673
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606671
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606666
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606593
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606589
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606586
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606584
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606582
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376606576
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603540
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603539
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603538
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603537
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603534
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603531
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603456
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603453
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603448
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603445
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603441
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603355
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603353
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603351
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603350
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603348
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376603327
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 6.99%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/25916080?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25916081?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25916083?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25916084?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/25916086?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915172_12-08-2025_15_03_08.pdf.

Lien vers velours :https://www.fotonower.com/velours/25916077,25916078,25916079,25916080,25916081,25916082,25916083,25916084,25916085,25916086,25916087?tags=pet_fonce,pehd,flou,carton,autre,environnement,papier,pet_clair,mal_croppe,metal,background.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 12 Aug 2025 13:03:13 GMT Content-Length: 0 Connection: close X-Message-Id: sWQ9hWZ_TAi4OgyYoPspHQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1376607106, 1376607103, 1376607100, 1376606812, 1376606810, 1376606807, 1376606805, 1376606802, 1376606797, 1376606676, 1376606674, 1376606673, 1376606671, 1376606666, 1376606593, 1376606589, 1376606586, 1376606584, 1376606582, 1376606576, 1376603540, 1376603539, 1376603538, 1376603537, 1376603534, 1376603531, 1376603456, 1376603453, 1376603448, 1376603445, 1376603441, 1376603355, 1376603353, 1376603351, 1376603350, 1376603348, 1376603327] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607106', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607103', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607100', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606812', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606810', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606807', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606805', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606802', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606797', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606676', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606674', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606673', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606671', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606666', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606593', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606589', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606586', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606584', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606582', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606576', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603540', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603539', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603538', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603537', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603534', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603531', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603456', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603453', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603448', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603445', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603441', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603355', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603353', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603351', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603350', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603348', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603327', None, None, None, None, None, '3512838') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 37 time used for this insertion : 0.020821094512939453 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.7903077602386475 time spend to save output : 0.021259784698486328 total time spend for step 9 : 5.811567544937134 step10:split_time_score Tue Aug 12 15:03:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 37),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 12082025 25915172 Nombre de photos uploadées : 37 / 23040 (0%) 12082025 25915172 Nombre de photos taguées (types de déchets): 0 / 37 (0%) 12082025 25915172 Nombre de photos taguées (volume) : 0 / 37 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 9.5367431640625e-06 ????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0018851757049560547 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.19936227798461914 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.08963755666473765 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907306_12-08-2025_12_02_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907306 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907306 AND mptpi.`type`=3594 To do Qualite : 0.2198127786351166 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25908856_12-08-2025_12_01_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25908856 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25908856 AND mptpi.`type`=3594 To do Qualite : 0.11567090446566358 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25908860_12-08-2025_13_02_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25908860 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25908860 AND mptpi.`type`=3594 To do Qualite : 0.03421356577932099 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25908864_12-08-2025_11_41_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25908864 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25908864 AND mptpi.`type`=3594 To do Qualite : 0.09985528962742503 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907315_12-08-2025_12_41_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907315 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907315 AND mptpi.`type`=3594 To do Qualite : 0.24285493827160495 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907317_12-08-2025_13_21_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907317 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907317 AND mptpi.`type`=3594 To do Qualite : 0.021655971995279587 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907323_12-08-2025_11_22_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907323 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907323 AND mptpi.`type`=3594 To do Qualite : 0.06390883349867725 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907331_12-08-2025_12_21_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907331 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907331 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915170 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915171 order by id desc limit 1 Qualite : 0.0699012163204872 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915172_12-08-2025_15_03_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915172 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915172 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915175 order by id desc limit 1 Qualite : 0.054940908926504634 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915180_12-08-2025_14_43_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915180 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915180 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'12082025': {'nb_upload': 37, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1376607106, 1376607103, 1376607100, 1376606812, 1376606810, 1376606807, 1376606805, 1376606802, 1376606797, 1376606676, 1376606674, 1376606673, 1376606671, 1376606666, 1376606593, 1376606589, 1376606586, 1376606584, 1376606582, 1376606576, 1376603540, 1376603539, 1376603538, 1376603537, 1376603534, 1376603531, 1376603456, 1376603453, 1376603448, 1376603445, 1376603441, 1376603355, 1376603353, 1376603351, 1376603350, 1376603348, 1376603327] Looping around the photos to save general results len do output : 1 /25915172Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607106', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607103', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376607100', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606812', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606810', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606807', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606805', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606802', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606797', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606676', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606674', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606673', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606671', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606666', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606593', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606589', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606586', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606584', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606582', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376606576', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603540', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603539', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603538', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603537', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603534', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603531', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603456', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603453', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603448', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603445', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603441', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603355', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603353', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603351', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603350', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603348', None, None, None, None, None, '3512838') ('3318', None, None, None, None, None, None, None, '3512838') ('3318', '25915172', '1376603327', None, None, None, None, None, '3512838') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 38 time used for this insertion : 0.020993947982788086 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.7088661193847656 time spend to save output : 0.021352529525756836 total time spend for step 10 : 3.7302186489105225 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 37 set_done_treatment 102.67user 36.11system 2:52.51elapsed 80%CPU (0avgtext+0avgdata 3458568maxresident)k 92896inputs+46248outputs (4890major+2403731minor)pagefaults 0swaps