python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 461067 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3521717'] with mtr_portfolio_ids : ['25946359'] and first list_photo_ids : [] new path : /proc/461067/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 23 ; length of list_pids : 23 ; length of list_args : 23 time to download the photos : 2.879852771759033 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Aug 13 19:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10395 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-13 19:40:33.412491: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-13 19:40:33.440574: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-13 19:40:33.442221: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fa5d0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-13 19:40:33.442242: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-13 19:40:33.444956: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-13 19:40:33.587934: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x13c35ee0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-13 19:40:33.587968: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-13 19:40:33.588906: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-13 19:40:33.589193: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-13 19:40:33.591059: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-13 19:40:33.593072: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-13 19:40:33.593371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-13 19:40:33.596365: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-13 19:40:33.597693: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-13 19:40:33.603549: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-13 19:40:33.605120: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-13 19:40:33.605202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-13 19:40:33.605978: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-13 19:40:33.605996: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-13 19:40:33.606005: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-13 19:40:33.607324: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9629 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-13 19:40:33.865702: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-13 19:40:33.865805: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-13 19:40:33.865829: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-13 19:40:33.865852: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-13 19:40:33.865873: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-13 19:40:33.865895: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-13 19:40:33.865917: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-13 19:40:33.865942: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-13 19:40:33.867494: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-13 19:40:33.869088: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-13 19:40:33.869130: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-13 19:40:33.869146: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-13 19:40:33.869160: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-13 19:40:33.869174: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-13 19:40:33.869188: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-13 19:40:33.869201: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-13 19:40:33.869215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-13 19:40:33.870487: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-13 19:40:33.870519: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-13 19:40:33.870528: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-13 19:40:33.870536: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-13 19:40:33.871853: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9629 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-13 19:40:40.848777: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-13 19:40:41.046195: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 23 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 63.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 Detection mask done ! Trying to reset tf kernel 461674 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 136 tf kernel not reseted sub process len(results) : 23 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 23 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5425 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0003790855407714844 nb_pixel_total : 11279 time to create 1 rle with old method : 0.014296293258666992 length of segment : 175 time for calcul the mask position with numpy : 0.01412820816040039 nb_pixel_total : 730120 time to create 1 rle with new method : 0.027374744415283203 length of segment : 1003 time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 11102 time to create 1 rle with old method : 0.014009237289428711 length of segment : 126 time for calcul the mask position with numpy : 0.00020694732666015625 nb_pixel_total : 10885 time to create 1 rle with old method : 0.012720346450805664 length of segment : 139 time for calcul the mask position with numpy : 0.00022125244140625 nb_pixel_total : 12119 time to create 1 rle with old method : 0.014522790908813477 length of segment : 134 time for calcul the mask position with numpy : 0.0002167224884033203 nb_pixel_total : 10670 time to create 1 rle with old method : 0.012427330017089844 length of segment : 182 time for calcul the mask position with numpy : 0.00025200843811035156 nb_pixel_total : 13492 time to create 1 rle with old method : 0.015828847885131836 length of segment : 90 time for calcul the mask position with numpy : 0.00012350082397460938 nb_pixel_total : 5008 time to create 1 rle with old method : 0.006174325942993164 length of segment : 91 time for calcul the mask position with numpy : 0.0003361701965332031 nb_pixel_total : 11013 time to create 1 rle with old method : 0.013009071350097656 length of segment : 181 time for calcul the mask position with numpy : 0.00022363662719726562 nb_pixel_total : 14117 time to create 1 rle with old method : 0.017452716827392578 length of segment : 94 time for calcul the mask position with numpy : 0.0001952648162841797 nb_pixel_total : 10001 time to create 1 rle with old method : 0.011869668960571289 length of segment : 172 time for calcul the mask position with numpy : 0.0001857280731201172 nb_pixel_total : 9841 time to create 1 rle with old method : 0.011942386627197266 length of segment : 89 time for calcul the mask position with numpy : 0.00033664703369140625 nb_pixel_total : 20077 time to create 1 rle with old method : 0.023917436599731445 length of segment : 146 time for calcul the mask position with numpy : 0.0001399517059326172 nb_pixel_total : 5732 time to create 1 rle with old method : 0.007382869720458984 length of segment : 44 time for calcul the mask position with numpy : 0.00021409988403320312 nb_pixel_total : 12705 time to create 1 rle with old method : 0.015468835830688477 length of segment : 136 time for calcul the mask position with numpy : 0.00015425682067871094 nb_pixel_total : 7393 time to create 1 rle with old method : 0.00876617431640625 length of segment : 120 time for calcul the mask position with numpy : 0.0002677440643310547 nb_pixel_total : 17750 time to create 1 rle with old method : 0.020467281341552734 length of segment : 215 time for calcul the mask position with numpy : 0.00025200843811035156 nb_pixel_total : 14052 time to create 1 rle with old method : 0.016527652740478516 length of segment : 115 time for calcul the mask position with numpy : 0.00012993812561035156 nb_pixel_total : 5323 time to create 1 rle with old method : 0.00641942024230957 length of segment : 74 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1340 time to create 1 rle with old method : 0.0017390251159667969 length of segment : 39 time for calcul the mask position with numpy : 0.001554727554321289 nb_pixel_total : 50812 time to create 1 rle with old method : 0.05983281135559082 length of segment : 353 time for calcul the mask position with numpy : 0.00022077560424804688 nb_pixel_total : 11134 time to create 1 rle with old method : 0.013590097427368164 length of segment : 128 time for calcul the mask position with numpy : 0.0016283988952636719 nb_pixel_total : 112617 time to create 1 rle with old method : 0.12972044944763184 length of segment : 546 time for calcul the mask position with numpy : 0.00025844573974609375 nb_pixel_total : 16192 time to create 1 rle with old method : 0.018618106842041016 length of segment : 124 time for calcul the mask position with numpy : 0.0015387535095214844 nb_pixel_total : 111612 time to create 1 rle with old method : 0.13008379936218262 length of segment : 542 time for calcul the mask position with numpy : 0.0002396106719970703 nb_pixel_total : 14009 time to create 1 rle with old method : 0.016600847244262695 length of segment : 132 time for calcul the mask position with numpy : 0.0001342296600341797 nb_pixel_total : 6421 time to create 1 rle with old method : 0.007849931716918945 length of segment : 102 time for calcul the mask position with numpy : 0.00016546249389648438 nb_pixel_total : 3498 time to create 1 rle with old method : 0.0044405460357666016 length of segment : 61 time for calcul the mask position with numpy : 0.0002951622009277344 nb_pixel_total : 12355 time to create 1 rle with old method : 0.014976739883422852 length of segment : 176 time for calcul the mask position with numpy : 0.00017642974853515625 nb_pixel_total : 8480 time to create 1 rle with old method : 0.010495424270629883 length of segment : 98 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 2942 time to create 1 rle with old method : 0.003726959228515625 length of segment : 56 time for calcul the mask position with numpy : 0.0002384185791015625 nb_pixel_total : 13458 time to create 1 rle with old method : 0.015954971313476562 length of segment : 173 time for calcul the mask position with numpy : 0.00010895729064941406 nb_pixel_total : 4982 time to create 1 rle with old method : 0.006003856658935547 length of segment : 107 time for calcul the mask position with numpy : 0.00035452842712402344 nb_pixel_total : 7331 time to create 1 rle with old method : 0.008793830871582031 length of segment : 158 time for calcul the mask position with numpy : 0.0003154277801513672 nb_pixel_total : 9389 time to create 1 rle with old method : 0.011176109313964844 length of segment : 230 time for calcul the mask position with numpy : 0.00017571449279785156 nb_pixel_total : 9770 time to create 1 rle with old method : 0.011463165283203125 length of segment : 223 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 8398 time to create 1 rle with old method : 0.010359764099121094 length of segment : 66 time for calcul the mask position with numpy : 0.0004801750183105469 nb_pixel_total : 13841 time to create 1 rle with old method : 0.01656055450439453 length of segment : 137 time for calcul the mask position with numpy : 0.00026035308837890625 nb_pixel_total : 6940 time to create 1 rle with old method : 0.008552789688110352 length of segment : 92 time for calcul the mask position with numpy : 0.0025904178619384766 nb_pixel_total : 94902 time to create 1 rle with old method : 0.10957741737365723 length of segment : 498 time for calcul the mask position with numpy : 0.0004811286926269531 nb_pixel_total : 13644 time to create 1 rle with old method : 0.019360780715942383 length of segment : 173 time for calcul the mask position with numpy : 0.0007865428924560547 nb_pixel_total : 20698 time to create 1 rle with old method : 0.023778915405273438 length of segment : 317 time for calcul the mask position with numpy : 0.0003445148468017578 nb_pixel_total : 9378 time to create 1 rle with old method : 0.01114201545715332 length of segment : 127 time for calcul the mask position with numpy : 0.00039315223693847656 nb_pixel_total : 17513 time to create 1 rle with old method : 0.02138209342956543 length of segment : 74 time for calcul the mask position with numpy : 0.0001342296600341797 nb_pixel_total : 6000 time to create 1 rle with old method : 0.007321357727050781 length of segment : 105 time for calcul the mask position with numpy : 0.0002129077911376953 nb_pixel_total : 8981 time to create 1 rle with old method : 0.011152029037475586 length of segment : 144 time for calcul the mask position with numpy : 0.00015854835510253906 nb_pixel_total : 8140 time to create 1 rle with old method : 0.009912729263305664 length of segment : 191 time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 8266 time to create 1 rle with old method : 0.009624242782592773 length of segment : 116 time for calcul the mask position with numpy : 0.0005736351013183594 nb_pixel_total : 33129 time to create 1 rle with old method : 0.03896212577819824 length of segment : 239 time for calcul the mask position with numpy : 0.0002598762512207031 nb_pixel_total : 15504 time to create 1 rle with old method : 0.021603822708129883 length of segment : 171 time for calcul the mask position with numpy : 0.00023484230041503906 nb_pixel_total : 4146 time to create 1 rle with old method : 0.005034685134887695 length of segment : 93 time for calcul the mask position with numpy : 0.00025582313537597656 nb_pixel_total : 6566 time to create 1 rle with old method : 0.007960319519042969 length of segment : 131 time for calcul the mask position with numpy : 0.00024199485778808594 nb_pixel_total : 7043 time to create 1 rle with old method : 0.008347511291503906 length of segment : 74 time for calcul the mask position with numpy : 0.0002028942108154297 nb_pixel_total : 3979 time to create 1 rle with old method : 0.005112171173095703 length of segment : 86 time for calcul the mask position with numpy : 0.0017180442810058594 nb_pixel_total : 78518 time to create 1 rle with old method : 0.0895681381225586 length of segment : 482 time for calcul the mask position with numpy : 0.012262582778930664 nb_pixel_total : 650231 time to create 1 rle with new method : 0.02246570587158203 length of segment : 981 time for calcul the mask position with numpy : 0.00017905235290527344 nb_pixel_total : 3972 time to create 1 rle with old method : 0.004656314849853516 length of segment : 75 time for calcul the mask position with numpy : 0.0024657249450683594 nb_pixel_total : 108450 time to create 1 rle with old method : 0.12485885620117188 length of segment : 534 time for calcul the mask position with numpy : 0.0014600753784179688 nb_pixel_total : 111963 time to create 1 rle with old method : 0.1296672821044922 length of segment : 545 time for calcul the mask position with numpy : 0.0005054473876953125 nb_pixel_total : 17564 time to create 1 rle with old method : 0.020578384399414062 length of segment : 134 time for calcul the mask position with numpy : 0.0004937648773193359 nb_pixel_total : 10347 time to create 1 rle with old method : 0.01215815544128418 length of segment : 178 time for calcul the mask position with numpy : 0.0024938583374023438 nb_pixel_total : 119916 time to create 1 rle with old method : 0.1387484073638916 length of segment : 534 time for calcul the mask position with numpy : 0.0014410018920898438 nb_pixel_total : 108048 time to create 1 rle with old method : 0.12948226928710938 length of segment : 507 time for calcul the mask position with numpy : 0.014045000076293945 nb_pixel_total : 726057 time to create 1 rle with new method : 0.02328634262084961 length of segment : 967 time for calcul the mask position with numpy : 0.00012135505676269531 nb_pixel_total : 3493 time to create 1 rle with old method : 0.004248380661010742 length of segment : 32 time for calcul the mask position with numpy : 0.0017020702362060547 nb_pixel_total : 92376 time to create 1 rle with old method : 0.1065666675567627 length of segment : 508 time for calcul the mask position with numpy : 0.00022029876708984375 nb_pixel_total : 6110 time to create 1 rle with old method : 0.007395029067993164 length of segment : 115 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1428 time to create 1 rle with old method : 0.0018053054809570312 length of segment : 42 time for calcul the mask position with numpy : 0.000270843505859375 nb_pixel_total : 6539 time to create 1 rle with old method : 0.007859468460083008 length of segment : 103 time for calcul the mask position with numpy : 0.002579927444458008 nb_pixel_total : 99118 time to create 1 rle with old method : 0.11461567878723145 length of segment : 513 time for calcul the mask position with numpy : 0.0001285076141357422 nb_pixel_total : 1726 time to create 1 rle with old method : 0.0021665096282958984 length of segment : 58 time for calcul the mask position with numpy : 0.0003337860107421875 nb_pixel_total : 9338 time to create 1 rle with old method : 0.011408567428588867 length of segment : 171 time for calcul the mask position with numpy : 0.00019431114196777344 nb_pixel_total : 4369 time to create 1 rle with old method : 0.0052700042724609375 length of segment : 71 time for calcul the mask position with numpy : 0.0031058788299560547 nb_pixel_total : 122121 time to create 1 rle with old method : 0.1443920135498047 length of segment : 534 time for calcul the mask position with numpy : 0.00016880035400390625 nb_pixel_total : 3983 time to create 1 rle with old method : 0.004860401153564453 length of segment : 68 time for calcul the mask position with numpy : 0.00012874603271484375 nb_pixel_total : 1322 time to create 1 rle with old method : 0.0016949176788330078 length of segment : 35 time for calcul the mask position with numpy : 0.0004150867462158203 nb_pixel_total : 14816 time to create 1 rle with old method : 0.018076658248901367 length of segment : 112 time for calcul the mask position with numpy : 0.00036978721618652344 nb_pixel_total : 7018 time to create 1 rle with old method : 0.008601188659667969 length of segment : 307 time for calcul the mask position with numpy : 0.00015997886657714844 nb_pixel_total : 4570 time to create 1 rle with old method : 0.005626678466796875 length of segment : 136 time for calcul the mask position with numpy : 0.002595186233520508 nb_pixel_total : 109469 time to create 1 rle with old method : 0.12608051300048828 length of segment : 562 time for calcul the mask position with numpy : 0.00044345855712890625 nb_pixel_total : 15619 time to create 1 rle with old method : 0.017694473266601562 length of segment : 137 time for calcul the mask position with numpy : 0.0004372596740722656 nb_pixel_total : 17638 time to create 1 rle with old method : 0.02106308937072754 length of segment : 316 time for calcul the mask position with numpy : 0.013263463973999023 nb_pixel_total : 711130 time to create 1 rle with new method : 0.0251467227935791 length of segment : 969 time for calcul the mask position with numpy : 0.00908660888671875 nb_pixel_total : 416815 time to create 1 rle with new method : 0.014821052551269531 length of segment : 870 time for calcul the mask position with numpy : 0.00048828125 nb_pixel_total : 11362 time to create 1 rle with old method : 0.013434886932373047 length of segment : 209 time for calcul the mask position with numpy : 0.0010237693786621094 nb_pixel_total : 19940 time to create 1 rle with old method : 0.024399518966674805 length of segment : 372 time for calcul the mask position with numpy : 0.007991313934326172 nb_pixel_total : 511081 time to create 1 rle with new method : 0.013132333755493164 length of segment : 891 time for calcul the mask position with numpy : 0.0003349781036376953 nb_pixel_total : 10183 time to create 1 rle with old method : 0.012250423431396484 length of segment : 177 time for calcul the mask position with numpy : 0.00011897087097167969 nb_pixel_total : 2001 time to create 1 rle with old method : 0.002638578414916992 length of segment : 40 time for calcul the mask position with numpy : 0.0025517940521240234 nb_pixel_total : 115448 time to create 1 rle with old method : 0.13210821151733398 length of segment : 544 time for calcul the mask position with numpy : 0.0003361701965332031 nb_pixel_total : 10808 time to create 1 rle with old method : 0.012948989868164062 length of segment : 177 time for calcul the mask position with numpy : 0.010565042495727539 nb_pixel_total : 635254 time to create 1 rle with new method : 0.0162811279296875 length of segment : 915 time for calcul the mask position with numpy : 0.00021576881408691406 nb_pixel_total : 6217 time to create 1 rle with old method : 0.00740814208984375 length of segment : 85 time for calcul the mask position with numpy : 0.00014829635620117188 nb_pixel_total : 4441 time to create 1 rle with old method : 0.0055828094482421875 length of segment : 74 time for calcul the mask position with numpy : 0.002748727798461914 nb_pixel_total : 112357 time to create 1 rle with old method : 0.13025546073913574 length of segment : 554 time for calcul the mask position with numpy : 0.0005877017974853516 nb_pixel_total : 11999 time to create 1 rle with old method : 0.01484227180480957 length of segment : 128 time for calcul the mask position with numpy : 0.0004391670227050781 nb_pixel_total : 10840 time to create 1 rle with old method : 0.013318300247192383 length of segment : 178 time for calcul the mask position with numpy : 0.0004718303680419922 nb_pixel_total : 14753 time to create 1 rle with old method : 0.017391681671142578 length of segment : 159 time for calcul the mask position with numpy : 0.0006353855133056641 nb_pixel_total : 17671 time to create 1 rle with old method : 0.020369529724121094 length of segment : 284 time spent for convertir_results : 6.293122291564941 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 99 chid ids of type : 3594 Number RLEs to save : 24791 save missing photos in datou_result : time spend for datou_step_exec : 33.865055322647095 time spend to save output : 1.4364728927612305 total time spend for step 1 : 35.301528215408325 step2:crop_condition Wed Aug 13 19:41:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 23 ! batch 1 Loaded 99 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 43 About to insert : list_path_to_insert length 43 new photo from crops ! About to upload 43 photos upload in portfolio : 3736932 init cache_photo without model_param we have 43 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755106871_461067 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 43 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.466165542602539 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755106885_461067 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.059924602508545 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755106889_461067 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8865656852722168 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 36 About to insert : list_path_to_insert length 36 new photo from crops ! About to upload 36 photos upload in portfolio : 3736932 init cache_photo without model_param we have 36 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755106907_461067 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 36 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.831700801849365 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755106919_461067 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.4438507556915283 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1376786164, 1376786155, 1376786136, 1376786127, 1376786116, 1376785846, 1376785813, 1376785774, 1376785715, 1376785658, 1376785621, 1376785562, 1376785559, 1376785558, 1376785536, 1376785534, 1376785531, 1376785489, 1376785487, 1376785486, 1376785484, 1376785482, 1376785473] Looping around the photos to save general results len do output : 99 /1376802877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376802983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376803041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786164', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786155', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786136', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786127', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786116', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785846', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785813', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785774', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785715', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785658', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785621', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785562', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785559', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785558', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785536', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785534', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785531', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785489', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785487', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785486', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785484', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785482', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785473', None, None, None, None, None, '3521717') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 320 time used for this insertion : 0.02885270118713379 save_final save missing photos in datou_result : time spend for datou_step_exec : 54.819494009017944 time spend to save output : 0.03581357002258301 total time spend for step 2 : 54.85530757904053 step3:rle_unique_nms_with_priority Wed Aug 13 19:42:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 99 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 1.0209414958953857 time for calcul the mask position with numpy : 2.635723114013672 nb_pixel_total : 1305059 time to create 1 rle with new method : 1.3935725688934326 time for calcul the mask position with numpy : 0.07797455787658691 nb_pixel_total : 12119 time to create 1 rle with old method : 0.020505428314208984 time for calcul the mask position with numpy : 0.011151313781738281 nb_pixel_total : 4525 time to create 1 rle with old method : 0.018951892852783203 time for calcul the mask position with numpy : 0.008029699325561523 nb_pixel_total : 11102 time to create 1 rle with old method : 0.019066333770751953 time for calcul the mask position with numpy : 0.14194631576538086 nb_pixel_total : 729516 time to create 1 rle with new method : 1.261775016784668 time for calcul the mask position with numpy : 0.008026361465454102 nb_pixel_total : 11279 time to create 1 rle with old method : 0.014899730682373047 create new chi : 5.627641677856445 time to delete rle : 0.030889272689819336 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 4018 TO DO : save crop sub photo not yet done ! save time : 0.3633556365966797 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 1.0243327617645264 time for calcul the mask position with numpy : 0.2256317138671875 nb_pixel_total : 2049438 time to create 1 rle with new method : 1.5374488830566406 time for calcul the mask position with numpy : 0.009225606918334961 nb_pixel_total : 13492 time to create 1 rle with old method : 0.01681208610534668 time for calcul the mask position with numpy : 0.006192207336425781 nb_pixel_total : 10670 time to create 1 rle with old method : 0.012525081634521484 create new chi : 1.8121485710144043 time to delete rle : 0.00028824806213378906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1624 TO DO : save crop sub photo not yet done ! save time : 0.13747143745422363 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04001140594482422 time for calcul the mask position with numpy : 0.02197551727294922 nb_pixel_total : 2068592 time to create 1 rle with new method : 0.3690459728240967 time for calcul the mask position with numpy : 0.0062482357025146484 nb_pixel_total : 5008 time to create 1 rle with old method : 0.005629777908325195 create new chi : 0.40863847732543945 time to delete rle : 0.0002608299255371094 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1262 TO DO : save crop sub photo not yet done ! save time : 0.18047809600830078 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.6078200340270996 time for calcul the mask position with numpy : 0.08249807357788086 nb_pixel_total : 2002819 time to create 1 rle with new method : 0.30177950859069824 time for calcul the mask position with numpy : 0.006272792816162109 nb_pixel_total : 5732 time to create 1 rle with old method : 0.00693821907043457 time for calcul the mask position with numpy : 0.007821321487426758 nb_pixel_total : 20077 time to create 1 rle with old method : 0.02368950843811035 time for calcul the mask position with numpy : 0.011911392211914062 nb_pixel_total : 9841 time to create 1 rle with old method : 0.011282205581665039 time for calcul the mask position with numpy : 0.009763956069946289 nb_pixel_total : 10001 time to create 1 rle with old method : 0.01171255111694336 time for calcul the mask position with numpy : 0.010497093200683594 nb_pixel_total : 14117 time to create 1 rle with old method : 0.016396522521972656 time for calcul the mask position with numpy : 0.010158538818359375 nb_pixel_total : 11013 time to create 1 rle with old method : 0.013031959533691406 create new chi : 0.5333497524261475 time to delete rle : 0.00046825408935546875 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 2532 TO DO : save crop sub photo not yet done ! save time : 0.19385099411010742 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.06976962089538574 time for calcul the mask position with numpy : 0.020593643188476562 nb_pixel_total : 2035752 time to create 1 rle with new method : 0.15182757377624512 time for calcul the mask position with numpy : 0.0063402652740478516 nb_pixel_total : 17750 time to create 1 rle with old method : 0.020806312561035156 time for calcul the mask position with numpy : 0.009958505630493164 nb_pixel_total : 7393 time to create 1 rle with old method : 0.008417367935180664 time for calcul the mask position with numpy : 0.007302999496459961 nb_pixel_total : 12705 time to create 1 rle with old method : 0.014057636260986328 create new chi : 0.2547597885131836 time to delete rle : 0.0003707408905029297 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2022 TO DO : save crop sub photo not yet done ! save time : 0.1629321575164795 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 0.30219221115112305 time for calcul the mask position with numpy : 0.18028903007507324 nb_pixel_total : 1846251 time to create 1 rle with new method : 0.2746245861053467 time for calcul the mask position with numpy : 0.006385087966918945 nb_pixel_total : 14009 time to create 1 rle with old method : 0.016674041748046875 time for calcul the mask position with numpy : 0.006111860275268555 nb_pixel_total : 1870 time to create 1 rle with old method : 0.0024209022521972656 time for calcul the mask position with numpy : 0.006344318389892578 nb_pixel_total : 16192 time to create 1 rle with old method : 0.018948078155517578 time for calcul the mask position with numpy : 0.006672859191894531 nb_pixel_total : 112617 time to create 1 rle with old method : 0.13103628158569336 time for calcul the mask position with numpy : 0.0061626434326171875 nb_pixel_total : 11134 time to create 1 rle with old method : 0.012850046157836914 time for calcul the mask position with numpy : 0.0061686038970947266 nb_pixel_total : 50812 time to create 1 rle with old method : 0.060039520263671875 time for calcul the mask position with numpy : 0.006333112716674805 nb_pixel_total : 1340 time to create 1 rle with old method : 0.0015375614166259766 time for calcul the mask position with numpy : 0.006083250045776367 nb_pixel_total : 5323 time to create 1 rle with old method : 0.006350278854370117 time for calcul the mask position with numpy : 0.006239414215087891 nb_pixel_total : 14052 time to create 1 rle with old method : 0.016555070877075195 create new chi : 0.7867193222045898 time to delete rle : 0.0007464885711669922 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 4492 TO DO : save crop sub photo not yet done ! save time : 0.29976844787597656 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 0.08288121223449707 time for calcul the mask position with numpy : 0.07351422309875488 nb_pixel_total : 2021464 time to create 1 rle with new method : 0.1447455883026123 time for calcul the mask position with numpy : 0.006447553634643555 nb_pixel_total : 4982 time to create 1 rle with old method : 0.006142377853393555 time for calcul the mask position with numpy : 0.006368160247802734 nb_pixel_total : 13458 time to create 1 rle with old method : 0.015832185745239258 time for calcul the mask position with numpy : 0.00629734992980957 nb_pixel_total : 2942 time to create 1 rle with old method : 0.003633260726928711 time for calcul the mask position with numpy : 0.006416797637939453 nb_pixel_total : 8480 time to create 1 rle with old method : 0.010514020919799805 time for calcul the mask position with numpy : 0.006514787673950195 nb_pixel_total : 12355 time to create 1 rle with old method : 0.01519322395324707 time for calcul the mask position with numpy : 0.006207466125488281 nb_pixel_total : 3498 time to create 1 rle with old method : 0.0041086673736572266 time for calcul the mask position with numpy : 0.0061762332916259766 nb_pixel_total : 6421 time to create 1 rle with old method : 0.007531881332397461 create new chi : 0.3346867561340332 time to delete rle : 0.0004711151123046875 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 2626 TO DO : save crop sub photo not yet done ! save time : 0.19664621353149414 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.052434444427490234 time for calcul the mask position with numpy : 0.019774436950683594 nb_pixel_total : 2056363 time to create 1 rle with new method : 0.031450748443603516 time for calcul the mask position with numpy : 0.006751537322998047 nb_pixel_total : 517 time to create 1 rle with old method : 0.0006821155548095703 time for calcul the mask position with numpy : 0.006304264068603516 nb_pixel_total : 9389 time to create 1 rle with old method : 0.011134862899780273 time for calcul the mask position with numpy : 0.0067975521087646484 nb_pixel_total : 7331 time to create 1 rle with old method : 0.009086847305297852 create new chi : 0.09234833717346191 time to delete rle : 0.0003879070281982422 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2115 TO DO : save crop sub photo not yet done ! save time : 0.15968632698059082 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.2958698272705078 time for calcul the mask position with numpy : 0.09304594993591309 nb_pixel_total : 1935875 time to create 1 rle with new method : 0.11718487739562988 time for calcul the mask position with numpy : 0.0063784122467041016 nb_pixel_total : 13644 time to create 1 rle with old method : 0.01601243019104004 time for calcul the mask position with numpy : 0.021938323974609375 nb_pixel_total : 94902 time to create 1 rle with old method : 0.11554694175720215 time for calcul the mask position with numpy : 0.006308794021606445 nb_pixel_total : 6940 time to create 1 rle with old method : 0.008085966110229492 time for calcul the mask position with numpy : 0.0059757232666015625 nb_pixel_total : 13841 time to create 1 rle with old method : 0.015514373779296875 time for calcul the mask position with numpy : 0.00580286979675293 nb_pixel_total : 8398 time to create 1 rle with old method : 0.009613275527954102 create new chi : 0.4310343265533447 time to delete rle : 0.0005338191986083984 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3012 TO DO : save crop sub photo not yet done ! save time : 0.21171092987060547 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05059361457824707 time for calcul the mask position with numpy : 0.01934957504272461 nb_pixel_total : 2026011 time to create 1 rle with new method : 0.599625825881958 time for calcul the mask position with numpy : 0.006299257278442383 nb_pixel_total : 17513 time to create 1 rle with old method : 0.02056145668029785 time for calcul the mask position with numpy : 0.0061838626861572266 nb_pixel_total : 9378 time to create 1 rle with old method : 0.010846138000488281 time for calcul the mask position with numpy : 0.006314277648925781 nb_pixel_total : 20698 time to create 1 rle with old method : 0.02414417266845703 create new chi : 0.7001655101776123 time to delete rle : 0.0003502368927001953 batch 1 Loaded 7 chid ids of type : 3594 +++++++Number RLEs to save : 2116 TO DO : save crop sub photo not yet done ! save time : 0.15993738174438477 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 1.8768112659454346 time for calcul the mask position with numpy : 1.4183921813964844 nb_pixel_total : 1984729 time to create 1 rle with new method : 0.8574953079223633 time for calcul the mask position with numpy : 0.006220340728759766 nb_pixel_total : 7043 time to create 1 rle with old method : 0.007969141006469727 time for calcul the mask position with numpy : 0.006131649017333984 nb_pixel_total : 6566 time to create 1 rle with old method : 0.007330417633056641 time for calcul the mask position with numpy : 0.005927324295043945 nb_pixel_total : 4146 time to create 1 rle with old method : 0.0048351287841796875 time for calcul the mask position with numpy : 0.005929470062255859 nb_pixel_total : 15504 time to create 1 rle with old method : 0.01755523681640625 time for calcul the mask position with numpy : 0.006187915802001953 nb_pixel_total : 24225 time to create 1 rle with old method : 0.028185367584228516 time for calcul the mask position with numpy : 0.006076812744140625 nb_pixel_total : 8266 time to create 1 rle with old method : 0.009449481964111328 time for calcul the mask position with numpy : 0.005973339080810547 nb_pixel_total : 8140 time to create 1 rle with old method : 0.008929729461669922 time for calcul the mask position with numpy : 0.005794525146484375 nb_pixel_total : 8981 time to create 1 rle with old method : 0.010404586791992188 time for calcul the mask position with numpy : 0.005906581878662109 nb_pixel_total : 6000 time to create 1 rle with old method : 0.0071086883544921875 create new chi : 2.440825939178467 time to delete rle : 0.0006244182586669922 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 3577 TO DO : save crop sub photo not yet done ! save time : 0.2396693229675293 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05239534378051758 time for calcul the mask position with numpy : 0.014943361282348633 nb_pixel_total : 1340872 time to create 1 rle with new method : 0.030241966247558594 time for calcul the mask position with numpy : 0.010616540908813477 nb_pixel_total : 650231 time to create 1 rle with new method : 0.02829122543334961 time for calcul the mask position with numpy : 0.006421327590942383 nb_pixel_total : 78518 time to create 1 rle with old method : 0.08936572074890137 time for calcul the mask position with numpy : 0.006163120269775391 nb_pixel_total : 3979 time to create 1 rle with old method : 0.00472712516784668 create new chi : 0.19133710861206055 time to delete rle : 0.0006649494171142578 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4178 TO DO : save crop sub photo not yet done ! save time : 0.2662949562072754 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.06480765342712402 time for calcul the mask position with numpy : 0.018355369567871094 nb_pixel_total : 1938525 time to create 1 rle with new method : 0.0701909065246582 time for calcul the mask position with numpy : 0.006342411041259766 nb_pixel_total : 17564 time to create 1 rle with old method : 0.02027130126953125 time for calcul the mask position with numpy : 0.006107330322265625 nb_pixel_total : 5089 time to create 1 rle with old method : 0.005953311920166016 time for calcul the mask position with numpy : 0.008348703384399414 nb_pixel_total : 108450 time to create 1 rle with old method : 0.12056851387023926 time for calcul the mask position with numpy : 0.005818367004394531 nb_pixel_total : 3972 time to create 1 rle with old method : 0.004422187805175781 create new chi : 0.2730112075805664 time to delete rle : 0.0005393028259277344 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3018 TO DO : save crop sub photo not yet done ! save time : 0.20366907119750977 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.04561591148376465 time for calcul the mask position with numpy : 0.018479347229003906 nb_pixel_total : 1941589 time to create 1 rle with new method : 0.20470166206359863 time for calcul the mask position with numpy : 0.005987405776977539 nb_pixel_total : 1748 time to create 1 rle with old method : 0.002226591110229492 time for calcul the mask position with numpy : 0.00635981559753418 nb_pixel_total : 119916 time to create 1 rle with old method : 0.13940954208374023 time for calcul the mask position with numpy : 0.006168842315673828 nb_pixel_total : 10347 time to create 1 rle with old method : 0.01186227798461914 create new chi : 0.40280866622924805 time to delete rle : 0.0002849102020263672 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2755 TO DO : save crop sub photo not yet done ! save time : 0.18201255798339844 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.0724949836730957 time for calcul the mask position with numpy : 0.0388178825378418 nb_pixel_total : 1244136 time to create 1 rle with new method : 0.18912386894226074 time for calcul the mask position with numpy : 0.00633549690246582 nb_pixel_total : 1428 time to create 1 rle with old method : 0.0017039775848388672 time for calcul the mask position with numpy : 0.007220745086669922 nb_pixel_total : 6110 time to create 1 rle with old method : 0.0070226192474365234 time for calcul the mask position with numpy : 0.006598949432373047 nb_pixel_total : 92376 time to create 1 rle with old method : 0.10940885543823242 time for calcul the mask position with numpy : 0.006829977035522461 nb_pixel_total : 3493 time to create 1 rle with old method : 0.005903005599975586 time for calcul the mask position with numpy : 0.07068896293640137 nb_pixel_total : 726057 time to create 1 rle with new method : 0.14084863662719727 create new chi : 0.5990831851959229 time to delete rle : 0.0006387233734130859 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4408 TO DO : save crop sub photo not yet done ! save time : 0.2743690013885498 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06492066383361816 time for calcul the mask position with numpy : 0.026468753814697266 nb_pixel_total : 1956879 time to create 1 rle with new method : 0.26573657989501953 time for calcul the mask position with numpy : 0.006455183029174805 nb_pixel_total : 9338 time to create 1 rle with old method : 0.012331247329711914 time for calcul the mask position with numpy : 0.009810209274291992 nb_pixel_total : 1726 time to create 1 rle with old method : 0.003558635711669922 time for calcul the mask position with numpy : 0.008083820343017578 nb_pixel_total : 99118 time to create 1 rle with old method : 0.1156151294708252 time for calcul the mask position with numpy : 0.006158113479614258 nb_pixel_total : 6539 time to create 1 rle with old method : 0.008098125457763672 create new chi : 0.4691903591156006 time to delete rle : 0.0005114078521728516 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2733 TO DO : save crop sub photo not yet done ! save time : 0.1837761402130127 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.24919652938842773 time for calcul the mask position with numpy : 0.14400601387023926 nb_pixel_total : 1941830 time to create 1 rle with new method : 0.20968174934387207 time for calcul the mask position with numpy : 0.009607076644897461 nb_pixel_total : 1322 time to create 1 rle with old method : 0.0025787353515625 time for calcul the mask position with numpy : 0.009185075759887695 nb_pixel_total : 3958 time to create 1 rle with old method : 0.007361650466918945 time for calcul the mask position with numpy : 0.02729654312133789 nb_pixel_total : 122121 time to create 1 rle with old method : 0.156022310256958 time for calcul the mask position with numpy : 0.00794839859008789 nb_pixel_total : 4369 time to create 1 rle with old method : 0.005430698394775391 create new chi : 0.5975189208984375 time to delete rle : 0.0008625984191894531 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 2485 TO DO : save crop sub photo not yet done ! save time : 0.1659553050994873 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.2269761562347412 time for calcul the mask position with numpy : 0.10176944732666016 nb_pixel_total : 1910139 time to create 1 rle with new method : 0.09053373336791992 time for calcul the mask position with numpy : 0.006159067153930664 nb_pixel_total : 11972 time to create 1 rle with old method : 0.013765335083007812 time for calcul the mask position with numpy : 0.0060291290283203125 nb_pixel_total : 15619 time to create 1 rle with old method : 0.017919301986694336 time for calcul the mask position with numpy : 0.00644993782043457 nb_pixel_total : 109469 time to create 1 rle with old method : 0.1228036880493164 time for calcul the mask position with numpy : 0.005922794342041016 nb_pixel_total : 4567 time to create 1 rle with old method : 0.0052242279052734375 time for calcul the mask position with numpy : 0.006009340286254883 nb_pixel_total : 7018 time to create 1 rle with old method : 0.008048057556152344 time for calcul the mask position with numpy : 0.006281137466430664 nb_pixel_total : 14816 time to create 1 rle with old method : 0.01712322235107422 create new chi : 0.4227876663208008 time to delete rle : 0.0006613731384277344 batch 1 Loaded 13 chid ids of type : 3594 +++++++++++++Number RLEs to save : 3959 TO DO : save crop sub photo not yet done ! save time : 0.260775089263916 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04136776924133301 time for calcul the mask position with numpy : 0.016004085540771484 nb_pixel_total : 1362470 time to create 1 rle with new method : 0.029924392700195312 time for calcul the mask position with numpy : 0.012344598770141602 nb_pixel_total : 711130 time to create 1 rle with new method : 0.030277013778686523 create new chi : 0.08900165557861328 time to delete rle : 0.00030994415283203125 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3018 TO DO : save crop sub photo not yet done ! save time : 0.20673227310180664 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.042003631591796875 time for calcul the mask position with numpy : 0.04951906204223633 nb_pixel_total : 1656785 time to create 1 rle with new method : 0.0437929630279541 time for calcul the mask position with numpy : 0.009487152099609375 nb_pixel_total : 416815 time to create 1 rle with new method : 0.034078121185302734 create new chi : 0.14075732231140137 time to delete rle : 0.0003781318664550781 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 2820 TO DO : save crop sub photo not yet done ! save time : 0.19138789176940918 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.3674654960632324 time for calcul the mask position with numpy : 0.11282062530517578 nb_pixel_total : 1521034 time to create 1 rle with new method : 0.1998128890991211 time for calcul the mask position with numpy : 0.00632929801940918 nb_pixel_total : 10183 time to create 1 rle with old method : 0.01191091537475586 time for calcul the mask position with numpy : 0.009227752685546875 nb_pixel_total : 511081 time to create 1 rle with new method : 0.06774759292602539 time for calcul the mask position with numpy : 0.006247758865356445 nb_pixel_total : 19940 time to create 1 rle with old method : 0.023607492446899414 time for calcul the mask position with numpy : 0.0062160491943359375 nb_pixel_total : 11362 time to create 1 rle with old method : 0.013312101364135742 create new chi : 0.46541666984558105 time to delete rle : 0.0007803440093994141 batch 1 Loaded 9 chid ids of type : 3594 ++++++++Number RLEs to save : 4378 TO DO : save crop sub photo not yet done ! save time : 0.27430224418640137 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.11900758743286133 time for calcul the mask position with numpy : 0.04001951217651367 nb_pixel_total : 1299431 time to create 1 rle with new method : 0.21172165870666504 time for calcul the mask position with numpy : 0.006209373474121094 nb_pixel_total : 4441 time to create 1 rle with old method : 0.00554656982421875 time for calcul the mask position with numpy : 0.006103992462158203 nb_pixel_total : 6217 time to create 1 rle with old method : 0.008111238479614258 time for calcul the mask position with numpy : 0.013140678405761719 nb_pixel_total : 635254 time to create 1 rle with new method : 0.11368346214294434 time for calcul the mask position with numpy : 0.006076812744140625 nb_pixel_total : 10808 time to create 1 rle with old method : 0.012787818908691406 time for calcul the mask position with numpy : 0.006510496139526367 nb_pixel_total : 115448 time to create 1 rle with old method : 0.1380467414855957 time for calcul the mask position with numpy : 0.006173610687255859 nb_pixel_total : 2001 time to create 1 rle with old method : 0.0022830963134765625 create new chi : 0.5861668586730957 time to delete rle : 0.0008378028869628906 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4750 TO DO : save crop sub photo not yet done ! save time : 0.29781413078308105 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 0.06425595283508301 time for calcul the mask position with numpy : 0.018948078155517578 nb_pixel_total : 1905980 time to create 1 rle with new method : 0.1585080623626709 time for calcul the mask position with numpy : 0.0062978267669677734 nb_pixel_total : 17671 time to create 1 rle with old method : 0.02038121223449707 time for calcul the mask position with numpy : 0.0062103271484375 nb_pixel_total : 14753 time to create 1 rle with old method : 0.017187833786010742 time for calcul the mask position with numpy : 0.0062983036041259766 nb_pixel_total : 10840 time to create 1 rle with old method : 0.012485504150390625 time for calcul the mask position with numpy : 0.006101846694946289 nb_pixel_total : 11999 time to create 1 rle with old method : 0.013668537139892578 time for calcul the mask position with numpy : 0.0076181888580322266 nb_pixel_total : 112357 time to create 1 rle with old method : 0.1280372142791748 create new chi : 0.4124794006347656 time to delete rle : 0.0005524158477783203 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 3686 TO DO : save crop sub photo not yet done ! save time : 0.2365434169769287 map_output_result : {1376786164: (0.0, 'Should be the crop_list due to order', 0), 1376786155: (0.0, 'Should be the crop_list due to order', 0), 1376786136: (0.0, 'Should be the crop_list due to order', 0), 1376786127: (0.0, 'Should be the crop_list due to order', 0), 1376786116: (0.0, 'Should be the crop_list due to order', 0), 1376785846: (0.0, 'Should be the crop_list due to order', 0), 1376785813: (0.0, 'Should be the crop_list due to order', 0), 1376785774: (0.0, 'Should be the crop_list due to order', 0), 1376785715: (0.0, 'Should be the crop_list due to order', 0), 1376785658: (0.0, 'Should be the crop_list due to order', 0), 1376785621: (0.0, 'Should be the crop_list due to order', 0), 1376785562: (0.0, 'Should be the crop_list due to order', 0), 1376785559: (0.0, 'Should be the crop_list due to order', 0), 1376785558: (0.0, 'Should be the crop_list due to order', 0), 1376785536: (0.0, 'Should be the crop_list due to order', 0), 1376785534: (0.0, 'Should be the crop_list due to order', 0), 1376785531: (0.0, 'Should be the crop_list due to order', 0), 1376785489: (0.0, 'Should be the crop_list due to order', 0), 1376785487: (0.0, 'Should be the crop_list due to order', 0), 1376785486: (0.0, 'Should be the crop_list due to order', 0), 1376785484: (0.0, 'Should be the crop_list due to order', 0), 1376785482: (0.0, 'Should be the crop_list due to order', 0), 1376785473: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1376786164, 1376786155, 1376786136, 1376786127, 1376786116, 1376785846, 1376785813, 1376785774, 1376785715, 1376785658, 1376785621, 1376785562, 1376785559, 1376785558, 1376785536, 1376785534, 1376785531, 1376785489, 1376785487, 1376785486, 1376785484, 1376785482, 1376785473] Looping around the photos to save general results len do output : 23 /1376786164.Didn't retrieve data . /1376786155.Didn't retrieve data . /1376786136.Didn't retrieve data . /1376786127.Didn't retrieve data . /1376786116.Didn't retrieve data . /1376785846.Didn't retrieve data . /1376785813.Didn't retrieve data . /1376785774.Didn't retrieve data . /1376785715.Didn't retrieve data . /1376785658.Didn't retrieve data . /1376785621.Didn't retrieve data . /1376785562.Didn't retrieve data . /1376785559.Didn't retrieve data . /1376785558.Didn't retrieve data . /1376785536.Didn't retrieve data . /1376785534.Didn't retrieve data . /1376785531.Didn't retrieve data . /1376785489.Didn't retrieve data . /1376785487.Didn't retrieve data . /1376785486.Didn't retrieve data . /1376785484.Didn't retrieve data . /1376785482.Didn't retrieve data . /1376785473.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786164', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786155', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786136', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786127', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786116', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785846', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785813', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785774', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785715', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785658', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785621', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785562', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785559', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785558', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785536', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785534', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785531', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785489', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785487', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785486', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785484', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785482', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785473', None, None, None, None, None, '3521717') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 69 time used for this insertion : 0.014999628067016602 save_final save missing photos in datou_result : time spend for datou_step_exec : 31.121471643447876 time spend to save output : 0.022573232650756836 total time spend for step 3 : 31.144044876098633 step4:ventilate_hashtags_in_portfolio Wed Aug 13 19:42:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25946359 get user id for portfolio 25946359 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25946359 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','background','papier','flou','pet_fonce','carton','environnement','mal_croppe','pehd','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25946359 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','background','papier','flou','pet_fonce','carton','environnement','mal_croppe','pehd','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25946359 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','background','papier','flou','pet_fonce','carton','environnement','mal_croppe','pehd','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25946535,25946536,25946537,25946538,25946539,25946540,25946541,25946542,25946543,25946544,25946545?tags=pet_clair,metal,background,papier,flou,pet_fonce,carton,environnement,mal_croppe,pehd,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1376786164, 1376786155, 1376786136, 1376786127, 1376786116, 1376785846, 1376785813, 1376785774, 1376785715, 1376785658, 1376785621, 1376785562, 1376785559, 1376785558, 1376785536, 1376785534, 1376785531, 1376785489, 1376785487, 1376785486, 1376785484, 1376785482, 1376785473] Looping around the photos to save general results len do output : 1 /25946359. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786164', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786155', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786136', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786127', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786116', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785846', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785813', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785774', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785715', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785658', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785621', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785562', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785559', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785558', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785536', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785534', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785531', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785489', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785487', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785486', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785484', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785482', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785473', None, None, None, None, None, '3521717') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.015708446502685547 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.610870122909546 time spend to save output : 0.016113758087158203 total time spend for step 4 : 1.626983880996704 step5:final Wed Aug 13 19:42:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1376786164: ('0.13295040341519054',), 1376786155: ('0.13295040341519054',), 1376786136: ('0.13295040341519054',), 1376786127: ('0.13295040341519054',), 1376786116: ('0.13295040341519054',), 1376785846: ('0.13295040341519054',), 1376785813: ('0.13295040341519054',), 1376785774: ('0.13295040341519054',), 1376785715: ('0.13295040341519054',), 1376785658: ('0.13295040341519054',), 1376785621: ('0.13295040341519054',), 1376785562: ('0.13295040341519054',), 1376785559: ('0.13295040341519054',), 1376785558: ('0.13295040341519054',), 1376785536: ('0.13295040341519054',), 1376785534: ('0.13295040341519054',), 1376785531: ('0.13295040341519054',), 1376785489: ('0.13295040341519054',), 1376785487: ('0.13295040341519054',), 1376785486: ('0.13295040341519054',), 1376785484: ('0.13295040341519054',), 1376785482: ('0.13295040341519054',), 1376785473: ('0.13295040341519054',)} new output for save of step final : {1376786164: ('0.13295040341519054',), 1376786155: ('0.13295040341519054',), 1376786136: ('0.13295040341519054',), 1376786127: ('0.13295040341519054',), 1376786116: ('0.13295040341519054',), 1376785846: ('0.13295040341519054',), 1376785813: ('0.13295040341519054',), 1376785774: ('0.13295040341519054',), 1376785715: ('0.13295040341519054',), 1376785658: ('0.13295040341519054',), 1376785621: ('0.13295040341519054',), 1376785562: ('0.13295040341519054',), 1376785559: ('0.13295040341519054',), 1376785558: ('0.13295040341519054',), 1376785536: ('0.13295040341519054',), 1376785534: ('0.13295040341519054',), 1376785531: ('0.13295040341519054',), 1376785489: ('0.13295040341519054',), 1376785487: ('0.13295040341519054',), 1376785486: ('0.13295040341519054',), 1376785484: ('0.13295040341519054',), 1376785482: ('0.13295040341519054',), 1376785473: ('0.13295040341519054',)} [1376786164, 1376786155, 1376786136, 1376786127, 1376786116, 1376785846, 1376785813, 1376785774, 1376785715, 1376785658, 1376785621, 1376785562, 1376785559, 1376785558, 1376785536, 1376785534, 1376785531, 1376785489, 1376785487, 1376785486, 1376785484, 1376785482, 1376785473] Looping around the photos to save general results len do output : 23 /1376786164.Didn't retrieve data . /1376786155.Didn't retrieve data . /1376786136.Didn't retrieve data . /1376786127.Didn't retrieve data . /1376786116.Didn't retrieve data . /1376785846.Didn't retrieve data . /1376785813.Didn't retrieve data . /1376785774.Didn't retrieve data . /1376785715.Didn't retrieve data . /1376785658.Didn't retrieve data . /1376785621.Didn't retrieve data . /1376785562.Didn't retrieve data . /1376785559.Didn't retrieve data . /1376785558.Didn't retrieve data . /1376785536.Didn't retrieve data . /1376785534.Didn't retrieve data . /1376785531.Didn't retrieve data . /1376785489.Didn't retrieve data . /1376785487.Didn't retrieve data . /1376785486.Didn't retrieve data . /1376785484.Didn't retrieve data . /1376785482.Didn't retrieve data . /1376785473.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786164', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786155', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786136', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786127', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786116', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785846', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785813', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785774', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785715', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785658', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785621', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785562', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785559', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785558', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785536', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785534', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785531', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785489', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785487', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785486', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785484', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785482', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785473', None, None, None, None, None, '3521717') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 69 time used for this insertion : 0.014112234115600586 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11376357078552246 time spend to save output : 0.015012502670288086 total time spend for step 5 : 0.12877607345581055 step6:blur_detection Wed Aug 13 19:42:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1755106827_461067_1376786164_6efbcef827ae4c12497a460c324aca68.jpg resize: (1080, 1920) 1376786164 0.8358493934566986 treat image : temp/1755106827_461067_1376786155_b8eeb3a94eae848f973ba91b4d820b09.jpg resize: (1080, 1920) 1376786155 0.22835048839719246 treat image : temp/1755106827_461067_1376786136_d644939933a24a254fa881f32d77841d.jpg resize: (1080, 1920) 1376786136 -0.49725265229295895 treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27.jpg resize: (1080, 1920) 1376786127 0.16530817779417992 treat image : temp/1755106827_461067_1376786116_26f9e7a43e13d02d4ba1572e876a423c.jpg resize: (1080, 1920) 1376786116 -4.013119388343793 treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c.jpg resize: (1080, 1920) 1376785846 -2.7342580903929874 treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea.jpg resize: (1080, 1920) 1376785813 0.17126327765805746 treat image : temp/1755106827_461067_1376785774_dfa7ef8d6ce0c55922e09e4c3a0e4a5f.jpg resize: (1080, 1920) 1376785774 1.4137123817629718 treat image : temp/1755106827_461067_1376785715_68fcf7e3618f18ba6e28621146c79fca.jpg resize: (1080, 1920) 1376785715 -0.8178787109275975 treat image : temp/1755106827_461067_1376785658_768d491074ff32ee599fb4179e9720c9.jpg resize: (1080, 1920) 1376785658 0.3252896278257817 treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a.jpg resize: (1080, 1920) 1376785621 -3.5591444040271134 treat image : temp/1755106827_461067_1376785562_2b6ac3586ad87135b3ea8a31570737ad.jpg resize: (1080, 1920) 1376785562 -0.4624604765385062 treat image : temp/1755106827_461067_1376785559_0e22dc3ac18fd7dafe40a330732da79a.jpg resize: (1080, 1920) 1376785559 -4.471054995678268 treat image : temp/1755106827_461067_1376785558_9761c58763d8b7133da336907e392a7d.jpg resize: (1080, 1920) 1376785558 -2.506144087997529 treat image : temp/1755106827_461067_1376785536_564139ce5cceaa6fe908ad39644a2c21.jpg resize: (1080, 1920) 1376785536 -1.0865230320678205 treat image : temp/1755106827_461067_1376785534_6baa20def3fd6728d48517ea184889ce.jpg resize: (1080, 1920) 1376785534 -0.47468637658987356 treat image : temp/1755106827_461067_1376785531_728082286449d3e8c47348c1540f0fd8.jpg resize: (1080, 1920) 1376785531 -1.2073343185882457 treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075.jpg resize: (1080, 1920) 1376785489 -4.177089010835901 treat image : temp/1755106827_461067_1376785487_d7054e9903ed3bcf3246ce076df7cbd3.jpg resize: (1080, 1920) 1376785487 0.18441836988030003 treat image : temp/1755106827_461067_1376785486_d11d4b0337789216074f5936e78630bc.jpg resize: (1080, 1920) 1376785486 0.8294284600444134 treat image : temp/1755106827_461067_1376785484_2e47f0027de924a98bbbd001b01e6767.jpg resize: (1080, 1920) 1376785484 2.385122854025252 treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459.jpg resize: (1080, 1920) 1376785482 -3.7682275877751428 treat image : temp/1755106827_461067_1376785473_8ce711fce12b93e40da9b60c34fd63e1.jpg resize: (1080, 1920) 1376785473 -4.755168140544944 treat image : temp/1755106827_461067_1376786164_6efbcef827ae4c12497a460c324aca68_rle_crop_3913193612_0.png resize: (174, 105) 1376802877 -0.49211039938264683 treat image : temp/1755106827_461067_1376786164_6efbcef827ae4c12497a460c324aca68_rle_crop_3913193613_0.png resize: (969, 1043) 1376802878 -0.0787728488953038 treat image : temp/1755106827_461067_1376786164_6efbcef827ae4c12497a460c324aca68_rle_crop_3913193614_0.png resize: (94, 182) 1376802879 -2.1620501429588748 treat image : temp/1755106827_461067_1376786164_6efbcef827ae4c12497a460c324aca68_rle_crop_3913193616_0.png resize: (134, 131) 1376802880 -1.2764457619415355 treat image : temp/1755106827_461067_1376786155_b8eeb3a94eae848f973ba91b4d820b09_rle_crop_3913193617_0.png resize: (181, 108) 1376802881 -0.4850156886349357 treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27_rle_crop_3913193620_0.png resize: (181, 108) 1376802882 -0.4771760165392768 treat image : temp/1755106827_461067_1376786116_26f9e7a43e13d02d4ba1572e876a423c_rle_crop_3913193627_0.png resize: (119, 95) 1376802883 -1.9450956462198399 treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193629_0.png resize: (115, 170) 1376802884 -2.2609995782141077 treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193630_0.png resize: (74, 92) 1376802885 0.44187874468917804 treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193631_0.png resize: (39, 47) 1376802886 -1.2535279437223685 treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193635_0.png resize: (123, 174) 1376802887 -2.5184288475808194 treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193637_0.png resize: (132, 137) 1376802888 1.3924300500372795 treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193639_0.png resize: (59, 109) 1376802889 -3.046019363211265 treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193642_0.png resize: (56, 74) 1376802890 -1.819024636231839 treat image : temp/1755106827_461067_1376785774_dfa7ef8d6ce0c55922e09e4c3a0e4a5f_rle_crop_3913193645_0.png resize: (158, 102) 1376802891 -0.9588082616787464 treat image : temp/1755106827_461067_1376785774_dfa7ef8d6ce0c55922e09e4c3a0e4a5f_rle_crop_3913193646_0.png resize: (230, 67) 1376802892 -2.6438479479522248 treat image : temp/1755106827_461067_1376785715_68fcf7e3618f18ba6e28621146c79fca_rle_crop_3913193648_0.png resize: (66, 165) 1376802894 0.6381383515889777 treat image : temp/1755106827_461067_1376785715_68fcf7e3618f18ba6e28621146c79fca_rle_crop_3913193649_0.png resize: (137, 153) 1376802895 -1.336470918028736 treat image : temp/1755106827_461067_1376785715_68fcf7e3618f18ba6e28621146c79fca_rle_crop_3913193650_0.png resize: (81, 128) 1376802896 -1.7034294293172763 treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193656_0.png resize: (104, 78) 1376802897 -2.7862973886224016 treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193657_0.png resize: (93, 226) 1376802898 0.25957277323431116 treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193658_0.png resize: (176, 76) 1376802899 -4.668813882706717 treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193659_0.png resize: (115, 108) 1376802900 -1.441457778495127 treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193660_0.png resize: (178, 352) 1376802901 -3.2481269222062346 treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193663_0.png resize: (100, 98) 1376802902 -4.657319225001619 treat image : temp/1755106827_461067_1376785562_2b6ac3586ad87135b3ea8a31570737ad_rle_crop_3913193665_0.png resize: (86, 119) 1376802903 -1.4583001013800956 treat image : temp/1755106827_461067_1376785559_0e22dc3ac18fd7dafe40a330732da79a_rle_crop_3913193668_0.png resize: (75, 73) 1376802904 0.49815981679788085 treat image : temp/1755106827_461067_1376785559_0e22dc3ac18fd7dafe40a330732da79a_rle_crop_3913193671_0.png resize: (134, 192) 1376802905 -0.7899773047431741 treat image : temp/1755106827_461067_1376785558_9761c58763d8b7133da336907e392a7d_rle_crop_3913193672_0.png resize: (178, 106) 1376802906 -0.5609054686729465 treat image : temp/1755106827_461067_1376785534_6baa20def3fd6728d48517ea184889ce_rle_crop_3913193680_0.png resize: (103, 96) 1376802907 -1.5109709735970647 treat image : temp/1755106827_461067_1376785534_6baa20def3fd6728d48517ea184889ce_rle_crop_3913193682_0.png resize: (57, 49) 1376802908 -1.6814124832230208 treat image : temp/1755106827_461067_1376785534_6baa20def3fd6728d48517ea184889ce_rle_crop_3913193683_0.png resize: (171, 109) 1376802909 -0.9703625893025009 treat image : temp/1755106827_461067_1376785531_728082286449d3e8c47348c1540f0fd8_rle_crop_3913193684_0.png resize: (71, 94) 1376802910 -0.3616065176174756 treat image : temp/1755106827_461067_1376785531_728082286449d3e8c47348c1540f0fd8_rle_crop_3913193686_0.png resize: (66, 82) 1376802911 -3.319757841901159 treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075_rle_crop_3913193688_0.png resize: (106, 181) 1376802912 -0.2526611085730623 treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075_rle_crop_3913193689_0.png resize: (162, 84) 1376802913 -3.2784376209422867 treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075_rle_crop_3913193690_0.png resize: (135, 46) 1376802914 -0.21020695456011718 treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075_rle_crop_3913193693_0.png resize: (196, 181) 1376802915 -2.516398720697135 treat image : temp/1755106827_461067_1376785484_2e47f0027de924a98bbbd001b01e6767_rle_crop_3913193696_0.png resize: (198, 116) 1376802916 -1.9856409993673843 treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459_rle_crop_3913193702_0.png resize: (177, 112) 1376802917 -0.5504044911041984 treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459_rle_crop_3913193704_0.png resize: (85, 101) 1376802918 -1.391947446590371 treat image : temp/1755106827_461067_1376785473_8ce711fce12b93e40da9b60c34fd63e1_rle_crop_3913193707_0.png resize: (127, 149) 1376802919 -0.9412873704462155 treat image : temp/1755106827_461067_1376785473_8ce711fce12b93e40da9b60c34fd63e1_rle_crop_3913193708_0.png resize: (178, 115) 1376802920 -0.8399682223088918 treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27_rle_crop_3913193622_0.png resize: (171, 82) 1376802955 -1.3618177698870726 treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193633_0.png resize: (128, 113) 1376802956 -0.2573523014520058 treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193634_0.png resize: (545, 341) 1376802958 0.43149901484224956 treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193638_0.png resize: (101, 76) 1376802959 5.659866297290628 treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193640_0.png resize: (140, 133) 1376802960 -1.7299854931208627 treat image : temp/1755106827_461067_1376785658_768d491074ff32ee599fb4179e9720c9_rle_crop_3913193653_0.png resize: (203, 181) 1376802962 -2.678525149143483 treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193664_0.png resize: (74, 136) 1376802963 -1.239974797368013 treat image : temp/1755106827_461067_1376785559_0e22dc3ac18fd7dafe40a330732da79a_rle_crop_3913193670_0.png resize: (543, 339) 1376802964 0.12450031964556622 treat image : temp/1755106827_461067_1376785558_9761c58763d8b7133da336907e392a7d_rle_crop_3913193674_0.png resize: (498, 354) 1376802965 0.23676976911867278 treat image : temp/1755106827_461067_1376785536_564139ce5cceaa6fe908ad39644a2c21_rle_crop_3913193678_0.png resize: (115, 120) 1376802967 -2.5162849886675898 treat image : temp/1755106827_461067_1376785484_2e47f0027de924a98bbbd001b01e6767_rle_crop_3913193697_0.png resize: (372, 179) 1376802968 -1.068775871434053 treat image : temp/1755106827_461067_1376785484_2e47f0027de924a98bbbd001b01e6767_rle_crop_3913193698_0.png resize: (668, 1024) 1376802969 0.8794596096634282 treat image : temp/1755106827_461067_1376785473_8ce711fce12b93e40da9b60c34fd63e1_rle_crop_3913193710_0.png resize: (229, 113) 1376802971 -2.0562809921371707 treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193662_0.png resize: (93, 57) 1376802982 -2.872190997119461 treat image : temp/1755106827_461067_1376785531_728082286449d3e8c47348c1540f0fd8_rle_crop_3913193687_0.png resize: (35, 46) 1376802983 -3.5003098050309385 treat image : temp/1755106827_461067_1376786155_b8eeb3a94eae848f973ba91b4d820b09_rle_crop_3913193618_0.png resize: (89, 248) 1376803000 -2.613740557606909 treat image : temp/1755106827_461067_1376786136_d644939933a24a254fa881f32d77841d_rle_crop_3913193619_0.png resize: (91, 79) 1376803002 -2.158744712233272 treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27_rle_crop_3913193621_0.png resize: (92, 217) 1376803003 -1.9033304733484038 treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27_rle_crop_3913193623_0.png resize: (85, 163) 1376803004 -0.6940929387008408 treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27_rle_crop_3913193624_0.png resize: (134, 244) 1376803005 -2.528476536575012 treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27_rle_crop_3913193625_0.png resize: (40, 175) 1376803006 7.411342207443146 treat image : temp/1755106827_461067_1376786116_26f9e7a43e13d02d4ba1572e876a423c_rle_crop_3913193628_0.png resize: (154, 164) 1376803007 -3.9832147843336885 treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193632_0.png resize: (316, 544) 1376803008 -1.9271524367958102 treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193636_0.png resize: (542, 332) 1376803009 0.38723599672992054 treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193641_0.png resize: (98, 106) 1376803010 -1.871003981036538 treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193643_0.png resize: (173, 99) 1376803011 -1.2227715729983062 treat image : temp/1755106827_461067_1376785774_dfa7ef8d6ce0c55922e09e4c3a0e4a5f_rle_crop_3913193647_0.png resize: (223, 68) 1376803012 -2.6398128471477413 treat image : temp/1755106827_461067_1376785715_68fcf7e3618f18ba6e28621146c79fca_rle_crop_3913193651_0.png resize: (498, 328) 1376803013 0.106025679926955 treat image : temp/1755106827_461067_1376785715_68fcf7e3618f18ba6e28621146c79fca_rle_crop_3913193652_0.png resize: (173, 110) 1376803014 -0.9953105210139609 treat image : temp/1755106827_461067_1376785658_768d491074ff32ee599fb4179e9720c9_rle_crop_3913193654_0.png resize: (127, 107) 1376803015 -1.2357479457135376 treat image : temp/1755106827_461067_1376785658_768d491074ff32ee599fb4179e9720c9_rle_crop_3913193655_0.png resize: (71, 363) 1376803016 -0.6018099633423937 treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193661_0.png resize: (151, 152) 1376803017 -5.485219186943002 treat image : temp/1755106827_461067_1376785562_2b6ac3586ad87135b3ea8a31570737ad_rle_crop_3913193666_0.png resize: (470, 292) 1376803018 -0.47399013817936686 treat image : temp/1755106827_461067_1376785562_2b6ac3586ad87135b3ea8a31570737ad_rle_crop_3913193667_0.png resize: (929, 914) 1376803019 0.9742678582079748 treat image : temp/1755106827_461067_1376785559_0e22dc3ac18fd7dafe40a330732da79a_rle_crop_3913193669_0.png resize: (533, 337) 1376803020 0.25221048723760314 treat image : temp/1755106827_461067_1376785558_9761c58763d8b7133da336907e392a7d_rle_crop_3913193673_0.png resize: (531, 359) 1376803021 0.3036717745584469 treat image : temp/1755106827_461067_1376785536_564139ce5cceaa6fe908ad39644a2c21_rle_crop_3913193675_0.png resize: (964, 965) 1376803022 -0.07679938937702807 treat image : temp/1755106827_461067_1376785536_564139ce5cceaa6fe908ad39644a2c21_rle_crop_3913193676_0.png resize: (32, 125) 1376803023 3.2324978748843964 treat image : temp/1755106827_461067_1376785536_564139ce5cceaa6fe908ad39644a2c21_rle_crop_3913193677_0.png resize: (493, 319) 1376803024 -0.047677226828577036 treat image : temp/1755106827_461067_1376785536_564139ce5cceaa6fe908ad39644a2c21_rle_crop_3913193679_0.png resize: (42, 42) 1376803025 2.2976548062148123 treat image : temp/1755106827_461067_1376785534_6baa20def3fd6728d48517ea184889ce_rle_crop_3913193681_0.png resize: (510, 319) 1376803026 -0.22821573324033326 treat image : temp/1755106827_461067_1376785531_728082286449d3e8c47348c1540f0fd8_rle_crop_3913193685_0.png resize: (534, 374) 1376803027 -0.2014455343056777 treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075_rle_crop_3913193691_0.png resize: (554, 340) 1376803028 0.09846219496878153 treat image : temp/1755106827_461067_1376785487_d7054e9903ed3bcf3246ce076df7cbd3_rle_crop_3913193694_0.png resize: (962, 1040) 1376803029 0.303478395031414 treat image : temp/1755106827_461067_1376785486_d11d4b0337789216074f5936e78630bc_rle_crop_3913193695_0.png resize: (700, 822) 1376803030 0.7647495770974232 treat image : temp/1755106827_461067_1376785484_2e47f0027de924a98bbbd001b01e6767_rle_crop_3913193699_0.png resize: (177, 89) 1376803031 -0.7263903069412871 treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459_rle_crop_3913193700_0.png resize: (40, 72) 1376803032 -2.1895924185885733 treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459_rle_crop_3913193701_0.png resize: (544, 348) 1376803033 0.3785240691572974 treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459_rle_crop_3913193703_0.png resize: (907, 909) 1376803034 -0.06033297368620646 treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459_rle_crop_3913193705_0.png resize: (74, 90) 1376803035 -2.547350895916686 treat image : temp/1755106827_461067_1376785473_8ce711fce12b93e40da9b60c34fd63e1_rle_crop_3913193706_0.png resize: (553, 340) 1376803036 0.1599293033320994 treat image : temp/1755106827_461067_1376786164_6efbcef827ae4c12497a460c324aca68_rle_crop_3913193615_0.png resize: (139, 107) 1376803037 -2.7453945159255544 treat image : temp/1755106827_461067_1376786116_26f9e7a43e13d02d4ba1572e876a423c_rle_crop_3913193626_0.png resize: (136, 124) 1376803038 -3.600143849287695 treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193644_0.png resize: (107, 56) 1376803039 6.224598122104738 treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075_rle_crop_3913193692_0.png resize: (102, 228) 1376803040 -4.176236098305264 treat image : temp/1755106827_461067_1376785473_8ce711fce12b93e40da9b60c34fd63e1_rle_crop_3913193709_0.png resize: (144, 129) 1376803041 -3.7500220013488486 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 122 time used for this insertion : 0.01815176010131836 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 122 time used for this insertion : 0.027673959732055664 save missing photos in datou_result : time spend for datou_step_exec : 21.974331855773926 time spend to save output : 0.061536312103271484 total time spend for step 6 : 22.035868167877197 step7:brightness Wed Aug 13 19:42:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1755106827_461067_1376786164_6efbcef827ae4c12497a460c324aca68.jpg treat image : temp/1755106827_461067_1376786155_b8eeb3a94eae848f973ba91b4d820b09.jpg treat image : temp/1755106827_461067_1376786136_d644939933a24a254fa881f32d77841d.jpg treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27.jpg treat image : temp/1755106827_461067_1376786116_26f9e7a43e13d02d4ba1572e876a423c.jpg treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c.jpg treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea.jpg treat image : temp/1755106827_461067_1376785774_dfa7ef8d6ce0c55922e09e4c3a0e4a5f.jpg treat image : temp/1755106827_461067_1376785715_68fcf7e3618f18ba6e28621146c79fca.jpg treat image : temp/1755106827_461067_1376785658_768d491074ff32ee599fb4179e9720c9.jpg treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a.jpg treat image : temp/1755106827_461067_1376785562_2b6ac3586ad87135b3ea8a31570737ad.jpg treat image : temp/1755106827_461067_1376785559_0e22dc3ac18fd7dafe40a330732da79a.jpg treat image : temp/1755106827_461067_1376785558_9761c58763d8b7133da336907e392a7d.jpg treat image : temp/1755106827_461067_1376785536_564139ce5cceaa6fe908ad39644a2c21.jpg treat image : temp/1755106827_461067_1376785534_6baa20def3fd6728d48517ea184889ce.jpg treat image : temp/1755106827_461067_1376785531_728082286449d3e8c47348c1540f0fd8.jpg treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075.jpg treat image : temp/1755106827_461067_1376785487_d7054e9903ed3bcf3246ce076df7cbd3.jpg treat image : temp/1755106827_461067_1376785486_d11d4b0337789216074f5936e78630bc.jpg treat image : temp/1755106827_461067_1376785484_2e47f0027de924a98bbbd001b01e6767.jpg treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459.jpg treat image : temp/1755106827_461067_1376785473_8ce711fce12b93e40da9b60c34fd63e1.jpg treat image : temp/1755106827_461067_1376786164_6efbcef827ae4c12497a460c324aca68_rle_crop_3913193612_0.png treat image : temp/1755106827_461067_1376786164_6efbcef827ae4c12497a460c324aca68_rle_crop_3913193613_0.png treat image : temp/1755106827_461067_1376786164_6efbcef827ae4c12497a460c324aca68_rle_crop_3913193614_0.png treat image : temp/1755106827_461067_1376786164_6efbcef827ae4c12497a460c324aca68_rle_crop_3913193616_0.png treat image : temp/1755106827_461067_1376786155_b8eeb3a94eae848f973ba91b4d820b09_rle_crop_3913193617_0.png treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27_rle_crop_3913193620_0.png treat image : temp/1755106827_461067_1376786116_26f9e7a43e13d02d4ba1572e876a423c_rle_crop_3913193627_0.png treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193629_0.png treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193630_0.png treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193631_0.png treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193635_0.png treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193637_0.png treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193639_0.png treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193642_0.png treat image : temp/1755106827_461067_1376785774_dfa7ef8d6ce0c55922e09e4c3a0e4a5f_rle_crop_3913193645_0.png treat image : temp/1755106827_461067_1376785774_dfa7ef8d6ce0c55922e09e4c3a0e4a5f_rle_crop_3913193646_0.png treat image : temp/1755106827_461067_1376785715_68fcf7e3618f18ba6e28621146c79fca_rle_crop_3913193648_0.png treat image : temp/1755106827_461067_1376785715_68fcf7e3618f18ba6e28621146c79fca_rle_crop_3913193649_0.png treat image : temp/1755106827_461067_1376785715_68fcf7e3618f18ba6e28621146c79fca_rle_crop_3913193650_0.png treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193656_0.png treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193657_0.png treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193658_0.png treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193659_0.png treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193660_0.png treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193663_0.png treat image : temp/1755106827_461067_1376785562_2b6ac3586ad87135b3ea8a31570737ad_rle_crop_3913193665_0.png treat image : temp/1755106827_461067_1376785559_0e22dc3ac18fd7dafe40a330732da79a_rle_crop_3913193668_0.png treat image : temp/1755106827_461067_1376785559_0e22dc3ac18fd7dafe40a330732da79a_rle_crop_3913193671_0.png treat image : temp/1755106827_461067_1376785558_9761c58763d8b7133da336907e392a7d_rle_crop_3913193672_0.png treat image : temp/1755106827_461067_1376785534_6baa20def3fd6728d48517ea184889ce_rle_crop_3913193680_0.png treat image : temp/1755106827_461067_1376785534_6baa20def3fd6728d48517ea184889ce_rle_crop_3913193682_0.png treat image : temp/1755106827_461067_1376785534_6baa20def3fd6728d48517ea184889ce_rle_crop_3913193683_0.png treat image : temp/1755106827_461067_1376785531_728082286449d3e8c47348c1540f0fd8_rle_crop_3913193684_0.png treat image : temp/1755106827_461067_1376785531_728082286449d3e8c47348c1540f0fd8_rle_crop_3913193686_0.png treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075_rle_crop_3913193688_0.png treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075_rle_crop_3913193689_0.png treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075_rle_crop_3913193690_0.png treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075_rle_crop_3913193693_0.png treat image : temp/1755106827_461067_1376785484_2e47f0027de924a98bbbd001b01e6767_rle_crop_3913193696_0.png treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459_rle_crop_3913193702_0.png treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459_rle_crop_3913193704_0.png treat image : temp/1755106827_461067_1376785473_8ce711fce12b93e40da9b60c34fd63e1_rle_crop_3913193707_0.png treat image : temp/1755106827_461067_1376785473_8ce711fce12b93e40da9b60c34fd63e1_rle_crop_3913193708_0.png treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27_rle_crop_3913193622_0.png treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193633_0.png treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193634_0.png treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193638_0.png treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193640_0.png treat image : temp/1755106827_461067_1376785658_768d491074ff32ee599fb4179e9720c9_rle_crop_3913193653_0.png treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193664_0.png treat image : temp/1755106827_461067_1376785559_0e22dc3ac18fd7dafe40a330732da79a_rle_crop_3913193670_0.png treat image : temp/1755106827_461067_1376785558_9761c58763d8b7133da336907e392a7d_rle_crop_3913193674_0.png treat image : temp/1755106827_461067_1376785536_564139ce5cceaa6fe908ad39644a2c21_rle_crop_3913193678_0.png treat image : temp/1755106827_461067_1376785484_2e47f0027de924a98bbbd001b01e6767_rle_crop_3913193697_0.png treat image : temp/1755106827_461067_1376785484_2e47f0027de924a98bbbd001b01e6767_rle_crop_3913193698_0.png treat image : temp/1755106827_461067_1376785473_8ce711fce12b93e40da9b60c34fd63e1_rle_crop_3913193710_0.png treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193662_0.png treat image : temp/1755106827_461067_1376785531_728082286449d3e8c47348c1540f0fd8_rle_crop_3913193687_0.png treat image : temp/1755106827_461067_1376786155_b8eeb3a94eae848f973ba91b4d820b09_rle_crop_3913193618_0.png treat image : temp/1755106827_461067_1376786136_d644939933a24a254fa881f32d77841d_rle_crop_3913193619_0.png treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27_rle_crop_3913193621_0.png treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27_rle_crop_3913193623_0.png treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27_rle_crop_3913193624_0.png treat image : temp/1755106827_461067_1376786127_5e5da26e9b3abab723f1e9671559de27_rle_crop_3913193625_0.png treat image : temp/1755106827_461067_1376786116_26f9e7a43e13d02d4ba1572e876a423c_rle_crop_3913193628_0.png treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193632_0.png treat image : temp/1755106827_461067_1376785846_fe85b30be02a6784d726849ea916fe3c_rle_crop_3913193636_0.png treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193641_0.png treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193643_0.png treat image : temp/1755106827_461067_1376785774_dfa7ef8d6ce0c55922e09e4c3a0e4a5f_rle_crop_3913193647_0.png treat image : temp/1755106827_461067_1376785715_68fcf7e3618f18ba6e28621146c79fca_rle_crop_3913193651_0.png treat image : temp/1755106827_461067_1376785715_68fcf7e3618f18ba6e28621146c79fca_rle_crop_3913193652_0.png treat image : temp/1755106827_461067_1376785658_768d491074ff32ee599fb4179e9720c9_rle_crop_3913193654_0.png treat image : temp/1755106827_461067_1376785658_768d491074ff32ee599fb4179e9720c9_rle_crop_3913193655_0.png treat image : temp/1755106827_461067_1376785621_20699e7b7f9379688d14500c53fd015a_rle_crop_3913193661_0.png treat image : temp/1755106827_461067_1376785562_2b6ac3586ad87135b3ea8a31570737ad_rle_crop_3913193666_0.png treat image : temp/1755106827_461067_1376785562_2b6ac3586ad87135b3ea8a31570737ad_rle_crop_3913193667_0.png treat image : temp/1755106827_461067_1376785559_0e22dc3ac18fd7dafe40a330732da79a_rle_crop_3913193669_0.png treat image : temp/1755106827_461067_1376785558_9761c58763d8b7133da336907e392a7d_rle_crop_3913193673_0.png treat image : temp/1755106827_461067_1376785536_564139ce5cceaa6fe908ad39644a2c21_rle_crop_3913193675_0.png treat image : temp/1755106827_461067_1376785536_564139ce5cceaa6fe908ad39644a2c21_rle_crop_3913193676_0.png treat image : temp/1755106827_461067_1376785536_564139ce5cceaa6fe908ad39644a2c21_rle_crop_3913193677_0.png treat image : temp/1755106827_461067_1376785536_564139ce5cceaa6fe908ad39644a2c21_rle_crop_3913193679_0.png treat image : temp/1755106827_461067_1376785534_6baa20def3fd6728d48517ea184889ce_rle_crop_3913193681_0.png treat image : temp/1755106827_461067_1376785531_728082286449d3e8c47348c1540f0fd8_rle_crop_3913193685_0.png treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075_rle_crop_3913193691_0.png treat image : temp/1755106827_461067_1376785487_d7054e9903ed3bcf3246ce076df7cbd3_rle_crop_3913193694_0.png treat image : temp/1755106827_461067_1376785486_d11d4b0337789216074f5936e78630bc_rle_crop_3913193695_0.png treat image : temp/1755106827_461067_1376785484_2e47f0027de924a98bbbd001b01e6767_rle_crop_3913193699_0.png treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459_rle_crop_3913193700_0.png treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459_rle_crop_3913193701_0.png treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459_rle_crop_3913193703_0.png treat image : temp/1755106827_461067_1376785482_9dd06b72d4c3ade4bd9da3fddfcd4459_rle_crop_3913193705_0.png treat image : temp/1755106827_461067_1376785473_8ce711fce12b93e40da9b60c34fd63e1_rle_crop_3913193706_0.png treat image : temp/1755106827_461067_1376786164_6efbcef827ae4c12497a460c324aca68_rle_crop_3913193615_0.png treat image : temp/1755106827_461067_1376786116_26f9e7a43e13d02d4ba1572e876a423c_rle_crop_3913193626_0.png treat image : temp/1755106827_461067_1376785813_11ff742d1a60ca25f129e9c084bb8aea_rle_crop_3913193644_0.png treat image : temp/1755106827_461067_1376785489_4e2fb7e7ebc4372ecca5955051aa2075_rle_crop_3913193692_0.png treat image : temp/1755106827_461067_1376785473_8ce711fce12b93e40da9b60c34fd63e1_rle_crop_3913193709_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 122 time used for this insertion : 0.01936173439025879 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 122 time used for this insertion : 0.027962923049926758 save missing photos in datou_result : time spend for datou_step_exec : 7.013472318649292 time spend to save output : 0.05258631706237793 total time spend for step 7 : 7.06605863571167 step8:velours_tree Wed Aug 13 19:43:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.9375159740447998 time spend to save output : 0.00024962425231933594 total time spend for step 8 : 0.9377655982971191 step9:send_mail_cod Wed Aug 13 19:43:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25946359_13-08-2025_19_43_03.pdf 25946535 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259465351755106983 25946536 change filename to text .change filename to text .imagette259465361755106985 25946537 imagette259465371755106985 25946538 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259465381755106985 25946539 imagette259465391755106991 25946540 imagette259465401755106991 25946541 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259465411755106991 25946543 imagette259465431755106992 25946544 imagette259465441755106992 25946545 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259465451755106992 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25946359 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25946535,25946536,25946537,25946538,25946539,25946540,25946541,25946542,25946543,25946544,25946545?tags=pet_clair,metal,background,papier,flou,pet_fonce,carton,environnement,mal_croppe,pehd,autre args[1376786164] : ((1376786164, 0.8358493934566986, 492688767), (1376786164, 0.3336533626251921, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376786155] : ((1376786155, 0.22835048839719246, 492688767), (1376786155, 0.595452245809378, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376786136] : ((1376786136, -0.49725265229295895, 492688767), (1376786136, 0.5755995154204874, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376786127] : ((1376786127, 0.16530817779417992, 492688767), (1376786127, 0.6453569856604342, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376786116] : ((1376786116, -4.013119388343793, 492609224), (1376786116, 0.39605863870000757, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785846] : ((1376785846, -2.7342580903929874, 492609224), (1376785846, 0.47565693398352615, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785813] : ((1376785813, 0.17126327765805746, 492688767), (1376785813, 0.7048715819899231, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785774] : ((1376785774, 1.4137123817629718, 492688767), (1376785774, 0.6259771399087505, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785715] : ((1376785715, -0.8178787109275975, 492688767), (1376785715, 0.5936183051022755, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785658] : ((1376785658, 0.3252896278257817, 492688767), (1376785658, 0.5995119167712861, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785621] : ((1376785621, -3.5591444040271134, 492609224), (1376785621, 0.46730583777144524, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785562] : ((1376785562, -0.4624604765385062, 492688767), (1376785562, 0.6022162450346823, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785559] : ((1376785559, -4.471054995678268, 492609224), (1376785559, 0.6257432957648184, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785558] : ((1376785558, -2.506144087997529, 492609224), (1376785558, 0.40750093261669773, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785536] : ((1376785536, -1.0865230320678205, 492688767), (1376785536, 0.5961240444167182, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785534] : ((1376785534, -0.47468637658987356, 492688767), (1376785534, 0.32554275659403853, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785531] : ((1376785531, -1.2073343185882457, 492688767), (1376785531, 0.2140649285779238, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785489] : ((1376785489, -4.177089010835901, 492609224), (1376785489, 0.45063330859211487, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785487] : ((1376785487, 0.18441836988030003, 492688767), (1376785487, 0.36280536873208846, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785486] : ((1376785486, 0.8294284600444134, 492688767), (1376785486, 0.8667722437318491, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785484] : ((1376785484, 2.385122854025252, 492688767), (1376785484, 0.512109172660948, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785482] : ((1376785482, -3.7682275877751428, 492609224), (1376785482, 0.9563677639986156, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com args[1376785473] : ((1376785473, -4.755168140544944, 492609224), (1376785473, 0.3645135634680984, 2107752395), '0.13295040341519054') We are sending mail with results at report@fotonower.com refus_total : 0.13295040341519054 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25946359 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25946359_13-08-2025_19_43_03.pdf results_Auto_P25946359_13-08-2025_19_43_03.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25946359_13-08-2025_19_43_03.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25946359','results_Auto_P25946359_13-08-2025_19_43_03.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25946359_13-08-2025_19_43_03.pdf','pdf','','0.67','0.13295040341519054') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25946359

https://www.fotonower.com/image?json=false&list_photos_id=1376786164
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376786155
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376786136
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376786127
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376786116
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785846
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785813
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785774
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.4137123817629718)
https://www.fotonower.com/image?json=false&list_photos_id=1376785715
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785658
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785621
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785562
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785559
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785558
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785536
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785534
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785531
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785489
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785487
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785486
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785484
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.385122854025252)
https://www.fotonower.com/image?json=false&list_photos_id=1376785482
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376785473
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 13.30%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/25946535?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/25946536?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25946538?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25946541?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25946545?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25946359_13-08-2025_19_43_03.pdf.

Lien vers velours :https://www.fotonower.com/velours/25946535,25946536,25946537,25946538,25946539,25946540,25946541,25946542,25946543,25946544,25946545?tags=pet_clair,metal,background,papier,flou,pet_fonce,carton,environnement,mal_croppe,pehd,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 13 Aug 2025 17:43:15 GMT Content-Length: 0 Connection: close X-Message-Id: DVY3CeZfSKWmDT-81LOF8Q Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1376786164, 1376786155, 1376786136, 1376786127, 1376786116, 1376785846, 1376785813, 1376785774, 1376785715, 1376785658, 1376785621, 1376785562, 1376785559, 1376785558, 1376785536, 1376785534, 1376785531, 1376785489, 1376785487, 1376785486, 1376785484, 1376785482, 1376785473] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786164', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786155', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786136', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786127', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786116', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785846', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785813', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785774', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785715', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785658', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785621', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785562', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785559', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785558', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785536', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785534', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785531', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785489', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785487', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785486', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785484', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785482', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785473', None, None, None, None, None, '3521717') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 23 time used for this insertion : 0.0158383846282959 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.561938285827637 time spend to save output : 0.01639246940612793 total time spend for step 9 : 11.578330755233765 step10:split_time_score Wed Aug 13 19:43:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 23),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 13082025 25946359 Nombre de photos uploadées : 23 / 23040 (0%) 13082025 25946359 Nombre de photos taguées (types de déchets): 0 / 23 (0%) 13082025 25946359 Nombre de photos taguées (volume) : 0 / 23 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 7.3909759521484375e-06 ??????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0010223388671875 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20485997200012207 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.03972543724279837 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25940069_13-08-2025_18_07_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25940069 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25940069 AND mptpi.`type`=3594 To do Qualite : 0.12531488112461417 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25940073_13-08-2025_18_22_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25940073 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25940073 AND mptpi.`type`=3594 To do Qualite : 0.15611899736746548 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25940088_13-08-2025_18_27_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25940088 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25940088 AND mptpi.`type`=3594 To do Qualite : 0.06518625303130511 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25940104_13-08-2025_18_36_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25940104 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25940104 AND mptpi.`type`=3594 To do Qualite : 0.06725288784495279 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25940107_13-08-2025_18_47_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25940107 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25940107 AND mptpi.`type`=3594 To do Qualite : 0.04017532913773148 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25940112_13-08-2025_18_44_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25940112 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25940112 AND mptpi.`type`=3594 To do Qualite : 0.07134256044238685 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25940114_13-08-2025_18_31_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25940114 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25940114 AND mptpi.`type`=3594 To do Qualite : 0.13828178898874371 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25940122_13-08-2025_18_12_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25940122 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25940122 AND mptpi.`type`=3594 To do Qualite : 0.03090489227207978 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25940126_13-08-2025_18_01_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25940126 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25940126 AND mptpi.`type`=3594 To do Qualite : 0.18059592297567179 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25940133_13-08-2025_17_52_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25940133 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25940133 AND mptpi.`type`=3594 To do Qualite : 0.13602671682098766 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25940136_13-08-2025_17_41_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25940136 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25940136 AND mptpi.`type`=3594 To do Qualite : 0.12635289527216603 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25940143_13-08-2025_17_31_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25940143 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25940143 AND mptpi.`type`=3594 To do Qualite : 0.12353614267676769 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25940146_13-08-2025_17_21_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25940146 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25940146 AND mptpi.`type`=3594 To do Qualite : 0.08592171717171714 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25942158_13-08-2025_18_21_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25942158 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25942158 AND mptpi.`type`=3594 To do Qualite : 0.13295040341519054 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25946359_13-08-2025_19_43_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25946359 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25946359 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'13082025': {'nb_upload': 23, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1376786164, 1376786155, 1376786136, 1376786127, 1376786116, 1376785846, 1376785813, 1376785774, 1376785715, 1376785658, 1376785621, 1376785562, 1376785559, 1376785558, 1376785536, 1376785534, 1376785531, 1376785489, 1376785487, 1376785486, 1376785484, 1376785482, 1376785473] Looping around the photos to save general results len do output : 1 /25946359Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786164', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786155', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786136', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786127', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376786116', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785846', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785813', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785774', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785715', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785658', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785621', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785562', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785559', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785558', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785536', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785534', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785531', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785489', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785487', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785486', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785484', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785482', None, None, None, None, None, '3521717') ('3318', None, None, None, None, None, None, None, '3521717') ('3318', '25946359', '1376785473', None, None, None, None, None, '3521717') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.018044710159301758 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.2673530578613281 time spend to save output : 0.018343210220336914 total time spend for step 10 : 1.285696268081665 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 23 set_done_treatment 89.99user 41.15system 2:52.87elapsed 75%CPU (0avgtext+0avgdata 3177208maxresident)k 937512inputs+51168outputs (18355major+2257222minor)pagefaults 0swaps