python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3283195 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3749544'] with mtr_portfolio_ids : ['27058821'] and first list_photo_ids : [] new path : /proc/3283195/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 2.1132259368896484 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Sat Sep 20 00:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3777 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-20 00:20:34.102205: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-20 00:20:34.128725: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-20 00:20:34.130938: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7efbe0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-20 00:20:34.130997: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-20 00:20:34.135025: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-20 00:20:34.283862: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x76690f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-20 00:20:34.283913: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-20 00:20:34.284993: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-20 00:20:34.285401: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-20 00:20:34.288519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-20 00:20:34.291400: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-20 00:20:34.291902: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-20 00:20:34.294489: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-20 00:20:34.295483: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-20 00:20:34.299773: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-20 00:20:34.300865: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-20 00:20:34.300941: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-20 00:20:34.301525: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-20 00:20:34.301540: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-20 00:20:34.301550: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-20 00:20:34.302473: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3325 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-20 00:20:34.630277: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-20 00:20:34.630375: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-20 00:20:34.630402: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-20 00:20:34.630428: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-20 00:20:34.630452: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-20 00:20:34.630477: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-20 00:20:34.630501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-20 00:20:34.630525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-20 00:20:34.631959: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-20 00:20:34.633411: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-20 00:20:34.633470: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-20 00:20:34.633500: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-20 00:20:34.633528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-20 00:20:34.633554: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-20 00:20:34.633581: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-20 00:20:34.633608: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-20 00:20:34.633634: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-20 00:20:34.634605: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-20 00:20:34.634633: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-20 00:20:34.634641: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-20 00:20:34.634649: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-20 00:20:34.635567: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3325 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-20 00:20:43.762950: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-20 00:20:43.939772: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-20 00:20:45.316769: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.057409: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-09-20 00:20:46.123643: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.123723: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-20 00:20:46.124938: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.124970: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-20 00:20:46.132209: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-20 00:20:46.132248: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-20 00:20:46.138420: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.138440: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-20 00:20:46.139127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.139143: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-20 00:20:46.194421: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.194462: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-20 00:20:46.195115: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.195130: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-20 00:20:46.202970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.202990: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-20 00:20:46.203635: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.203650: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-20 00:20:46.220767: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.221530: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.222176: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.222811: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.227069: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.227763: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.228449: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.229142: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.230228: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.230243: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-09-20 00:20:46.240576: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.241224: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.250238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.250899: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.251546: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.252180: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.252840: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-20 00:20:46.253477: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.75G (2951282688 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 Detection mask done ! Trying to reset tf kernel 3283986 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1544 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3930 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0011420249938964844 nb_pixel_total : 35425 time to create 1 rle with old method : 0.04097700119018555 length of segment : 238 time for calcul the mask position with numpy : 0.004980802536010742 nb_pixel_total : 156320 time to create 1 rle with new method : 0.015257120132446289 length of segment : 765 time for calcul the mask position with numpy : 0.0026171207427978516 nb_pixel_total : 127061 time to create 1 rle with old method : 0.14081311225891113 length of segment : 444 time for calcul the mask position with numpy : 0.0017805099487304688 nb_pixel_total : 95919 time to create 1 rle with old method : 0.1097104549407959 length of segment : 480 time for calcul the mask position with numpy : 0.0011014938354492188 nb_pixel_total : 55037 time to create 1 rle with old method : 0.06868147850036621 length of segment : 276 time for calcul the mask position with numpy : 0.0011365413665771484 nb_pixel_total : 28751 time to create 1 rle with old method : 0.0399627685546875 length of segment : 281 time for calcul the mask position with numpy : 0.0015249252319335938 nb_pixel_total : 61819 time to create 1 rle with old method : 0.0867764949798584 length of segment : 570 time for calcul the mask position with numpy : 0.0003726482391357422 nb_pixel_total : 14824 time to create 1 rle with old method : 0.016820907592773438 length of segment : 128 time for calcul the mask position with numpy : 0.0004596710205078125 nb_pixel_total : 13225 time to create 1 rle with old method : 0.0156097412109375 length of segment : 143 time for calcul the mask position with numpy : 0.002308368682861328 nb_pixel_total : 110012 time to create 1 rle with old method : 0.15118074417114258 length of segment : 515 time for calcul the mask position with numpy : 0.0011489391326904297 nb_pixel_total : 37932 time to create 1 rle with old method : 0.04930877685546875 length of segment : 247 time for calcul the mask position with numpy : 0.0004703998565673828 nb_pixel_total : 15238 time to create 1 rle with old method : 0.02027606964111328 length of segment : 147 time for calcul the mask position with numpy : 0.0005214214324951172 nb_pixel_total : 26441 time to create 1 rle with old method : 0.0364527702331543 length of segment : 81 time for calcul the mask position with numpy : 0.0005571842193603516 nb_pixel_total : 20502 time to create 1 rle with old method : 0.026171207427978516 length of segment : 178 time for calcul the mask position with numpy : 0.0009884834289550781 nb_pixel_total : 48227 time to create 1 rle with old method : 0.0650169849395752 length of segment : 279 time for calcul the mask position with numpy : 0.0009760856628417969 nb_pixel_total : 40600 time to create 1 rle with old method : 0.04989194869995117 length of segment : 286 time for calcul the mask position with numpy : 0.0004277229309082031 nb_pixel_total : 14949 time to create 1 rle with old method : 0.018272876739501953 length of segment : 229 time for calcul the mask position with numpy : 0.0018475055694580078 nb_pixel_total : 106348 time to create 1 rle with old method : 0.12029194831848145 length of segment : 544 time for calcul the mask position with numpy : 0.0007326602935791016 nb_pixel_total : 29499 time to create 1 rle with old method : 0.03219151496887207 length of segment : 260 time for calcul the mask position with numpy : 0.0023491382598876953 nb_pixel_total : 125483 time to create 1 rle with old method : 0.14602923393249512 length of segment : 444 time for calcul the mask position with numpy : 0.0026865005493164062 nb_pixel_total : 136490 time to create 1 rle with old method : 0.1573646068572998 length of segment : 350 time for calcul the mask position with numpy : 0.001997709274291992 nb_pixel_total : 55021 time to create 1 rle with old method : 0.06256461143493652 length of segment : 268 time for calcul the mask position with numpy : 0.0014162063598632812 nb_pixel_total : 26063 time to create 1 rle with old method : 0.030230283737182617 length of segment : 181 time for calcul the mask position with numpy : 0.0011796951293945312 nb_pixel_total : 30976 time to create 1 rle with old method : 0.04134678840637207 length of segment : 148 time for calcul the mask position with numpy : 0.004916191101074219 nb_pixel_total : 135121 time to create 1 rle with old method : 0.15085172653198242 length of segment : 473 time for calcul the mask position with numpy : 0.0033800601959228516 nb_pixel_total : 98870 time to create 1 rle with old method : 0.11166620254516602 length of segment : 566 time for calcul the mask position with numpy : 0.002020597457885742 nb_pixel_total : 76623 time to create 1 rle with old method : 0.08742642402648926 length of segment : 319 time for calcul the mask position with numpy : 0.0006902217864990234 nb_pixel_total : 14297 time to create 1 rle with old method : 0.02343583106994629 length of segment : 153 time for calcul the mask position with numpy : 0.001970052719116211 nb_pixel_total : 55404 time to create 1 rle with old method : 0.06400227546691895 length of segment : 295 time for calcul the mask position with numpy : 0.0005447864532470703 nb_pixel_total : 16839 time to create 1 rle with old method : 0.02003312110900879 length of segment : 134 time for calcul the mask position with numpy : 0.0021181106567382812 nb_pixel_total : 74852 time to create 1 rle with old method : 0.08653140068054199 length of segment : 273 time for calcul the mask position with numpy : 0.0008912086486816406 nb_pixel_total : 28082 time to create 1 rle with old method : 0.03159594535827637 length of segment : 349 time for calcul the mask position with numpy : 0.001439809799194336 nb_pixel_total : 46254 time to create 1 rle with old method : 0.05380654335021973 length of segment : 211 time for calcul the mask position with numpy : 0.0004420280456542969 nb_pixel_total : 16090 time to create 1 rle with old method : 0.019004344940185547 length of segment : 86 time for calcul the mask position with numpy : 0.0027098655700683594 nb_pixel_total : 113985 time to create 1 rle with old method : 0.12990856170654297 length of segment : 336 time for calcul the mask position with numpy : 0.0026433467864990234 nb_pixel_total : 79407 time to create 1 rle with old method : 0.11292886734008789 length of segment : 577 time for calcul the mask position with numpy : 0.0007867813110351562 nb_pixel_total : 17468 time to create 1 rle with old method : 0.0208737850189209 length of segment : 148 time for calcul the mask position with numpy : 0.0019180774688720703 nb_pixel_total : 51602 time to create 1 rle with old method : 0.0592808723449707 length of segment : 270 time for calcul the mask position with numpy : 0.0013890266418457031 nb_pixel_total : 37827 time to create 1 rle with old method : 0.04329252243041992 length of segment : 226 time for calcul the mask position with numpy : 0.002621889114379883 nb_pixel_total : 84504 time to create 1 rle with old method : 0.09404444694519043 length of segment : 535 time for calcul the mask position with numpy : 0.0016353130340576172 nb_pixel_total : 39447 time to create 1 rle with old method : 0.04823899269104004 length of segment : 244 time for calcul the mask position with numpy : 0.003252744674682617 nb_pixel_total : 67306 time to create 1 rle with old method : 0.07676529884338379 length of segment : 380 time for calcul the mask position with numpy : 0.0010235309600830078 nb_pixel_total : 25808 time to create 1 rle with old method : 0.029247283935546875 length of segment : 235 time for calcul the mask position with numpy : 0.011284589767456055 nb_pixel_total : 262327 time to create 1 rle with new method : 0.011429309844970703 length of segment : 526 time for calcul the mask position with numpy : 0.002233266830444336 nb_pixel_total : 62441 time to create 1 rle with old method : 0.06977391242980957 length of segment : 553 time for calcul the mask position with numpy : 0.0016438961029052734 nb_pixel_total : 74455 time to create 1 rle with old method : 0.08390021324157715 length of segment : 290 time for calcul the mask position with numpy : 0.0025894641876220703 nb_pixel_total : 75365 time to create 1 rle with old method : 0.0872793197631836 length of segment : 453 time for calcul the mask position with numpy : 0.0014443397521972656 nb_pixel_total : 55574 time to create 1 rle with old method : 0.06483936309814453 length of segment : 248 time for calcul the mask position with numpy : 0.0006568431854248047 nb_pixel_total : 34094 time to create 1 rle with old method : 0.04244208335876465 length of segment : 208 time for calcul the mask position with numpy : 0.0005867481231689453 nb_pixel_total : 18641 time to create 1 rle with old method : 0.02223372459411621 length of segment : 163 time for calcul the mask position with numpy : 0.001623392105102539 nb_pixel_total : 39751 time to create 1 rle with old method : 0.04480576515197754 length of segment : 275 time for calcul the mask position with numpy : 0.001939535140991211 nb_pixel_total : 73667 time to create 1 rle with old method : 0.08441472053527832 length of segment : 458 time for calcul the mask position with numpy : 0.0005767345428466797 nb_pixel_total : 20586 time to create 1 rle with old method : 0.024168968200683594 length of segment : 119 time for calcul the mask position with numpy : 0.014474630355834961 nb_pixel_total : 314892 time to create 1 rle with new method : 0.027533531188964844 length of segment : 1147 time for calcul the mask position with numpy : 0.0020599365234375 nb_pixel_total : 65247 time to create 1 rle with old method : 0.07422447204589844 length of segment : 333 time for calcul the mask position with numpy : 0.004352092742919922 nb_pixel_total : 123847 time to create 1 rle with old method : 0.13866281509399414 length of segment : 407 time for calcul the mask position with numpy : 0.0013117790222167969 nb_pixel_total : 21394 time to create 1 rle with old method : 0.025015830993652344 length of segment : 357 time for calcul the mask position with numpy : 0.0026531219482421875 nb_pixel_total : 81344 time to create 1 rle with old method : 0.09254956245422363 length of segment : 462 time for calcul the mask position with numpy : 0.0035164356231689453 nb_pixel_total : 94578 time to create 1 rle with old method : 0.10908961296081543 length of segment : 368 time for calcul the mask position with numpy : 0.0015268325805664062 nb_pixel_total : 59831 time to create 1 rle with old method : 0.06856250762939453 length of segment : 369 time for calcul the mask position with numpy : 0.0011935234069824219 nb_pixel_total : 30961 time to create 1 rle with old method : 0.03542828559875488 length of segment : 271 time for calcul the mask position with numpy : 0.0010476112365722656 nb_pixel_total : 19519 time to create 1 rle with old method : 0.02304530143737793 length of segment : 244 time for calcul the mask position with numpy : 0.00046634674072265625 nb_pixel_total : 8602 time to create 1 rle with old method : 0.010470151901245117 length of segment : 97 time for calcul the mask position with numpy : 0.00035119056701660156 nb_pixel_total : 7826 time to create 1 rle with old method : 0.00922083854675293 length of segment : 106 time for calcul the mask position with numpy : 0.0006327629089355469 nb_pixel_total : 26758 time to create 1 rle with old method : 0.030866384506225586 length of segment : 198 time for calcul the mask position with numpy : 0.0033867359161376953 nb_pixel_total : 121484 time to create 1 rle with old method : 0.13689541816711426 length of segment : 556 time for calcul the mask position with numpy : 0.005856990814208984 nb_pixel_total : 182656 time to create 1 rle with new method : 0.011671066284179688 length of segment : 664 time for calcul the mask position with numpy : 0.003919124603271484 nb_pixel_total : 119582 time to create 1 rle with old method : 0.13390803337097168 length of segment : 438 time for calcul the mask position with numpy : 0.0007288455963134766 nb_pixel_total : 35593 time to create 1 rle with old method : 0.040421247482299805 length of segment : 267 time for calcul the mask position with numpy : 0.008915185928344727 nb_pixel_total : 224710 time to create 1 rle with new method : 0.028962373733520508 length of segment : 640 time for calcul the mask position with numpy : 0.005924701690673828 nb_pixel_total : 164451 time to create 1 rle with new method : 0.011438369750976562 length of segment : 549 time for calcul the mask position with numpy : 0.004090309143066406 nb_pixel_total : 176537 time to create 1 rle with new method : 0.008140087127685547 length of segment : 591 time for calcul the mask position with numpy : 0.021562576293945312 nb_pixel_total : 371656 time to create 1 rle with new method : 0.07149577140808105 length of segment : 1562 time for calcul the mask position with numpy : 0.0024995803833007812 nb_pixel_total : 102318 time to create 1 rle with old method : 0.11824798583984375 length of segment : 511 time for calcul the mask position with numpy : 0.002896547317504883 nb_pixel_total : 188701 time to create 1 rle with new method : 0.007519721984863281 length of segment : 674 time for calcul the mask position with numpy : 0.0004794597625732422 nb_pixel_total : 11485 time to create 1 rle with old method : 0.013351202011108398 length of segment : 167 time for calcul the mask position with numpy : 0.0029540061950683594 nb_pixel_total : 135835 time to create 1 rle with old method : 0.15306782722473145 length of segment : 431 time for calcul the mask position with numpy : 0.004204273223876953 nb_pixel_total : 162603 time to create 1 rle with new method : 0.005931377410888672 length of segment : 524 time for calcul the mask position with numpy : 0.0006327629089355469 nb_pixel_total : 17099 time to create 1 rle with old method : 0.019417762756347656 length of segment : 188 time for calcul the mask position with numpy : 0.0012638568878173828 nb_pixel_total : 44818 time to create 1 rle with old method : 0.051691532135009766 length of segment : 305 time for calcul the mask position with numpy : 0.0062885284423828125 nb_pixel_total : 296641 time to create 1 rle with new method : 0.02037501335144043 length of segment : 951 time for calcul the mask position with numpy : 0.0008752346038818359 nb_pixel_total : 28213 time to create 1 rle with old method : 0.03246760368347168 length of segment : 238 time for calcul the mask position with numpy : 0.0019464492797851562 nb_pixel_total : 68373 time to create 1 rle with old method : 0.07785606384277344 length of segment : 384 time for calcul the mask position with numpy : 0.00040078163146972656 nb_pixel_total : 9668 time to create 1 rle with old method : 0.011550188064575195 length of segment : 107 time for calcul the mask position with numpy : 0.0009789466857910156 nb_pixel_total : 32037 time to create 1 rle with old method : 0.03775835037231445 length of segment : 218 time for calcul the mask position with numpy : 0.0004992485046386719 nb_pixel_total : 13681 time to create 1 rle with old method : 0.01623249053955078 length of segment : 143 time for calcul the mask position with numpy : 0.0005204677581787109 nb_pixel_total : 14802 time to create 1 rle with old method : 0.017720699310302734 length of segment : 146 time for calcul the mask position with numpy : 0.003271341323852539 nb_pixel_total : 126497 time to create 1 rle with old method : 0.14414310455322266 length of segment : 434 time for calcul the mask position with numpy : 0.0034372806549072266 nb_pixel_total : 152024 time to create 1 rle with new method : 0.00668644905090332 length of segment : 303 time for calcul the mask position with numpy : 0.00177764892578125 nb_pixel_total : 75992 time to create 1 rle with old method : 0.08873200416564941 length of segment : 258 time for calcul the mask position with numpy : 0.002065420150756836 nb_pixel_total : 91070 time to create 1 rle with old method : 0.10542106628417969 length of segment : 280 time for calcul the mask position with numpy : 0.0024144649505615234 nb_pixel_total : 69814 time to create 1 rle with old method : 0.08186483383178711 length of segment : 375 time for calcul the mask position with numpy : 0.001651763916015625 nb_pixel_total : 75910 time to create 1 rle with old method : 0.08937764167785645 length of segment : 347 time for calcul the mask position with numpy : 0.0004100799560546875 nb_pixel_total : 13504 time to create 1 rle with old method : 0.018140316009521484 length of segment : 108 time spent for convertir_results : 12.191509008407593 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 94 chid ids of type : 3594 Number RLEs to save : 33303 save missing photos in datou_result : time spend for datou_step_exec : 68.75920534133911 time spend to save output : 3.2763986587524414 total time spend for step 1 : 72.03560400009155 step2:crop_condition Sat Sep 20 00:21:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 94 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 67 About to insert : list_path_to_insert length 67 new photo from crops ! About to upload 67 photos upload in portfolio : 3736932 init cache_photo without model_param we have 67 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758320528_3283195 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 67 photos in the portfolio 3736932 time of upload the photos Elapsed time : 18.26359748840332 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758320551_3283195 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.618955612182617 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758320556_3283195 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5507924556732178 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758320565_3283195 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.248640298843384 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1385175964, 1385175963, 1385175962, 1385175945, 1385175943, 1385175925, 1385175922, 1385175920, 1385175918, 1385175916] Looping around the photos to save general results len do output : 94 /1385186070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1385186196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175964', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175963', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175962', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175945', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175943', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175925', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175922', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175920', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175918', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175916', None, None, None, None, None, '3749544') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 292 time used for this insertion : 0.0392765998840332 save_final save missing photos in datou_result : time spend for datou_step_exec : 67.05645561218262 time spend to save output : 0.04182791709899902 total time spend for step 2 : 67.09828352928162 step3:rle_unique_nms_with_priority Sat Sep 20 00:22:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 94 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 9.176664113998413 time for calcul the mask position with numpy : 0.6838366985321045 nb_pixel_total : 7490953 time to create 1 rle with new method : 0.7178635597229004 time for calcul the mask position with numpy : 0.023958444595336914 nb_pixel_total : 48227 time to create 1 rle with old method : 0.05395054817199707 time for calcul the mask position with numpy : 0.023822784423828125 nb_pixel_total : 20502 time to create 1 rle with old method : 0.0229952335357666 time for calcul the mask position with numpy : 0.02375054359436035 nb_pixel_total : 26441 time to create 1 rle with old method : 0.032338857650756836 time for calcul the mask position with numpy : 0.03157782554626465 nb_pixel_total : 15238 time to create 1 rle with old method : 0.017184019088745117 time for calcul the mask position with numpy : 0.028693437576293945 nb_pixel_total : 37932 time to create 1 rle with old method : 0.042655229568481445 time for calcul the mask position with numpy : 0.028428077697753906 nb_pixel_total : 110012 time to create 1 rle with old method : 0.1226508617401123 time for calcul the mask position with numpy : 0.024656295776367188 nb_pixel_total : 13225 time to create 1 rle with old method : 0.014583587646484375 time for calcul the mask position with numpy : 0.025686264038085938 nb_pixel_total : 14824 time to create 1 rle with old method : 0.016337871551513672 time for calcul the mask position with numpy : 0.026342391967773438 nb_pixel_total : 61819 time to create 1 rle with old method : 0.06809449195861816 time for calcul the mask position with numpy : 0.024523496627807617 nb_pixel_total : 28751 time to create 1 rle with old method : 0.03139305114746094 time for calcul the mask position with numpy : 0.0242612361907959 nb_pixel_total : 11751 time to create 1 rle with old method : 0.013084888458251953 time for calcul the mask position with numpy : 0.028435945510864258 nb_pixel_total : 95919 time to create 1 rle with old method : 0.10535478591918945 time for calcul the mask position with numpy : 0.025501489639282227 nb_pixel_total : 127061 time to create 1 rle with old method : 0.14882826805114746 time for calcul the mask position with numpy : 0.028226375579833984 nb_pixel_total : 156320 time to create 1 rle with new method : 0.7358591556549072 time for calcul the mask position with numpy : 0.02404618263244629 nb_pixel_total : 35425 time to create 1 rle with old method : 0.037949562072753906 create new chi : 3.3196043968200684 time to delete rle : 0.027128219604492188 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 11277 TO DO : save crop sub photo not yet done ! save time : 0.9960010051727295 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 7.336907625198364 time for calcul the mask position with numpy : 0.6092410087585449 nb_pixel_total : 7494980 time to create 1 rle with new method : 0.9939966201782227 time for calcul the mask position with numpy : 0.02408313751220703 nb_pixel_total : 98870 time to create 1 rle with old method : 0.10601973533630371 time for calcul the mask position with numpy : 0.024344205856323242 nb_pixel_total : 135121 time to create 1 rle with old method : 0.14143085479736328 time for calcul the mask position with numpy : 0.022954940795898438 nb_pixel_total : 30976 time to create 1 rle with old method : 0.03219723701477051 time for calcul the mask position with numpy : 0.02300286293029785 nb_pixel_total : 26063 time to create 1 rle with old method : 0.027761459350585938 time for calcul the mask position with numpy : 0.023530244827270508 nb_pixel_total : 55021 time to create 1 rle with old method : 0.05906414985656738 time for calcul the mask position with numpy : 0.024791717529296875 nb_pixel_total : 136490 time to create 1 rle with old method : 0.1507115364074707 time for calcul the mask position with numpy : 0.024821758270263672 nb_pixel_total : 125483 time to create 1 rle with old method : 0.13654685020446777 time for calcul the mask position with numpy : 0.024240970611572266 nb_pixel_total : 29499 time to create 1 rle with old method : 0.031972408294677734 time for calcul the mask position with numpy : 0.024614810943603516 nb_pixel_total : 106348 time to create 1 rle with old method : 0.11372113227844238 time for calcul the mask position with numpy : 0.024531126022338867 nb_pixel_total : 14949 time to create 1 rle with old method : 0.016449689865112305 time for calcul the mask position with numpy : 0.024326562881469727 nb_pixel_total : 40600 time to create 1 rle with old method : 0.043854475021362305 create new chi : 2.7710063457489014 time to delete rle : 0.0013575553894042969 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 9658 TO DO : save crop sub photo not yet done ! save time : 0.6027674674987793 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 4.560808181762695 time for calcul the mask position with numpy : 0.876624584197998 nb_pixel_total : 7852751 time to create 1 rle with new method : 1.1991770267486572 time for calcul the mask position with numpy : 0.024601459503173828 nb_pixel_total : 113208 time to create 1 rle with old method : 0.1308305263519287 time for calcul the mask position with numpy : 0.023255348205566406 nb_pixel_total : 16090 time to create 1 rle with old method : 0.01985025405883789 time for calcul the mask position with numpy : 0.024239063262939453 nb_pixel_total : 46254 time to create 1 rle with old method : 0.059600830078125 time for calcul the mask position with numpy : 0.025649070739746094 nb_pixel_total : 28082 time to create 1 rle with old method : 0.03479576110839844 time for calcul the mask position with numpy : 0.025439023971557617 nb_pixel_total : 74852 time to create 1 rle with old method : 0.09180402755737305 time for calcul the mask position with numpy : 0.027472972869873047 nb_pixel_total : 16839 time to create 1 rle with old method : 0.019249439239501953 time for calcul the mask position with numpy : 0.028040170669555664 nb_pixel_total : 55404 time to create 1 rle with old method : 0.06286883354187012 time for calcul the mask position with numpy : 0.028745651245117188 nb_pixel_total : 14297 time to create 1 rle with old method : 0.015959978103637695 time for calcul the mask position with numpy : 0.029032468795776367 nb_pixel_total : 76623 time to create 1 rle with old method : 0.08538365364074707 create new chi : 2.876343011856079 time to delete rle : 0.0008833408355712891 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++Number RLEs to save : 6424 TO DO : save crop sub photo not yet done ! save time : 0.41260766983032227 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 4.568907976150513 time for calcul the mask position with numpy : 0.766542911529541 nb_pixel_total : 7984145 time to create 1 rle with new method : 0.7883572578430176 time for calcul the mask position with numpy : 0.025522947311401367 nb_pixel_total : 39447 time to create 1 rle with old method : 0.044112443923950195 time for calcul the mask position with numpy : 0.024672985076904297 nb_pixel_total : 84504 time to create 1 rle with old method : 0.09517312049865723 time for calcul the mask position with numpy : 0.024464845657348633 nb_pixel_total : 37827 time to create 1 rle with old method : 0.041457176208496094 time for calcul the mask position with numpy : 0.024575471878051758 nb_pixel_total : 51602 time to create 1 rle with old method : 0.05925250053405762 time for calcul the mask position with numpy : 0.024428367614746094 nb_pixel_total : 17468 time to create 1 rle with old method : 0.019313335418701172 time for calcul the mask position with numpy : 0.024223804473876953 nb_pixel_total : 79407 time to create 1 rle with old method : 0.08998513221740723 create new chi : 2.1022026538848877 time to delete rle : 0.0008711814880371094 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 6149 TO DO : save crop sub photo not yet done ! save time : 0.6612882614135742 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 7.071096420288086 time for calcul the mask position with numpy : 0.6942248344421387 nb_pixel_total : 7178368 time to create 1 rle with new method : 0.7624721527099609 time for calcul the mask position with numpy : 0.029558420181274414 nb_pixel_total : 314892 time to create 1 rle with new method : 0.7749912738800049 time for calcul the mask position with numpy : 0.025157451629638672 nb_pixel_total : 20586 time to create 1 rle with old method : 0.023797988891601562 time for calcul the mask position with numpy : 0.026202917098999023 nb_pixel_total : 73667 time to create 1 rle with old method : 0.09674692153930664 time for calcul the mask position with numpy : 0.027846813201904297 nb_pixel_total : 39751 time to create 1 rle with old method : 0.05094742774963379 time for calcul the mask position with numpy : 0.027922868728637695 nb_pixel_total : 18641 time to create 1 rle with old method : 0.0261383056640625 time for calcul the mask position with numpy : 0.02958226203918457 nb_pixel_total : 25230 time to create 1 rle with old method : 0.030048847198486328 time for calcul the mask position with numpy : 0.024719715118408203 nb_pixel_total : 55574 time to create 1 rle with old method : 0.061913490295410156 time for calcul the mask position with numpy : 0.025561094284057617 nb_pixel_total : 75365 time to create 1 rle with old method : 0.0898582935333252 time for calcul the mask position with numpy : 0.025336027145385742 nb_pixel_total : 74444 time to create 1 rle with old method : 0.09205412864685059 time for calcul the mask position with numpy : 0.02502298355102539 nb_pixel_total : 62441 time to create 1 rle with old method : 0.07200121879577637 time for calcul the mask position with numpy : 0.026616334915161133 nb_pixel_total : 262327 time to create 1 rle with new method : 0.9646317958831787 time for calcul the mask position with numpy : 0.025589942932128906 nb_pixel_total : 25808 time to create 1 rle with old method : 0.029223203659057617 time for calcul the mask position with numpy : 0.02755594253540039 nb_pixel_total : 67306 time to create 1 rle with old method : 0.08299398422241211 create new chi : 4.299722909927368 time to delete rle : 0.001886129379272461 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 12198 TO DO : save crop sub photo not yet done ! save time : 1.0037822723388672 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 7.885939598083496 time for calcul the mask position with numpy : 0.6220231056213379 nb_pixel_total : 7314523 time to create 1 rle with new method : 0.8573205471038818 time for calcul the mask position with numpy : 0.02385878562927246 nb_pixel_total : 35593 time to create 1 rle with old method : 0.0437314510345459 time for calcul the mask position with numpy : 0.026372671127319336 nb_pixel_total : 119582 time to create 1 rle with old method : 0.13495087623596191 time for calcul the mask position with numpy : 0.024461030960083008 nb_pixel_total : 163909 time to create 1 rle with new method : 0.6867179870605469 time for calcul the mask position with numpy : 0.02562427520751953 nb_pixel_total : 121484 time to create 1 rle with old method : 0.1502058506011963 time for calcul the mask position with numpy : 0.02417135238647461 nb_pixel_total : 26758 time to create 1 rle with old method : 0.03281354904174805 time for calcul the mask position with numpy : 0.02460455894470215 nb_pixel_total : 7826 time to create 1 rle with old method : 0.009664058685302734 time for calcul the mask position with numpy : 0.026934146881103516 nb_pixel_total : 8602 time to create 1 rle with old method : 0.011552810668945312 time for calcul the mask position with numpy : 0.026268720626831055 nb_pixel_total : 19519 time to create 1 rle with old method : 0.02513909339904785 time for calcul the mask position with numpy : 0.025467395782470703 nb_pixel_total : 30961 time to create 1 rle with old method : 0.03789567947387695 time for calcul the mask position with numpy : 0.026179790496826172 nb_pixel_total : 59233 time to create 1 rle with old method : 0.07422971725463867 time for calcul the mask position with numpy : 0.02503204345703125 nb_pixel_total : 94578 time to create 1 rle with old method : 0.10574555397033691 time for calcul the mask position with numpy : 0.02622079849243164 nb_pixel_total : 81344 time to create 1 rle with old method : 0.09097027778625488 time for calcul the mask position with numpy : 0.027236223220825195 nb_pixel_total : 21394 time to create 1 rle with old method : 0.024425029754638672 time for calcul the mask position with numpy : 0.025145292282104492 nb_pixel_total : 123847 time to create 1 rle with old method : 0.13328170776367188 time for calcul the mask position with numpy : 0.02526259422302246 nb_pixel_total : 65247 time to create 1 rle with old method : 0.0707390308380127 create new chi : 3.566305637359619 time to delete rle : 0.0016779899597167969 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 12269 TO DO : save crop sub photo not yet done ! save time : 0.8491449356079102 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 6.125077724456787 time for calcul the mask position with numpy : 0.903864860534668 nb_pixel_total : 7436676 time to create 1 rle with new method : 0.7238297462463379 time for calcul the mask position with numpy : 0.025218963623046875 nb_pixel_total : 11485 time to create 1 rle with old method : 0.013584613800048828 time for calcul the mask position with numpy : 0.025237321853637695 nb_pixel_total : 1072 time to create 1 rle with old method : 0.0014095306396484375 time for calcul the mask position with numpy : 0.02376103401184082 nb_pixel_total : 102318 time to create 1 rle with old method : 0.11197662353515625 time for calcul the mask position with numpy : 0.026111602783203125 nb_pixel_total : 177151 time to create 1 rle with new method : 0.8279180526733398 time for calcul the mask position with numpy : 0.024768829345703125 nb_pixel_total : 176537 time to create 1 rle with new method : 0.7452573776245117 time for calcul the mask position with numpy : 0.030814170837402344 nb_pixel_total : 164451 time to create 1 rle with new method : 0.6787662506103516 time for calcul the mask position with numpy : 0.026304244995117188 nb_pixel_total : 224710 time to create 1 rle with new method : 0.894573450088501 create new chi : 5.238255739212036 time to delete rle : 0.001561880111694336 batch 1 Loaded 15 chid ids of type : 3594 +++++++++++++Number RLEs to save : 9483 TO DO : save crop sub photo not yet done ! save time : 0.6386635303497314 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 3.4700822830200195 time for calcul the mask position with numpy : 1.003068208694458 nb_pixel_total : 7648166 time to create 1 rle with new method : 0.6890881061553955 time for calcul the mask position with numpy : 0.0420072078704834 nb_pixel_total : 28213 time to create 1 rle with old method : 0.031197547912597656 time for calcul the mask position with numpy : 0.026629209518432617 nb_pixel_total : 257666 time to create 1 rle with new method : 1.0981686115264893 time for calcul the mask position with numpy : 0.03829002380371094 nb_pixel_total : 44818 time to create 1 rle with old method : 0.04888629913330078 time for calcul the mask position with numpy : 0.03785109519958496 nb_pixel_total : 17099 time to create 1 rle with old method : 0.018759489059448242 time for calcul the mask position with numpy : 0.04305434226989746 nb_pixel_total : 162603 time to create 1 rle with new method : 0.6554796695709229 time for calcul the mask position with numpy : 0.03758978843688965 nb_pixel_total : 135835 time to create 1 rle with old method : 0.15262508392333984 create new chi : 4.024121284484863 time to delete rle : 0.0017094612121582031 batch 1 Loaded 13 chid ids of type : 3594 ++++++++++Number RLEs to save : 7255 TO DO : save crop sub photo not yet done ! save time : 0.591083288192749 nb_obj : 6 nb_hashtags : 1 time to prepare the origin masks : 3.5279107093811035 time for calcul the mask position with numpy : 0.5913655757904053 nb_pixel_total : 8029342 time to create 1 rle with new method : 0.8346836566925049 time for calcul the mask position with numpy : 0.04102730751037598 nb_pixel_total : 126497 time to create 1 rle with old method : 0.13728690147399902 time for calcul the mask position with numpy : 0.02465033531188965 nb_pixel_total : 14802 time to create 1 rle with old method : 0.01631331443786621 time for calcul the mask position with numpy : 0.02485942840576172 nb_pixel_total : 13681 time to create 1 rle with old method : 0.014961719512939453 time for calcul the mask position with numpy : 0.024672269821166992 nb_pixel_total : 32037 time to create 1 rle with old method : 0.035782575607299805 time for calcul the mask position with numpy : 0.02545452117919922 nb_pixel_total : 9668 time to create 1 rle with old method : 0.010828256607055664 time for calcul the mask position with numpy : 0.027048110961914062 nb_pixel_total : 68373 time to create 1 rle with old method : 0.07557249069213867 create new chi : 1.9294097423553467 time to delete rle : 0.0008099079132080078 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5024 TO DO : save crop sub photo not yet done ! save time : 0.3519022464752197 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 5.055605173110962 time for calcul the mask position with numpy : 0.6143522262573242 nb_pixel_total : 7816086 time to create 1 rle with new method : 0.9367408752441406 time for calcul the mask position with numpy : 0.04097461700439453 nb_pixel_total : 13504 time to create 1 rle with old method : 0.015405893325805664 time for calcul the mask position with numpy : 0.04128265380859375 nb_pixel_total : 75910 time to create 1 rle with old method : 0.09349322319030762 time for calcul the mask position with numpy : 0.045940399169921875 nb_pixel_total : 69814 time to create 1 rle with old method : 0.08089447021484375 time for calcul the mask position with numpy : 0.04009270668029785 nb_pixel_total : 91070 time to create 1 rle with old method : 0.10314083099365234 time for calcul the mask position with numpy : 0.039010047912597656 nb_pixel_total : 75992 time to create 1 rle with old method : 0.08535504341125488 time for calcul the mask position with numpy : 0.027338743209838867 nb_pixel_total : 152024 time to create 1 rle with new method : 0.8797993659973145 create new chi : 3.1197569370269775 time to delete rle : 0.001607656478881836 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5502 TO DO : save crop sub photo not yet done ! save time : 0.3963651657104492 map_output_result : {1385175964: (0.0, 'Should be the crop_list due to order', 0), 1385175963: (0.0, 'Should be the crop_list due to order', 0), 1385175962: (0.0, 'Should be the crop_list due to order', 0), 1385175945: (0.0, 'Should be the crop_list due to order', 0), 1385175943: (0.0, 'Should be the crop_list due to order', 0), 1385175925: (0.0, 'Should be the crop_list due to order', 0), 1385175922: (0.0, 'Should be the crop_list due to order', 0), 1385175920: (0.0, 'Should be the crop_list due to order', 0), 1385175918: (0.0, 'Should be the crop_list due to order', 0), 1385175916: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1385175964, 1385175963, 1385175962, 1385175945, 1385175943, 1385175925, 1385175922, 1385175920, 1385175918, 1385175916] Looping around the photos to save general results len do output : 10 /1385175964.Didn't retrieve data . /1385175963.Didn't retrieve data . /1385175962.Didn't retrieve data . /1385175945.Didn't retrieve data . /1385175943.Didn't retrieve data . /1385175925.Didn't retrieve data . /1385175922.Didn't retrieve data . /1385175920.Didn't retrieve data . /1385175918.Didn't retrieve data . /1385175916.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175964', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175963', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175962', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175945', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175943', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175925', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175922', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175920', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175918', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175916', None, None, None, None, None, '3749544') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.01644587516784668 save_final save missing photos in datou_result : time spend for datou_step_exec : 100.26962304115295 time spend to save output : 0.016954421997070312 total time spend for step 3 : 100.28657746315002 step4:ventilate_hashtags_in_portfolio Sat Sep 20 00:24:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27058821 get user id for portfolio 27058821 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27058821 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','autre','mal_croppe','papier','flou','environnement','metal','pet_clair','carton','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27058821 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','autre','mal_croppe','papier','flou','environnement','metal','pet_clair','carton','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27058821 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','autre','mal_croppe','papier','flou','environnement','metal','pet_clair','carton','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27059641,27059642,27059643,27059644,27059645,27059646,27059647,27059648,27059649,27059650,27059651?tags=pet_fonce,background,autre,mal_croppe,papier,flou,environnement,metal,pet_clair,carton,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1385175964, 1385175963, 1385175962, 1385175945, 1385175943, 1385175925, 1385175922, 1385175920, 1385175918, 1385175916] Looping around the photos to save general results len do output : 1 /27058821. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175964', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175963', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175962', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175945', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175943', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175925', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175922', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175920', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175918', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175916', None, None, None, None, None, '3749544') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.016045093536376953 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7769126892089844 time spend to save output : 0.01647210121154785 total time spend for step 4 : 1.7933847904205322 step5:final Sat Sep 20 00:24:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1385175964: ('0.08075339988425925',), 1385175963: ('0.08075339988425925',), 1385175962: ('0.08075339988425925',), 1385175945: ('0.08075339988425925',), 1385175943: ('0.08075339988425925',), 1385175925: ('0.08075339988425925',), 1385175922: ('0.08075339988425925',), 1385175920: ('0.08075339988425925',), 1385175918: ('0.08075339988425925',), 1385175916: ('0.08075339988425925',)} new output for save of step final : {1385175964: ('0.08075339988425925',), 1385175963: ('0.08075339988425925',), 1385175962: ('0.08075339988425925',), 1385175945: ('0.08075339988425925',), 1385175943: ('0.08075339988425925',), 1385175925: ('0.08075339988425925',), 1385175922: ('0.08075339988425925',), 1385175920: ('0.08075339988425925',), 1385175918: ('0.08075339988425925',), 1385175916: ('0.08075339988425925',)} [1385175964, 1385175963, 1385175962, 1385175945, 1385175943, 1385175925, 1385175922, 1385175920, 1385175918, 1385175916] Looping around the photos to save general results len do output : 10 /1385175964.Didn't retrieve data . /1385175963.Didn't retrieve data . /1385175962.Didn't retrieve data . /1385175945.Didn't retrieve data . /1385175943.Didn't retrieve data . /1385175925.Didn't retrieve data . /1385175922.Didn't retrieve data . /1385175920.Didn't retrieve data . /1385175918.Didn't retrieve data . /1385175916.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175964', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175963', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175962', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175945', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175943', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175925', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175922', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175920', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175918', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175916', None, None, None, None, None, '3749544') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.018023014068603516 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13245773315429688 time spend to save output : 0.01845860481262207 total time spend for step 5 : 0.15091633796691895 step6:blur_detection Sat Sep 20 00:24:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0.jpg resize: (2160, 3840) 1385175964 -6.742439528742396 treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a.jpg resize: (2160, 3840) 1385175963 -6.418083717980114 treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38.jpg resize: (2160, 3840) 1385175962 -6.593751538415133 treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77.jpg resize: (2160, 3840) 1385175945 -6.55875216470259 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde.jpg resize: (2160, 3840) 1385175943 -6.570118352623826 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066.jpg resize: (2160, 3840) 1385175925 -6.5521594356729995 treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f.jpg resize: (2160, 3840) 1385175922 -6.090924516274549 treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1.jpg resize: (2160, 3840) 1385175920 -6.594188130356475 treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97.jpg resize: (2160, 3840) 1385175918 -6.657956466145634 treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98.jpg resize: (2160, 3840) 1385175916 -6.081957759391623 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417209_0.png resize: (237, 206) 1385186070 -2.315655259122192 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417210_0.png resize: (506, 534) 1385186071 -4.009823584801509 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417212_0.png resize: (438, 356) 1385186072 3.4505840106436607 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417213_0.png resize: (271, 284) 1385186073 -3.8404671055901796 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417214_0.png resize: (418, 177) 1385186074 -0.660653022899687 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417215_0.png resize: (402, 273) 1385186075 0.3890236510367427 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417216_0.png resize: (127, 144) 1385186076 0.7873378683897139 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417219_0.png resize: (247, 314) 1385186077 -3.054841364626152 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417220_0.png resize: (147, 145) 1385186078 -1.8698579374043516 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417221_0.png resize: (73, 477) 1385186079 -5.184472245336919 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417222_0.png resize: (178, 177) 1385186080 -2.5792961800246843 treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417224_0.png resize: (285, 203) 1385186082 -1.098282699839661 treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417225_0.png resize: (210, 96) 1385186083 -2.3911672765449388 treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417227_0.png resize: (259, 227) 1385186085 1.0901611630921009 treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417232_0.png resize: (148, 305) 1385186086 -1.704475847908859 treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417234_0.png resize: (482, 352) 1385186087 -4.4345000141288295 treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417235_0.png resize: (319, 335) 1385186088 -2.405356349079513 treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417236_0.png resize: (153, 125) 1385186090 1.0696981116119697 treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417237_0.png resize: (235, 388) 1385186091 -3.288416477011764 treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417238_0.png resize: (132, 152) 1385186093 -1.754953655860138 treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417239_0.png resize: (260, 444) 1385186094 -4.5809560015820265 treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417240_0.png resize: (269, 141) 1385186095 -3.0112373654378457 treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417242_0.png resize: (86, 233) 1385186097 -3.8072327306360827 treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77_rle_crop_3968417244_0.png resize: (434, 286) 1385186098 -1.815694500559245 treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77_rle_crop_3968417245_0.png resize: (144, 179) 1385186099 -3.429424008315179 treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77_rle_crop_3968417246_0.png resize: (270, 302) 1385186101 4.035785343127123 treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77_rle_crop_3968417247_0.png resize: (225, 237) 1385186102 -1.0279190389963007 treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77_rle_crop_3968417248_0.png resize: (500, 274) 1385186103 -4.582018194689425 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417250_0.png resize: (366, 302) 1385186104 2.447814339358435 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417251_0.png resize: (222, 159) 1385186105 -2.897172097433453 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417252_0.png resize: (510, 698) 1385186106 -2.2558065442204684 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417254_0.png resize: (271, 347) 1385186107 -0.7259636660048147 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417255_0.png resize: (270, 485) 1385186108 -4.254902049270835 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417257_0.png resize: (206, 213) 1385186109 -3.1870293598043267 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417258_0.png resize: (155, 167) 1385186111 -0.7132123134385311 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417260_0.png resize: (458, 233) 1385186112 -0.3117549592294688 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417261_0.png resize: (113, 225) 1385186113 -4.188727634451599 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417262_0.png resize: (916, 589) 1385186115 -4.610012166985906 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417263_0.png resize: (311, 304) 1385186116 -1.2128745597207353 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417264_0.png resize: (397, 486) 1385186118 -1.2229521776747587 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417267_0.png resize: (322, 456) 1385186119 -4.390759517207028 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417270_0.png resize: (237, 129) 1385186120 -2.1262465060235813 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417271_0.png resize: (91, 165) 1385186122 -4.196108906413218 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417272_0.png resize: (106, 96) 1385186123 1.4801256706715764 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417274_0.png resize: (452, 363) 1385186124 -4.309643965418917 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417275_0.png resize: (664, 443) 1385186126 -3.467369975592577 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417276_0.png resize: (418, 438) 1385186127 -1.0882691306463939 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417277_0.png resize: (206, 246) 1385186128 -3.441721606193956 treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417279_0.png resize: (611, 533) 1385186130 -4.396231850456332 treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417281_0.png resize: (853, 1228) 1385186132 -3.2588686076076936 treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417283_0.png resize: (643, 450) 1385186133 -3.48655685795666 treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417284_0.png resize: (160, 103) 1385186134 -4.042474965891728 treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1_rle_crop_3968417285_0.png resize: (431, 412) 1385186135 -3.8742417008222474 treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1_rle_crop_3968417286_0.png resize: (517, 492) 1385186136 -4.332336343137454 treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1_rle_crop_3968417287_0.png resize: (188, 128) 1385186137 -3.6122178189554486 treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1_rle_crop_3968417288_0.png resize: (233, 327) 1385186138 -0.5687968678878215 treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1_rle_crop_3968417289_0.png resize: (811, 581) 1385186139 -4.374281030923323 treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97_rle_crop_3968417291_0.png resize: (381, 280) 1385186140 -1.0638823630705898 treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97_rle_crop_3968417292_0.png resize: (106, 118) 1385186141 1.7030734869975173 treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97_rle_crop_3968417293_0.png resize: (200, 235) 1385186142 -2.8441842829116792 treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97_rle_crop_3968417294_0.png resize: (143, 126) 1385186143 0.12763165100783977 treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97_rle_crop_3968417295_0.png resize: (145, 122) 1385186144 -2.355018727219983 treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97_rle_crop_3968417296_0.png resize: (423, 462) 1385186145 -4.466795173711803 treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98_rle_crop_3968417299_0.png resize: (261, 457) 1385186146 -1.4799115249051469 treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98_rle_crop_3968417300_0.png resize: (345, 346) 1385186147 -3.7914345193176118 treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98_rle_crop_3968417301_0.png resize: (346, 259) 1385186148 -0.11938872731364444 treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98_rle_crop_3968417302_0.png resize: (107, 172) 1385186149 -4.070353707162247 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417211_0.png resize: (386, 515) 1385186158 -4.4558107398906746 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417217_0.png resize: (137, 135) 1385186159 -3.4831284301014627 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417256_0.png resize: (236, 260) 1385186160 -3.2555446769978733 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417265_0.png resize: (320, 131) 1385186161 -0.13365877491842731 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417268_0.png resize: (294, 267) 1385186162 -3.527766809508747 treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417278_0.png resize: (640, 568) 1385186163 -3.5134390673528673 treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98_rle_crop_3968417298_0.png resize: (232, 388) 1385186164 -4.154691338871147 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417223_0.png resize: (279, 214) 1385186166 -4.650041192021245 treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417241_0.png resize: (211, 312) 1385186167 -4.324208317562417 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417273_0.png resize: (198, 170) 1385186168 -4.512300102240305 treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417282_0.png resize: (507, 263) 1385186169 -4.818242743977804 treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417218_0.png resize: (379, 563) 1385186181 -3.0100507199020905 treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417226_0.png resize: (519, 272) 1385186182 -4.5717314188011295 treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417228_0.png resize: (439, 432) 1385186183 -3.9255742596716674 treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417229_0.png resize: (350, 579) 1385186184 -1.9331737951870944 treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417230_0.png resize: (266, 273) 1385186185 -4.255830539353353 treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417231_0.png resize: (145, 303) 1385186186 -3.742885932398887 treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417233_0.png resize: (424, 496) 1385186187 -3.51064476265981 treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417243_0.png resize: (336, 512) 1385186188 -2.2900311969152836 treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77_rle_crop_3968417249_0.png resize: (215, 259) 1385186189 -3.690553580933626 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417253_0.png resize: (544, 167) 1385186190 -4.803416217499389 treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417259_0.png resize: (242, 263) 1385186191 -4.351624261569142 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417266_0.png resize: (297, 404) 1385186192 -4.6267117791999235 treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417269_0.png resize: (267, 162) 1385186193 -4.835102800140108 treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417280_0.png resize: (406, 593) 1385186194 -3.486409557630585 treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1_rle_crop_3968417290_0.png resize: (235, 151) 1385186195 -5.646744867936798 treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98_rle_crop_3968417297_0.png resize: (286, 728) 1385186196 -5.087854188250943 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 104 time used for this insertion : 0.020832538604736328 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 104 time used for this insertion : 0.03901529312133789 save missing photos in datou_result : time spend for datou_step_exec : 45.03364539146423 time spend to save output : 0.06571340560913086 total time spend for step 6 : 45.099358797073364 step7:brightness Sat Sep 20 00:25:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0.jpg treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a.jpg treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38.jpg treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77.jpg treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde.jpg treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066.jpg treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f.jpg treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1.jpg treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97.jpg treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98.jpg treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417209_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417210_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417212_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417213_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417214_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417215_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417216_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417219_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417220_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417221_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417222_0.png treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417224_0.png treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417225_0.png treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417227_0.png treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417232_0.png treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417234_0.png treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417235_0.png treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417236_0.png treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417237_0.png treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417238_0.png treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417239_0.png treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417240_0.png treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417242_0.png treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77_rle_crop_3968417244_0.png treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77_rle_crop_3968417245_0.png treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77_rle_crop_3968417246_0.png treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77_rle_crop_3968417247_0.png treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77_rle_crop_3968417248_0.png treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417250_0.png treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417251_0.png treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417252_0.png treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417254_0.png treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417255_0.png treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417257_0.png treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417258_0.png treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417260_0.png treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417261_0.png treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417262_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417263_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417264_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417267_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417270_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417271_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417272_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417274_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417275_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417276_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417277_0.png treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417279_0.png treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417281_0.png treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417283_0.png treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417284_0.png treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1_rle_crop_3968417285_0.png treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1_rle_crop_3968417286_0.png treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1_rle_crop_3968417287_0.png treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1_rle_crop_3968417288_0.png treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1_rle_crop_3968417289_0.png treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97_rle_crop_3968417291_0.png treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97_rle_crop_3968417292_0.png treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97_rle_crop_3968417293_0.png treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97_rle_crop_3968417294_0.png treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97_rle_crop_3968417295_0.png treat image : temp/1758320429_3283195_1385175918_32c57bbb04a4d02c03a4448f15494c97_rle_crop_3968417296_0.png treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98_rle_crop_3968417299_0.png treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98_rle_crop_3968417300_0.png treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98_rle_crop_3968417301_0.png treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98_rle_crop_3968417302_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417211_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417217_0.png treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417256_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417265_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417268_0.png treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417278_0.png treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98_rle_crop_3968417298_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417223_0.png treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417241_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417273_0.png treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417282_0.png treat image : temp/1758320429_3283195_1385175964_3400d2fba7b4dd3ee8e63301421de8d0_rle_crop_3968417218_0.png treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417226_0.png treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417228_0.png treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417229_0.png treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417230_0.png treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417231_0.png treat image : temp/1758320429_3283195_1385175963_8e1494325fce07e8f13d2ac094775a0a_rle_crop_3968417233_0.png treat image : temp/1758320429_3283195_1385175962_61ffc4432f85647542ba7bacfe853a38_rle_crop_3968417243_0.png treat image : temp/1758320429_3283195_1385175945_bb9168122afe4ef818e50cf67c44fc77_rle_crop_3968417249_0.png treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417253_0.png treat image : temp/1758320429_3283195_1385175943_7ba9dc148a9f0f37e426b88073db5bde_rle_crop_3968417259_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417266_0.png treat image : temp/1758320429_3283195_1385175925_84ca4f506463f99a9f74992d294ba066_rle_crop_3968417269_0.png treat image : temp/1758320429_3283195_1385175922_a0fb3ee31d3ed26f223de2323c08006f_rle_crop_3968417280_0.png treat image : temp/1758320429_3283195_1385175920_292d555c73e3fa9b2c038cfb8c0707b1_rle_crop_3968417290_0.png treat image : temp/1758320429_3283195_1385175916_1b7307596ff5f40e53122a91ea522b98_rle_crop_3968417297_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 104 time used for this insertion : 0.017364025115966797 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 104 time used for this insertion : 0.039919376373291016 save missing photos in datou_result : time spend for datou_step_exec : 11.781112670898438 time spend to save output : 0.06258201599121094 total time spend for step 7 : 11.843694686889648 step8:velours_tree Sat Sep 20 00:25:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1298658847808838 time spend to save output : 4.553794860839844e-05 total time spend for step 8 : 0.1299114227294922 step9:send_mail_cod Sat Sep 20 00:25:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27058821_20-09-2025_00_25_29.pdf 27059641 imagette270596411758320729 27059642 imagette270596421758320729 27059643 imagette270596431758320729 27059644 imagette270596441758320729 27059645 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette270596451758320729 27059646 imagette270596461758320733 27059648 change filename to text .change filename to text .change filename to text .change filename to text .imagette270596481758320733 27059649 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette270596491758320734 27059650 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette270596501758320736 27059651 imagette270596511758320736 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27058821 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27059641,27059642,27059643,27059644,27059645,27059646,27059647,27059648,27059649,27059650,27059651?tags=pet_fonce,background,autre,mal_croppe,papier,flou,environnement,metal,pet_clair,carton,pehd args[1385175964] : ((1385175964, -6.742439528742396, 492609224), (1385175964, 1.366737018127109, 2107752395), '0.08075339988425925') We are sending mail with results at report@fotonower.com args[1385175963] : ((1385175963, -6.418083717980114, 492609224), (1385175963, 1.3697121026591816, 2107752395), '0.08075339988425925') We are sending mail with results at report@fotonower.com args[1385175962] : ((1385175962, -6.593751538415133, 492609224), (1385175962, 1.3896975241244327, 2107752395), '0.08075339988425925') We are sending mail with results at report@fotonower.com args[1385175945] : ((1385175945, -6.55875216470259, 492609224), (1385175945, 1.4540141888413471, 2107752395), '0.08075339988425925') We are sending mail with results at report@fotonower.com args[1385175943] : ((1385175943, -6.570118352623826, 492609224), (1385175943, 1.4658004851925328, 2107752395), '0.08075339988425925') We are sending mail with results at report@fotonower.com args[1385175925] : ((1385175925, -6.5521594356729995, 492609224), (1385175925, 1.2864727479190776, 2107752395), '0.08075339988425925') We are sending mail with results at report@fotonower.com args[1385175922] : ((1385175922, -6.090924516274549, 492609224), (1385175922, 1.2827537872702184, 2107752395), '0.08075339988425925') We are sending mail with results at report@fotonower.com args[1385175920] : ((1385175920, -6.594188130356475, 492609224), (1385175920, 1.2778051214240143, 2107752395), '0.08075339988425925') We are sending mail with results at report@fotonower.com args[1385175918] : ((1385175918, -6.657956466145634, 492609224), (1385175918, 1.3033223675804144, 2107752395), '0.08075339988425925') We are sending mail with results at report@fotonower.com args[1385175916] : ((1385175916, -6.081957759391623, 492609224), (1385175916, 0.6928016185259138, 2107752395), '0.08075339988425925') We are sending mail with results at report@fotonower.com refus_total : 0.08075339988425925 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27058821 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27058821_20-09-2025_00_25_29.pdf results_Auto_P27058821_20-09-2025_00_25_29.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27058821_20-09-2025_00_25_29.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27058821','results_Auto_P27058821_20-09-2025_00_25_29.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27058821_20-09-2025_00_25_29.pdf','pdf','','0.79','0.08075339988425925') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27058821

https://www.fotonower.com/image?json=false&list_photos_id=1385175964
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385175963
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385175962
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385175945
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385175943
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385175925
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385175922
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385175920
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385175918
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1385175916
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.08%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/27059645?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27059648?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27059649?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27059650?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27058821_20-09-2025_00_25_29.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27059641,27059642,27059643,27059644,27059645,27059646,27059647,27059648,27059649,27059650,27059651?tags=pet_fonce,background,autre,mal_croppe,papier,flou,environnement,metal,pet_clair,carton,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 19 Sep 2025 22:25:40 GMT Content-Length: 0 Connection: close X-Message-Id: zTQdKM5QQlSR7FzuJ1EZ3g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1385175964, 1385175963, 1385175962, 1385175945, 1385175943, 1385175925, 1385175922, 1385175920, 1385175918, 1385175916] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175964', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175963', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175962', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175945', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175943', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175925', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175922', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175920', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175918', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175916', None, None, None, None, None, '3749544') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013832330703735352 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.418623924255371 time spend to save output : 0.014131307601928711 total time spend for step 9 : 10.4327552318573 step10:split_time_score Sat Sep 20 00:25:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 19092025 27058821 Nombre de photos uploadées : 10 / 23040 (0%) 19092025 27058821 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 19092025 27058821 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0004544258117675781 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20396924018859863 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.017269210746408352 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27045239_19-09-2025_17_10_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27045239 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27045239 AND mptpi.`type`=3726 To do Qualite : 0.01787303931881728 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27048880_19-09-2025_19_13_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27048880 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27048880 AND mptpi.`type`=3726 To do Qualite : 0.08797370113168725 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27052783_19-09-2025_21_58_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27052783 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27052783 AND mptpi.`type`=3594 To do Qualite : 0.01470908885007062 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27052787_19-09-2025_20_42_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27052787 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27052787 AND mptpi.`type`=3726 To do Qualite : 0.08697559799382718 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27057432_19-09-2025_22_53_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27057432 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27057432 AND mptpi.`type`=3594 To do Qualite : 0.08254049203593473 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27057436_19-09-2025_22_50_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27057436 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27057436 AND mptpi.`type`=3594 To do Qualite : 0.012850038135002358 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27057437_19-09-2025_22_40_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27057437 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27057437 AND mptpi.`type`=3726 To do Qualite : 0.08075339988425925 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27058821_20-09-2025_00_25_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27058821 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27058821 AND mptpi.`type`=3594 To do Qualite : 0.060905824740460156 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27058827_20-09-2025_00_15_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27058827 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27058827 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'19092025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1385175964, 1385175963, 1385175962, 1385175945, 1385175943, 1385175925, 1385175922, 1385175920, 1385175918, 1385175916] Looping around the photos to save general results len do output : 1 /27058821Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175964', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175963', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175962', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175945', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175943', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175925', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175922', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175920', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175918', None, None, None, None, None, '3749544') ('3318', None, None, None, None, None, None, None, '3749544') ('3318', '27058821', '1385175916', None, None, None, None, None, '3749544') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.04230475425720215 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.1709229946136475 time spend to save output : 0.04256749153137207 total time spend for step 10 : 1.2134904861450195 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 132.28user 136.35system 5:17.28elapsed 84%CPU (0avgtext+0avgdata 4476960maxresident)k 1238952inputs+131568outputs (30990major+12188113minor)pagefaults 0swaps