python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3394967 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3253199'] with mtr_portfolio_ids : ['24753734'] and first list_photo_ids : [] new path : /proc/3394967/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 0.7747046947479248 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Jul 9 15:40:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5665 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-09 15:40:31.734587: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-09 15:40:31.759381: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-09 15:40:31.761390: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ff89c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-09 15:40:31.761437: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-09 15:40:31.764997: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-09 15:40:31.890309: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2903d6f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-09 15:40:31.890349: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-09 15:40:31.891382: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-09 15:40:31.891709: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-09 15:40:31.894579: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-09 15:40:31.897109: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-09 15:40:31.897576: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-09 15:40:31.900510: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-09 15:40:31.901454: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-09 15:40:31.905173: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-09 15:40:31.906228: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-09 15:40:31.906279: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-09 15:40:31.906854: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-09 15:40:31.906868: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-09 15:40:31.906875: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-09 15:40:31.907903: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5183 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-09 15:40:32.176509: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-09 15:40:32.176596: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-09 15:40:32.176623: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-09 15:40:32.176648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-09 15:40:32.176674: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-09 15:40:32.176700: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-09 15:40:32.176724: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-09 15:40:32.176742: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-09 15:40:32.177926: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-09 15:40:32.178954: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-09 15:40:32.178988: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-09 15:40:32.179006: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-09 15:40:32.179023: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-09 15:40:32.179040: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-09 15:40:32.179057: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-09 15:40:32.179074: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-09 15:40:32.179090: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-09 15:40:32.180275: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-09 15:40:32.180307: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-09 15:40:32.180318: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-09 15:40:32.180327: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-09 15:40:32.181553: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5183 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-09 15:40:41.524951: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-09 15:40:41.692139: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 43 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 Detection mask done ! Trying to reset tf kernel 3395580 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 376 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5665 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.000823974609375 nb_pixel_total : 22636 time to create 1 rle with old method : 0.024171113967895508 length of segment : 152 time for calcul the mask position with numpy : 0.0008170604705810547 nb_pixel_total : 31972 time to create 1 rle with old method : 0.03313636779785156 length of segment : 211 time for calcul the mask position with numpy : 0.008354902267456055 nb_pixel_total : 306289 time to create 1 rle with new method : 0.022393226623535156 length of segment : 660 time for calcul the mask position with numpy : 0.0005159378051757812 nb_pixel_total : 16561 time to create 1 rle with old method : 0.017381906509399414 length of segment : 191 time for calcul the mask position with numpy : 0.00041675567626953125 nb_pixel_total : 14642 time to create 1 rle with old method : 0.015718698501586914 length of segment : 138 time for calcul the mask position with numpy : 0.0003921985626220703 nb_pixel_total : 17307 time to create 1 rle with old method : 0.017992734909057617 length of segment : 193 time for calcul the mask position with numpy : 0.0012061595916748047 nb_pixel_total : 38090 time to create 1 rle with old method : 0.039638519287109375 length of segment : 550 time for calcul the mask position with numpy : 0.0014564990997314453 nb_pixel_total : 61190 time to create 1 rle with old method : 0.06393551826477051 length of segment : 347 time for calcul the mask position with numpy : 0.0011792182922363281 nb_pixel_total : 52736 time to create 1 rle with old method : 0.05472922325134277 length of segment : 381 time for calcul the mask position with numpy : 0.0014278888702392578 nb_pixel_total : 79201 time to create 1 rle with old method : 0.08185434341430664 length of segment : 314 time for calcul the mask position with numpy : 0.0026061534881591797 nb_pixel_total : 117658 time to create 1 rle with old method : 0.12189841270446777 length of segment : 532 time for calcul the mask position with numpy : 0.00038695335388183594 nb_pixel_total : 13334 time to create 1 rle with old method : 0.013932466506958008 length of segment : 146 time for calcul the mask position with numpy : 0.0003745555877685547 nb_pixel_total : 14527 time to create 1 rle with old method : 0.015485286712646484 length of segment : 136 time for calcul the mask position with numpy : 0.0003161430358886719 nb_pixel_total : 11160 time to create 1 rle with old method : 0.011672735214233398 length of segment : 180 time for calcul the mask position with numpy : 0.0009217262268066406 nb_pixel_total : 11266 time to create 1 rle with old method : 0.01211857795715332 length of segment : 213 time for calcul the mask position with numpy : 0.0013823509216308594 nb_pixel_total : 54266 time to create 1 rle with old method : 0.05648183822631836 length of segment : 298 time for calcul the mask position with numpy : 0.000270843505859375 nb_pixel_total : 9540 time to create 1 rle with old method : 0.010337114334106445 length of segment : 130 time for calcul the mask position with numpy : 0.001173257827758789 nb_pixel_total : 37626 time to create 1 rle with old method : 0.03935432434082031 length of segment : 425 time for calcul the mask position with numpy : 0.0004820823669433594 nb_pixel_total : 16900 time to create 1 rle with old method : 0.017380952835083008 length of segment : 245 time for calcul the mask position with numpy : 0.00048279762268066406 nb_pixel_total : 19862 time to create 1 rle with old method : 0.021082639694213867 length of segment : 125 time for calcul the mask position with numpy : 0.0007686614990234375 nb_pixel_total : 34828 time to create 1 rle with old method : 0.03653669357299805 length of segment : 239 time for calcul the mask position with numpy : 0.0023956298828125 nb_pixel_total : 89736 time to create 1 rle with old method : 0.09587907791137695 length of segment : 385 time for calcul the mask position with numpy : 0.0008842945098876953 nb_pixel_total : 32415 time to create 1 rle with old method : 0.03376317024230957 length of segment : 275 time for calcul the mask position with numpy : 0.0006840229034423828 nb_pixel_total : 31946 time to create 1 rle with old method : 0.03338885307312012 length of segment : 245 time for calcul the mask position with numpy : 0.0022430419921875 nb_pixel_total : 91624 time to create 1 rle with old method : 0.09412646293640137 length of segment : 592 time for calcul the mask position with numpy : 0.0016293525695800781 nb_pixel_total : 83308 time to create 1 rle with old method : 0.0936434268951416 length of segment : 308 time for calcul the mask position with numpy : 0.0018565654754638672 nb_pixel_total : 87576 time to create 1 rle with old method : 0.09005355834960938 length of segment : 432 time for calcul the mask position with numpy : 0.0011491775512695312 nb_pixel_total : 45576 time to create 1 rle with old method : 0.04975390434265137 length of segment : 358 time for calcul the mask position with numpy : 0.00036263465881347656 nb_pixel_total : 16349 time to create 1 rle with old method : 0.017004013061523438 length of segment : 157 time for calcul the mask position with numpy : 0.0005209445953369141 nb_pixel_total : 30851 time to create 1 rle with old method : 0.03294539451599121 length of segment : 164 time for calcul the mask position with numpy : 0.0005743503570556641 nb_pixel_total : 32144 time to create 1 rle with old method : 0.03414583206176758 length of segment : 133 time for calcul the mask position with numpy : 0.001293182373046875 nb_pixel_total : 56745 time to create 1 rle with old method : 0.059983015060424805 length of segment : 313 time for calcul the mask position with numpy : 0.0009584426879882812 nb_pixel_total : 51377 time to create 1 rle with old method : 0.054619550704956055 length of segment : 240 time for calcul the mask position with numpy : 0.0007476806640625 nb_pixel_total : 33733 time to create 1 rle with old method : 0.0353395938873291 length of segment : 236 time for calcul the mask position with numpy : 0.00039768218994140625 nb_pixel_total : 15637 time to create 1 rle with old method : 0.016554832458496094 length of segment : 165 time for calcul the mask position with numpy : 0.0004334449768066406 nb_pixel_total : 17769 time to create 1 rle with old method : 0.018944740295410156 length of segment : 176 time for calcul the mask position with numpy : 0.00020599365234375 nb_pixel_total : 7931 time to create 1 rle with old method : 0.00847935676574707 length of segment : 95 time for calcul the mask position with numpy : 0.0009849071502685547 nb_pixel_total : 52245 time to create 1 rle with old method : 0.053964853286743164 length of segment : 236 time for calcul the mask position with numpy : 0.0009846687316894531 nb_pixel_total : 47102 time to create 1 rle with old method : 0.04944348335266113 length of segment : 317 time for calcul the mask position with numpy : 0.0005359649658203125 nb_pixel_total : 26330 time to create 1 rle with old method : 0.02805948257446289 length of segment : 192 time for calcul the mask position with numpy : 0.0004260540008544922 nb_pixel_total : 15936 time to create 1 rle with old method : 0.017128705978393555 length of segment : 168 time for calcul the mask position with numpy : 0.0008842945098876953 nb_pixel_total : 31653 time to create 1 rle with old method : 0.03651738166809082 length of segment : 211 time for calcul the mask position with numpy : 0.0014455318450927734 nb_pixel_total : 84114 time to create 1 rle with old method : 0.08652782440185547 length of segment : 335 time for calcul the mask position with numpy : 0.0009167194366455078 nb_pixel_total : 53224 time to create 1 rle with old method : 0.05495142936706543 length of segment : 269 time for calcul the mask position with numpy : 0.0011899471282958984 nb_pixel_total : 52668 time to create 1 rle with old method : 0.05423331260681152 length of segment : 317 time for calcul the mask position with numpy : 0.0006914138793945312 nb_pixel_total : 30278 time to create 1 rle with old method : 0.03171253204345703 length of segment : 243 time for calcul the mask position with numpy : 0.0005888938903808594 nb_pixel_total : 23566 time to create 1 rle with old method : 0.024890899658203125 length of segment : 180 time for calcul the mask position with numpy : 0.0017919540405273438 nb_pixel_total : 67535 time to create 1 rle with old method : 0.07097744941711426 length of segment : 397 time for calcul the mask position with numpy : 0.0006165504455566406 nb_pixel_total : 24952 time to create 1 rle with old method : 0.02615952491760254 length of segment : 178 time for calcul the mask position with numpy : 0.0011699199676513672 nb_pixel_total : 47141 time to create 1 rle with old method : 0.048126220703125 length of segment : 329 time for calcul the mask position with numpy : 0.0021407604217529297 nb_pixel_total : 86073 time to create 1 rle with old method : 0.08866643905639648 length of segment : 275 time for calcul the mask position with numpy : 0.000274658203125 nb_pixel_total : 10939 time to create 1 rle with old method : 0.011858224868774414 length of segment : 98 time for calcul the mask position with numpy : 0.0005369186401367188 nb_pixel_total : 19101 time to create 1 rle with old method : 0.020183086395263672 length of segment : 146 time for calcul the mask position with numpy : 0.0010027885437011719 nb_pixel_total : 48181 time to create 1 rle with old method : 0.049927473068237305 length of segment : 352 time for calcul the mask position with numpy : 0.00028634071350097656 nb_pixel_total : 11766 time to create 1 rle with old method : 0.0125885009765625 length of segment : 101 time for calcul the mask position with numpy : 0.00026488304138183594 nb_pixel_total : 10452 time to create 1 rle with old method : 0.016651630401611328 length of segment : 172 time for calcul the mask position with numpy : 0.0010371208190917969 nb_pixel_total : 14376 time to create 1 rle with old method : 0.015210390090942383 length of segment : 187 time for calcul the mask position with numpy : 0.0006718635559082031 nb_pixel_total : 11273 time to create 1 rle with old method : 0.011853933334350586 length of segment : 166 time for calcul the mask position with numpy : 0.0055217742919921875 nb_pixel_total : 100809 time to create 1 rle with old method : 0.10506987571716309 length of segment : 313 time for calcul the mask position with numpy : 0.0020830631256103516 nb_pixel_total : 61061 time to create 1 rle with old method : 0.062273502349853516 length of segment : 257 time for calcul the mask position with numpy : 0.002348184585571289 nb_pixel_total : 46660 time to create 1 rle with old method : 0.0486445426940918 length of segment : 459 time for calcul the mask position with numpy : 0.0019826889038085938 nb_pixel_total : 60197 time to create 1 rle with old method : 0.062297821044921875 length of segment : 360 time for calcul the mask position with numpy : 0.002619504928588867 nb_pixel_total : 52482 time to create 1 rle with old method : 0.054073333740234375 length of segment : 321 time for calcul the mask position with numpy : 0.0022611618041992188 nb_pixel_total : 1593 time to create 1 rle with old method : 0.0021545886993408203 length of segment : 65 time for calcul the mask position with numpy : 0.0010929107666015625 nb_pixel_total : 26002 time to create 1 rle with old method : 0.027352333068847656 length of segment : 248 time for calcul the mask position with numpy : 0.0009160041809082031 nb_pixel_total : 19216 time to create 1 rle with old method : 0.020368576049804688 length of segment : 191 time for calcul the mask position with numpy : 0.0010676383972167969 nb_pixel_total : 20561 time to create 1 rle with old method : 0.021915197372436523 length of segment : 228 time for calcul the mask position with numpy : 0.0007178783416748047 nb_pixel_total : 9422 time to create 1 rle with old method : 0.010014057159423828 length of segment : 152 time for calcul the mask position with numpy : 0.000240325927734375 nb_pixel_total : 13303 time to create 1 rle with old method : 0.014537811279296875 length of segment : 94 time for calcul the mask position with numpy : 0.0015788078308105469 nb_pixel_total : 111591 time to create 1 rle with old method : 0.11461353302001953 length of segment : 402 time for calcul the mask position with numpy : 0.0014951229095458984 nb_pixel_total : 83308 time to create 1 rle with old method : 0.08611607551574707 length of segment : 433 time for calcul the mask position with numpy : 0.00023484230041503906 nb_pixel_total : 11391 time to create 1 rle with old method : 0.012195110321044922 length of segment : 90 time for calcul the mask position with numpy : 0.0004456043243408203 nb_pixel_total : 21951 time to create 1 rle with old method : 0.023500442504882812 length of segment : 198 time for calcul the mask position with numpy : 0.0002722740173339844 nb_pixel_total : 14276 time to create 1 rle with old method : 0.015098094940185547 length of segment : 132 time for calcul the mask position with numpy : 0.00040149688720703125 nb_pixel_total : 19616 time to create 1 rle with old method : 0.020258665084838867 length of segment : 221 time for calcul the mask position with numpy : 0.0002827644348144531 nb_pixel_total : 17011 time to create 1 rle with old method : 0.017896413803100586 length of segment : 136 time for calcul the mask position with numpy : 0.00035572052001953125 nb_pixel_total : 16355 time to create 1 rle with old method : 0.017209291458129883 length of segment : 189 time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 9614 time to create 1 rle with old method : 0.010468006134033203 length of segment : 231 time for calcul the mask position with numpy : 0.0010123252868652344 nb_pixel_total : 23576 time to create 1 rle with old method : 0.02584052085876465 length of segment : 122 time for calcul the mask position with numpy : 0.003326416015625 nb_pixel_total : 61676 time to create 1 rle with old method : 0.0644376277923584 length of segment : 322 time for calcul the mask position with numpy : 0.0034966468811035156 nb_pixel_total : 74641 time to create 1 rle with old method : 0.07830357551574707 length of segment : 317 time for calcul the mask position with numpy : 0.003847360610961914 nb_pixel_total : 70517 time to create 1 rle with old method : 0.07914161682128906 length of segment : 277 time for calcul the mask position with numpy : 0.003185272216796875 nb_pixel_total : 53032 time to create 1 rle with old method : 0.05649399757385254 length of segment : 318 time for calcul the mask position with numpy : 0.002089262008666992 nb_pixel_total : 39072 time to create 1 rle with old method : 0.040873050689697266 length of segment : 239 time for calcul the mask position with numpy : 0.0004391670227050781 nb_pixel_total : 7934 time to create 1 rle with old method : 0.008775711059570312 length of segment : 73 time for calcul the mask position with numpy : 0.0009832382202148438 nb_pixel_total : 16389 time to create 1 rle with old method : 0.01759624481201172 length of segment : 193 time for calcul the mask position with numpy : 0.0029125213623046875 nb_pixel_total : 70220 time to create 1 rle with old method : 0.07481169700622559 length of segment : 393 time for calcul the mask position with numpy : 0.008101224899291992 nb_pixel_total : 195042 time to create 1 rle with new method : 0.015326261520385742 length of segment : 963 time for calcul the mask position with numpy : 0.0007340908050537109 nb_pixel_total : 13338 time to create 1 rle with old method : 0.01561427116394043 length of segment : 120 time for calcul the mask position with numpy : 0.00197601318359375 nb_pixel_total : 42670 time to create 1 rle with old method : 0.04521989822387695 length of segment : 313 time for calcul the mask position with numpy : 0.0029261112213134766 nb_pixel_total : 77928 time to create 1 rle with old method : 0.08146095275878906 length of segment : 356 time for calcul the mask position with numpy : 0.0009756088256835938 nb_pixel_total : 14585 time to create 1 rle with old method : 0.016521692276000977 length of segment : 209 time for calcul the mask position with numpy : 0.0009045600891113281 nb_pixel_total : 13402 time to create 1 rle with old method : 0.022258996963500977 length of segment : 117 time for calcul the mask position with numpy : 0.001020193099975586 nb_pixel_total : 9837 time to create 1 rle with old method : 0.012846231460571289 length of segment : 147 time for calcul the mask position with numpy : 0.0008616447448730469 nb_pixel_total : 15850 time to create 1 rle with old method : 0.01819753646850586 length of segment : 169 time for calcul the mask position with numpy : 0.0004475116729736328 nb_pixel_total : 14882 time to create 1 rle with old method : 0.017257213592529297 length of segment : 118 time for calcul the mask position with numpy : 0.0008761882781982422 nb_pixel_total : 8091 time to create 1 rle with old method : 0.00966787338256836 length of segment : 152 time for calcul the mask position with numpy : 0.0004379749298095703 nb_pixel_total : 11481 time to create 1 rle with old method : 0.013242244720458984 length of segment : 312 time for calcul the mask position with numpy : 0.0011875629425048828 nb_pixel_total : 20727 time to create 1 rle with old method : 0.023825883865356445 length of segment : 316 time for calcul the mask position with numpy : 0.0013751983642578125 nb_pixel_total : 34664 time to create 1 rle with old method : 0.0399775505065918 length of segment : 195 time for calcul the mask position with numpy : 0.0009484291076660156 nb_pixel_total : 17031 time to create 1 rle with old method : 0.0286099910736084 length of segment : 146 time for calcul the mask position with numpy : 0.0006568431854248047 nb_pixel_total : 7445 time to create 1 rle with old method : 0.012229442596435547 length of segment : 117 time spent for convertir_results : 7.377658367156982 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 102 chid ids of type : 3594 Number RLEs to save : 25673 save missing photos in datou_result : time spend for datou_step_exec : 56.98907160758972 time spend to save output : 1.8839349746704102 total time spend for step 1 : 58.87300658226013 step2:crop_condition Wed Jul 9 15:41:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 102 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 92 About to insert : list_path_to_insert length 92 new photo from crops ! About to upload 92 photos upload in portfolio : 3736932 init cache_photo without model_param we have 92 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752068506_3394967 we have uploaded 92 photos in the portfolio 3736932 time of upload the photos Elapsed time : 21.9184148311615 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752068529_3394967 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.143303394317627 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752068531_3394967 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.491347074508667 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752068541_3394967 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2950353622436523 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752068543_3394967 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7000336647033691 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752068545_3394967 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6573281288146973 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1371379751, 1371379749, 1371379748, 1371379747, 1371379572] Looping around the photos to save general results len do output : 102 /1371387842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371387993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371388096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371388108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371388109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371388111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371388112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371388118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371388121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379751', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379749', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379748', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379747', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379572', None, None, None, None, None, '3253199') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 311 time used for this insertion : 0.04844021797180176 save_final save missing photos in datou_result : time spend for datou_step_exec : 57.53209948539734 time spend to save output : 0.051866769790649414 total time spend for step 2 : 57.58396625518799 step3:rle_unique_nms_with_priority Wed Jul 9 15:42:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 102 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 22 nb_hashtags : 2 time to prepare the origin masks : 9.269384622573853 time for calcul the mask position with numpy : 0.49752330780029297 nb_pixel_total : 7241392 time to create 1 rle with new method : 0.8691196441650391 time for calcul the mask position with numpy : 0.02541065216064453 nb_pixel_total : 71417 time to create 1 rle with old method : 0.07592582702636719 time for calcul the mask position with numpy : 0.024118661880493164 nb_pixel_total : 34828 time to create 1 rle with old method : 0.03643679618835449 time for calcul the mask position with numpy : 0.02405858039855957 nb_pixel_total : 19862 time to create 1 rle with old method : 0.022169113159179688 time for calcul the mask position with numpy : 0.027026653289794922 nb_pixel_total : 16900 time to create 1 rle with old method : 0.027949094772338867 time for calcul the mask position with numpy : 0.026125192642211914 nb_pixel_total : 37626 time to create 1 rle with old method : 0.04267144203186035 time for calcul the mask position with numpy : 0.02570199966430664 nb_pixel_total : 9540 time to create 1 rle with old method : 0.01043081283569336 time for calcul the mask position with numpy : 0.025200366973876953 nb_pixel_total : 54266 time to create 1 rle with old method : 0.057503461837768555 time for calcul the mask position with numpy : 0.02530670166015625 nb_pixel_total : 11266 time to create 1 rle with old method : 0.01222848892211914 time for calcul the mask position with numpy : 0.024461984634399414 nb_pixel_total : 11160 time to create 1 rle with old method : 0.01194906234741211 time for calcul the mask position with numpy : 0.02433037757873535 nb_pixel_total : 14527 time to create 1 rle with old method : 0.01542520523071289 time for calcul the mask position with numpy : 0.025654077529907227 nb_pixel_total : 13334 time to create 1 rle with old method : 0.014358997344970703 time for calcul the mask position with numpy : 0.02493453025817871 nb_pixel_total : 117658 time to create 1 rle with old method : 0.12653708457946777 time for calcul the mask position with numpy : 0.02502727508544922 nb_pixel_total : 79201 time to create 1 rle with old method : 0.08565735816955566 time for calcul the mask position with numpy : 0.02477431297302246 nb_pixel_total : 52736 time to create 1 rle with old method : 0.055816650390625 time for calcul the mask position with numpy : 0.02434849739074707 nb_pixel_total : 61190 time to create 1 rle with old method : 0.06306576728820801 time for calcul the mask position with numpy : 0.0242764949798584 nb_pixel_total : 38090 time to create 1 rle with old method : 0.040906667709350586 time for calcul the mask position with numpy : 0.023379087448120117 nb_pixel_total : 17307 time to create 1 rle with old method : 0.018245935440063477 time for calcul the mask position with numpy : 0.023716211318969727 nb_pixel_total : 14642 time to create 1 rle with old method : 0.015554189682006836 time for calcul the mask position with numpy : 0.023585081100463867 nb_pixel_total : 16561 time to create 1 rle with old method : 0.018182039260864258 time for calcul the mask position with numpy : 0.027377605438232422 nb_pixel_total : 306289 time to create 1 rle with new method : 1.0292789936065674 time for calcul the mask position with numpy : 0.024593591690063477 nb_pixel_total : 31972 time to create 1 rle with old method : 0.03418231010437012 time for calcul the mask position with numpy : 0.025206327438354492 nb_pixel_total : 22636 time to create 1 rle with old method : 0.02458643913269043 create new chi : 3.8134212493896484 time to delete rle : 0.018383026123046875 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 14320 TO DO : save crop sub photo not yet done ! save time : 0.8958806991577148 nb_obj : 22 nb_hashtags : 4 time to prepare the origin masks : 9.042232275009155 time for calcul the mask position with numpy : 0.5656321048736572 nb_pixel_total : 7364273 time to create 1 rle with new method : 1.3528995513916016 time for calcul the mask position with numpy : 0.02654123306274414 nb_pixel_total : 53224 time to create 1 rle with old method : 0.0565037727355957 time for calcul the mask position with numpy : 0.03405189514160156 nb_pixel_total : 84114 time to create 1 rle with old method : 0.08761477470397949 time for calcul the mask position with numpy : 0.023971080780029297 nb_pixel_total : 31653 time to create 1 rle with old method : 0.03350400924682617 time for calcul the mask position with numpy : 0.023426294326782227 nb_pixel_total : 478 time to create 1 rle with old method : 0.0007059574127197266 time for calcul the mask position with numpy : 0.024512529373168945 nb_pixel_total : 26330 time to create 1 rle with old method : 0.027077674865722656 time for calcul the mask position with numpy : 0.024013042449951172 nb_pixel_total : 47102 time to create 1 rle with old method : 0.04979372024536133 time for calcul the mask position with numpy : 0.024317026138305664 nb_pixel_total : 52245 time to create 1 rle with old method : 0.05460643768310547 time for calcul the mask position with numpy : 0.0234072208404541 nb_pixel_total : 7931 time to create 1 rle with old method : 0.008358955383300781 time for calcul the mask position with numpy : 0.02456951141357422 nb_pixel_total : 17769 time to create 1 rle with old method : 0.018463611602783203 time for calcul the mask position with numpy : 0.023730993270874023 nb_pixel_total : 15637 time to create 1 rle with old method : 0.016134977340698242 time for calcul the mask position with numpy : 0.02397322654724121 nb_pixel_total : 33733 time to create 1 rle with old method : 0.035492897033691406 time for calcul the mask position with numpy : 0.025328636169433594 nb_pixel_total : 51377 time to create 1 rle with old method : 0.054399967193603516 time for calcul the mask position with numpy : 0.024824142456054688 nb_pixel_total : 56745 time to create 1 rle with old method : 0.05992722511291504 time for calcul the mask position with numpy : 0.024581432342529297 nb_pixel_total : 32144 time to create 1 rle with old method : 0.034258127212524414 time for calcul the mask position with numpy : 0.02432870864868164 nb_pixel_total : 30851 time to create 1 rle with old method : 0.033408403396606445 time for calcul the mask position with numpy : 0.024460792541503906 nb_pixel_total : 16349 time to create 1 rle with old method : 0.018016338348388672 time for calcul the mask position with numpy : 0.02506709098815918 nb_pixel_total : 45576 time to create 1 rle with old method : 0.049013376235961914 time for calcul the mask position with numpy : 0.024254798889160156 nb_pixel_total : 87576 time to create 1 rle with old method : 0.0909879207611084 time for calcul the mask position with numpy : 0.023714065551757812 nb_pixel_total : 83308 time to create 1 rle with old method : 0.08758425712585449 time for calcul the mask position with numpy : 0.0247650146484375 nb_pixel_total : 91624 time to create 1 rle with old method : 0.09679651260375977 time for calcul the mask position with numpy : 0.023978471755981445 nb_pixel_total : 31946 time to create 1 rle with old method : 0.03449296951293945 time for calcul the mask position with numpy : 0.023904085159301758 nb_pixel_total : 32415 time to create 1 rle with old method : 0.034017086029052734 create new chi : 3.4862189292907715 time to delete rle : 0.0013823509216308594 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 13152 TO DO : save crop sub photo not yet done ! save time : 1.0469849109649658 nb_obj : 24 nb_hashtags : 2 time to prepare the origin masks : 9.017856121063232 time for calcul the mask position with numpy : 0.5370543003082275 nb_pixel_total : 7447395 time to create 1 rle with new method : 1.6492717266082764 time for calcul the mask position with numpy : 0.024648189544677734 nb_pixel_total : 9422 time to create 1 rle with old method : 0.010308980941772461 time for calcul the mask position with numpy : 0.024642467498779297 nb_pixel_total : 20561 time to create 1 rle with old method : 0.021950483322143555 time for calcul the mask position with numpy : 0.02469801902770996 nb_pixel_total : 19216 time to create 1 rle with old method : 0.020263195037841797 time for calcul the mask position with numpy : 0.023311853408813477 nb_pixel_total : 26002 time to create 1 rle with old method : 0.02810502052307129 time for calcul the mask position with numpy : 0.024101972579956055 nb_pixel_total : 95 time to create 1 rle with old method : 0.00011873245239257812 time for calcul the mask position with numpy : 0.02557659149169922 nb_pixel_total : 52482 time to create 1 rle with old method : 0.056993961334228516 time for calcul the mask position with numpy : 0.0248565673828125 nb_pixel_total : 60197 time to create 1 rle with old method : 0.06432485580444336 time for calcul the mask position with numpy : 0.025627851486206055 nb_pixel_total : 46660 time to create 1 rle with old method : 0.05208182334899902 time for calcul the mask position with numpy : 0.024612903594970703 nb_pixel_total : 61061 time to create 1 rle with old method : 0.06663250923156738 time for calcul the mask position with numpy : 0.025774002075195312 nb_pixel_total : 100809 time to create 1 rle with old method : 0.1089472770690918 time for calcul the mask position with numpy : 0.02418208122253418 nb_pixel_total : 11273 time to create 1 rle with old method : 0.012497901916503906 time for calcul the mask position with numpy : 0.025131702423095703 nb_pixel_total : 14376 time to create 1 rle with old method : 0.015711307525634766 time for calcul the mask position with numpy : 0.024727821350097656 nb_pixel_total : 2651 time to create 1 rle with old method : 0.0028836727142333984 time for calcul the mask position with numpy : 0.025011539459228516 nb_pixel_total : 11766 time to create 1 rle with old method : 0.012703657150268555 time for calcul the mask position with numpy : 0.024821996688842773 nb_pixel_total : 48181 time to create 1 rle with old method : 0.05204153060913086 time for calcul the mask position with numpy : 0.02478957176208496 nb_pixel_total : 19101 time to create 1 rle with old method : 0.020890235900878906 time for calcul the mask position with numpy : 0.02613091468811035 nb_pixel_total : 10939 time to create 1 rle with old method : 0.011812210083007812 time for calcul the mask position with numpy : 0.025119543075561523 nb_pixel_total : 86073 time to create 1 rle with old method : 0.09699869155883789 time for calcul the mask position with numpy : 0.024936914443969727 nb_pixel_total : 47141 time to create 1 rle with old method : 0.05030083656311035 time for calcul the mask position with numpy : 0.02917337417602539 nb_pixel_total : 24952 time to create 1 rle with old method : 0.030014991760253906 time for calcul the mask position with numpy : 0.02596592903137207 nb_pixel_total : 67535 time to create 1 rle with old method : 0.07266592979431152 time for calcul the mask position with numpy : 0.025593996047973633 nb_pixel_total : 23566 time to create 1 rle with old method : 0.025651216506958008 time for calcul the mask position with numpy : 0.025851726531982422 nb_pixel_total : 30278 time to create 1 rle with old method : 0.03388237953186035 time for calcul the mask position with numpy : 0.02669358253479004 nb_pixel_total : 52668 time to create 1 rle with old method : 0.05813789367675781 create new chi : 3.7604594230651855 time to delete rle : 0.001560211181640625 batch 1 Loaded 49 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 13354 TO DO : save crop sub photo not yet done ! save time : 0.8654744625091553 nb_obj : 10 nb_hashtags : 1 time to prepare the origin masks : 4.001526117324829 time for calcul the mask position with numpy : 0.5284605026245117 nb_pixel_total : 7976992 time to create 1 rle with new method : 0.8736038208007812 time for calcul the mask position with numpy : 0.022722721099853516 nb_pixel_total : 8606 time to create 1 rle with old method : 0.009119510650634766 time for calcul the mask position with numpy : 0.0229489803314209 nb_pixel_total : 16355 time to create 1 rle with old method : 0.01754450798034668 time for calcul the mask position with numpy : 0.02332329750061035 nb_pixel_total : 17011 time to create 1 rle with old method : 0.017577171325683594 time for calcul the mask position with numpy : 0.02411675453186035 nb_pixel_total : 19616 time to create 1 rle with old method : 0.020334243774414062 time for calcul the mask position with numpy : 0.024764060974121094 nb_pixel_total : 14276 time to create 1 rle with old method : 0.014919281005859375 time for calcul the mask position with numpy : 0.02420186996459961 nb_pixel_total : 21951 time to create 1 rle with old method : 0.022754907608032227 time for calcul the mask position with numpy : 0.023136138916015625 nb_pixel_total : 11391 time to create 1 rle with old method : 0.011730432510375977 time for calcul the mask position with numpy : 0.023471832275390625 nb_pixel_total : 83308 time to create 1 rle with old method : 0.08549761772155762 time for calcul the mask position with numpy : 0.023760557174682617 nb_pixel_total : 111591 time to create 1 rle with old method : 0.1177823543548584 time for calcul the mask position with numpy : 0.022941112518310547 nb_pixel_total : 13303 time to create 1 rle with old method : 0.013683319091796875 create new chi : 2.008317470550537 time to delete rle : 0.0008137226104736328 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 6324 TO DO : save crop sub photo not yet done ! save time : 0.4470798969268799 nb_obj : 24 nb_hashtags : 3 time to prepare the origin masks : 8.255443334579468 time for calcul the mask position with numpy : 0.761195182800293 nb_pixel_total : 7383951 time to create 1 rle with new method : 1.3890056610107422 time for calcul the mask position with numpy : 0.02268695831298828 nb_pixel_total : 7445 time to create 1 rle with old method : 0.007818460464477539 time for calcul the mask position with numpy : 0.022882938385009766 nb_pixel_total : 17031 time to create 1 rle with old method : 0.018056154251098633 time for calcul the mask position with numpy : 0.023855209350585938 nb_pixel_total : 34653 time to create 1 rle with old method : 0.03738760948181152 time for calcul the mask position with numpy : 0.024765491485595703 nb_pixel_total : 20727 time to create 1 rle with old method : 0.0229032039642334 time for calcul the mask position with numpy : 0.027954816818237305 nb_pixel_total : 7911 time to create 1 rle with old method : 0.012365102767944336 time for calcul the mask position with numpy : 0.03487563133239746 nb_pixel_total : 8091 time to create 1 rle with old method : 0.009192705154418945 time for calcul the mask position with numpy : 0.025310277938842773 nb_pixel_total : 14882 time to create 1 rle with old method : 0.01627635955810547 time for calcul the mask position with numpy : 0.026173830032348633 nb_pixel_total : 15850 time to create 1 rle with old method : 0.01723170280456543 time for calcul the mask position with numpy : 0.025601625442504883 nb_pixel_total : 9837 time to create 1 rle with old method : 0.01672220230102539 time for calcul the mask position with numpy : 0.024570941925048828 nb_pixel_total : 13402 time to create 1 rle with old method : 0.014787673950195312 time for calcul the mask position with numpy : 0.025445222854614258 nb_pixel_total : 14585 time to create 1 rle with old method : 0.015778303146362305 time for calcul the mask position with numpy : 0.02568507194519043 nb_pixel_total : 77928 time to create 1 rle with old method : 0.08397650718688965 time for calcul the mask position with numpy : 0.026538610458374023 nb_pixel_total : 42670 time to create 1 rle with old method : 0.06334376335144043 time for calcul the mask position with numpy : 0.02812671661376953 nb_pixel_total : 13338 time to create 1 rle with old method : 0.014882802963256836 time for calcul the mask position with numpy : 0.02748703956604004 nb_pixel_total : 195042 time to create 1 rle with new method : 0.9370486736297607 time for calcul the mask position with numpy : 0.024048566818237305 nb_pixel_total : 70220 time to create 1 rle with old method : 0.07231259346008301 time for calcul the mask position with numpy : 0.025260210037231445 nb_pixel_total : 16389 time to create 1 rle with old method : 0.016952991485595703 time for calcul the mask position with numpy : 0.02422022819519043 nb_pixel_total : 7934 time to create 1 rle with old method : 0.008585929870605469 time for calcul the mask position with numpy : 0.026783227920532227 nb_pixel_total : 39072 time to create 1 rle with old method : 0.04284358024597168 time for calcul the mask position with numpy : 0.027964353561401367 nb_pixel_total : 53032 time to create 1 rle with old method : 0.05697345733642578 time for calcul the mask position with numpy : 0.02814340591430664 nb_pixel_total : 70517 time to create 1 rle with old method : 0.07670950889587402 time for calcul the mask position with numpy : 0.025964736938476562 nb_pixel_total : 74641 time to create 1 rle with old method : 0.07998490333557129 time for calcul the mask position with numpy : 0.028971433639526367 nb_pixel_total : 61676 time to create 1 rle with old method : 0.0685429573059082 time for calcul the mask position with numpy : 0.023647785186767578 nb_pixel_total : 23576 time to create 1 rle with old method : 0.024501800537109375 create new chi : 4.575514078140259 time to delete rle : 0.0016796588897705078 batch 1 Loaded 49 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 14028 TO DO : save crop sub photo not yet done ! save time : 0.8784315586090088 map_output_result : {1371379751: (0.0, 'Should be the crop_list due to order', 0), 1371379749: (0.0, 'Should be the crop_list due to order', 0), 1371379748: (0.0, 'Should be the crop_list due to order', 0), 1371379747: (0.0, 'Should be the crop_list due to order', 0), 1371379572: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1371379751, 1371379749, 1371379748, 1371379747, 1371379572] Looping around the photos to save general results len do output : 5 /1371379751.Didn't retrieve data . /1371379749.Didn't retrieve data . /1371379748.Didn't retrieve data . /1371379747.Didn't retrieve data . /1371379572.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379751', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379749', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379748', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379747', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379572', None, None, None, None, None, '3253199') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01471710205078125 save_final save missing photos in datou_result : time spend for datou_step_exec : 62.317341804504395 time spend to save output : 0.015078544616699219 total time spend for step 3 : 62.332420349121094 step4:ventilate_hashtags_in_portfolio Wed Jul 9 15:43:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 24753734 get user id for portfolio 24753734 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24753734 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pehd','carton','pet_fonce','metal','flou','background','environnement','pet_clair','mal_croppe','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24753734 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pehd','carton','pet_fonce','metal','flou','background','environnement','pet_clair','mal_croppe','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24753734 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pehd','carton','pet_fonce','metal','flou','background','environnement','pet_clair','mal_croppe','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/24754172,24754173,24754174,24754176,24754177,24754178,24754179,24754180,24754181,24754182,24754183?tags=autre,pehd,carton,pet_fonce,metal,flou,background,environnement,pet_clair,mal_croppe,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1371379751, 1371379749, 1371379748, 1371379747, 1371379572] Looping around the photos to save general results len do output : 1 /24753734. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379751', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379749', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379748', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379747', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379572', None, None, None, None, None, '3253199') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013537168502807617 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6361291408538818 time spend to save output : 0.013757705688476562 total time spend for step 4 : 1.6498868465423584 step5:final Wed Jul 9 15:43:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1371379751: ('0.09784907889660494',), 1371379749: ('0.09784907889660494',), 1371379748: ('0.09784907889660494',), 1371379747: ('0.09784907889660494',), 1371379572: ('0.09784907889660494',)} new output for save of step final : {1371379751: ('0.09784907889660494',), 1371379749: ('0.09784907889660494',), 1371379748: ('0.09784907889660494',), 1371379747: ('0.09784907889660494',), 1371379572: ('0.09784907889660494',)} [1371379751, 1371379749, 1371379748, 1371379747, 1371379572] Looping around the photos to save general results len do output : 5 /1371379751.Didn't retrieve data . /1371379749.Didn't retrieve data . /1371379748.Didn't retrieve data . /1371379747.Didn't retrieve data . /1371379572.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379751', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379749', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379748', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379747', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379572', None, None, None, None, None, '3253199') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.014827251434326172 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11860299110412598 time spend to save output : 0.015142679214477539 total time spend for step 5 : 0.13374567031860352 step6:blur_detection Wed Jul 9 15:43:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321.jpg resize: (2160, 3840) 1371379751 -6.56983962879769 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050.jpg resize: (2160, 3840) 1371379749 -6.569227374312575 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561.jpg resize: (2160, 3840) 1371379748 -5.830148457109177 treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143.jpg resize: (2160, 3840) 1371379747 -6.919917861546449 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252.jpg resize: (2160, 3840) 1371379572 -7.159842828291332 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340407_0.png resize: (143, 193) 1371387842 -3.853139864731115 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340408_0.png resize: (211, 219) 1371387844 -1.4281284664500307 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340409_0.png resize: (600, 719) 1371387845 -3.409186987236469 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340410_0.png resize: (191, 137) 1371387847 -3.0992204608733513 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340411_0.png resize: (136, 175) 1371387849 -1.2944950875444219 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340412_0.png resize: (192, 105) 1371387850 -4.254945312089591 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340413_0.png resize: (373, 218) 1371387851 -3.7167320779127553 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340414_0.png resize: (344, 246) 1371387853 -3.1768337092060404 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340415_0.png resize: (364, 242) 1371387855 -4.0328904674915185 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340416_0.png resize: (309, 329) 1371387856 -4.418261239324415 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340417_0.png resize: (530, 328) 1371387858 -2.052710768284778 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340418_0.png resize: (146, 151) 1371387859 -4.75540960942611 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340419_0.png resize: (136, 152) 1371387860 -4.0783406147874555 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340420_0.png resize: (178, 93) 1371387861 -3.6239930850332223 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340421_0.png resize: (291, 185) 1371387863 -3.38094560545626 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340422_0.png resize: (298, 305) 1371387864 1.6519706926983877 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340423_0.png resize: (130, 93) 1371387865 -3.1083278615752374 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340425_0.png resize: (242, 101) 1371387867 -4.30969201355536 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340426_0.png resize: (115, 219) 1371387868 -2.722897114038841 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340427_0.png resize: (237, 219) 1371387869 -5.102940070924347 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340428_0.png resize: (270, 575) 1371387870 -4.642042598139157 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340429_0.png resize: (275, 244) 1371387872 -0.7528034485379426 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340430_0.png resize: (208, 241) 1371387873 -3.3448679408122204 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340431_0.png resize: (548, 295) 1371387874 -4.095938409789492 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340433_0.png resize: (419, 366) 1371387876 -3.9245364613769955 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340434_0.png resize: (234, 393) 1371387877 -4.64049762734571 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340435_0.png resize: (153, 143) 1371387878 -3.9044987112984213 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340436_0.png resize: (164, 222) 1371387879 -3.0207231117567006 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340437_0.png resize: (130, 319) 1371387881 -3.161771694703248 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340438_0.png resize: (282, 347) 1371387882 -2.7488434195310125 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340439_0.png resize: (240, 305) 1371387883 -3.912825735652156 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340440_0.png resize: (236, 229) 1371387885 -4.551698266835903 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340441_0.png resize: (165, 167) 1371387886 -2.5439431081936377 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340442_0.png resize: (176, 168) 1371387887 -2.917422698761737 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340444_0.png resize: (232, 278) 1371387888 -4.118605495699306 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340445_0.png resize: (305, 299) 1371387890 -4.039840344524359 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340446_0.png resize: (186, 162) 1371387891 1.0123452786769829 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340447_0.png resize: (153, 208) 1371387892 -4.384677476274788 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340448_0.png resize: (205, 246) 1371387894 -3.94379086759974 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340449_0.png resize: (333, 368) 1371387895 -4.017467064449202 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340451_0.png resize: (317, 278) 1371387896 1.924702166205802 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340452_0.png resize: (241, 190) 1371387897 -3.604749777109522 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340453_0.png resize: (178, 205) 1371387899 -4.009751813718481 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340454_0.png resize: (334, 338) 1371387900 -3.7057688771196022 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340455_0.png resize: (178, 236) 1371387901 -2.1382608109687267 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340456_0.png resize: (325, 217) 1371387903 -4.710992093137804 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340458_0.png resize: (97, 141) 1371387904 -4.392611355737759 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340459_0.png resize: (142, 232) 1371387905 -3.0159012918274137 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340460_0.png resize: (329, 206) 1371387907 -4.660946442981754 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340461_0.png resize: (101, 153) 1371387908 -3.534825818865672 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340462_0.png resize: (172, 86) 1371387909 -3.1950414659248856 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340463_0.png resize: (182, 179) 1371387910 -3.763721072544091 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340464_0.png resize: (132, 130) 1371387912 -3.5259713367948597 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340467_0.png resize: (326, 236) 1371387913 -4.208007292261538 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340468_0.png resize: (358, 202) 1371387914 -4.560335431856589 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340469_0.png resize: (321, 315) 1371387916 -3.6317093832279665 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340470_0.png resize: (127, 165) 1371387917 4.899580553609855 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340471_0.png resize: (248, 176) 1371387918 -4.4314989368553785 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340472_0.png resize: (191, 153) 1371387919 -4.9565707297081225 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340473_0.png resize: (228, 143) 1371387921 -4.928956150766165 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340474_0.png resize: (152, 108) 1371387922 -4.017616752463238 treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340475_0.png resize: (87, 176) 1371387923 -1.3222316899241424 treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340476_0.png resize: (391, 323) 1371387925 -3.164213112526523 treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340477_0.png resize: (430, 341) 1371387926 -3.03083194673449 treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340478_0.png resize: (90, 149) 1371387927 -1.862185295573368 treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340479_0.png resize: (194, 225) 1371387928 -3.405918461682315 treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340480_0.png resize: (132, 148) 1371387930 -4.2912364507413 treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340481_0.png resize: (221, 131) 1371387931 -2.8152249600475923 treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340482_0.png resize: (134, 146) 1371387932 0.04814956254288762 treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340483_0.png resize: (189, 161) 1371387934 -1.6044382127217345 treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340484_0.png resize: (161, 160) 1371387935 -3.7267314758531085 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340485_0.png resize: (122, 273) 1371387936 -1.3773251826741422 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340487_0.png resize: (315, 383) 1371387938 -4.1654013249306585 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340488_0.png resize: (253, 467) 1371387939 -5.112546873969532 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340489_0.png resize: (307, 327) 1371387940 0.6417147081640775 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340490_0.png resize: (239, 291) 1371387942 -3.479640503945931 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340491_0.png resize: (73, 139) 1371387943 -3.7656220779978047 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340492_0.png resize: (193, 125) 1371387944 -2.8280813912751204 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340493_0.png resize: (392, 231) 1371387945 -3.26803325521975 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340494_0.png resize: (533, 493) 1371387947 -5.6296763207840055 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340495_0.png resize: (118, 172) 1371387948 -0.3532145198376365 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340496_0.png resize: (309, 218) 1371387949 -3.4122792408879787 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340497_0.png resize: (335, 395) 1371387951 -2.857278595132338 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340498_0.png resize: (209, 92) 1371387952 -1.7985745896239214 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340500_0.png resize: (147, 113) 1371387953 -4.0577291491066365 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340501_0.png resize: (163, 125) 1371387954 -3.0195100443002194 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340502_0.png resize: (114, 154) 1371387956 -4.08325727681677 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340503_0.png resize: (152, 154) 1371387957 -3.7789934235515896 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340504_0.png resize: (318, 75) 1371387958 -3.393055348261673 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340505_0.png resize: (252, 191) 1371387960 -3.3515866117412183 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340506_0.png resize: (195, 278) 1371387961 -4.278469368946877 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340508_0.png resize: (117, 95) 1371387962 -5.096826936668233 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340432_0.png resize: (308, 398) 1371387990 -3.6295551849949867 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340486_0.png resize: (319, 266) 1371387992 -4.107942298322136 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340507_0.png resize: (146, 158) 1371387993 -4.687656301012455 treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340499_0.png resize: (117, 139) 1371388096 -4.385475154050673 treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340424_0.png resize: (256, 242) 1371388108 -4.4793059212099875 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340457_0.png resize: (268, 529) 1371388109 -4.815988211125143 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340465_0.png resize: (135, 1076) 1371388111 -3.848572268700508 treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340466_0.png resize: (256, 301) 1371388112 -4.086944724655051 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340443_0.png resize: (95, 101) 1371388118 -3.1705135510105493 treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340450_0.png resize: (269, 256) 1371388121 -2.1206037240902527 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 107 time used for this insertion : 0.016338348388671875 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 107 time used for this insertion : 0.026168346405029297 save missing photos in datou_result : time spend for datou_step_exec : 18.464770317077637 time spend to save output : 0.04772019386291504 total time spend for step 6 : 18.51249051094055 step7:brightness Wed Jul 9 15:43:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321.jpg treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050.jpg treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561.jpg treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143.jpg treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252.jpg treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340407_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340408_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340409_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340410_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340411_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340412_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340413_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340414_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340415_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340416_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340417_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340418_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340419_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340420_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340421_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340422_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340423_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340425_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340426_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340427_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340428_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340429_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340430_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340431_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340433_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340434_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340435_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340436_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340437_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340438_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340439_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340440_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340441_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340442_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340444_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340445_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340446_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340447_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340448_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340449_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340451_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340452_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340453_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340454_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340455_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340456_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340458_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340459_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340460_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340461_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340462_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340463_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340464_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340467_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340468_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340469_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340470_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340471_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340472_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340473_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340474_0.png treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340475_0.png treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340476_0.png treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340477_0.png treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340478_0.png treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340479_0.png treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340480_0.png treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340481_0.png treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340482_0.png treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340483_0.png treat image : temp/1752068428_3394967_1371379747_d4df1948e0ad20606cb700fe39c4a96c_78601143_rle_crop_3877340484_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340485_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340487_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340488_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340489_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340490_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340491_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340492_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340493_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340494_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340495_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340496_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340497_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340498_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340500_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340501_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340502_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340503_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340504_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340505_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340506_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340508_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340432_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340486_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340507_0.png treat image : temp/1752068428_3394967_1371379572_b054d83094c27a13586b38d92811aff1_15574252_rle_crop_3877340499_0.png treat image : temp/1752068428_3394967_1371379751_b7014f0f426fd6476880fea814d20e72_24849321_rle_crop_3877340424_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340457_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340465_0.png treat image : temp/1752068428_3394967_1371379748_152cf08b1c036af2f7cf7cb9068ae059_24173561_rle_crop_3877340466_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340443_0.png treat image : temp/1752068428_3394967_1371379749_69077fbb75da771c98492f94c1356521_50218050_rle_crop_3877340450_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 107 time used for this insertion : 0.017567157745361328 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 107 time used for this insertion : 0.02938246726989746 save missing photos in datou_result : time spend for datou_step_exec : 5.0605151653289795 time spend to save output : 0.05187869071960449 total time spend for step 7 : 5.112393856048584 step8:velours_tree Wed Jul 9 15:43:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.0809028148651123 time spend to save output : 3.695487976074219e-05 total time spend for step 8 : 0.08093976974487305 step9:send_mail_cod Wed Jul 9 15:43:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P24753734_09-07-2025_15_43_53.pdf 24754172 change filename to text .imagette247541721752068633 24754173 change filename to text .imagette247541731752068633 24754174 change filename to text .change filename to text .change filename to text .imagette247541741752068633 24754176 imagette247541761752068633 24754177 change filename to text .imagette247541771752068633 24754178 imagette247541781752068633 24754179 imagette247541791752068633 24754181 change filename to text .change filename to text .change filename to text .change filename to text .imagette247541811752068633 24754182 imagette247541821752068634 24754183 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette247541831752068634 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=24753734 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/24754172,24754173,24754174,24754176,24754177,24754178,24754179,24754180,24754181,24754182,24754183?tags=autre,pehd,carton,pet_fonce,metal,flou,background,environnement,pet_clair,mal_croppe,papier args[1371379751] : ((1371379751, -6.56983962879769, 492609224), (1371379751, 0.3817955968765012, 2107752395), '0.09784907889660494') We are sending mail with results at report@fotonower.com args[1371379749] : ((1371379749, -6.569227374312575, 492609224), (1371379749, 0.4093485210777475, 2107752395), '0.09784907889660494') We are sending mail with results at report@fotonower.com args[1371379748] : ((1371379748, -5.830148457109177, 492609224), (1371379748, -0.0398614179897568, 2107752395), '0.09784907889660494') We are sending mail with results at report@fotonower.com args[1371379747] : ((1371379747, -6.919917861546449, 492609224), (1371379747, 0.5105544354258167, 2107752395), '0.09784907889660494') We are sending mail with results at report@fotonower.com args[1371379572] : ((1371379572, -7.159842828291332, 492609224), (1371379572, 0.6083357038912405, 2107752395), '0.09784907889660494') We are sending mail with results at report@fotonower.com refus_total : 0.09784907889660494 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=24753734 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24753734_09-07-2025_15_43_53.pdf results_Auto_P24753734_09-07-2025_15_43_53.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24753734_09-07-2025_15_43_53.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','24753734','results_Auto_P24753734_09-07-2025_15_43_53.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24753734_09-07-2025_15_43_53.pdf','pdf','','0.3','0.09784907889660494') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/24753734

https://www.fotonower.com/image?json=false&list_photos_id=1371379751
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371379749
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371379748
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371379747
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371379572
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 9.78%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/24754172?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/24754173?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/24754174?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/24754177?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/24754181?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/24754183?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24753734_09-07-2025_15_43_53.pdf.

Lien vers velours :https://www.fotonower.com/velours/24754172,24754173,24754174,24754176,24754177,24754178,24754179,24754180,24754181,24754182,24754183?tags=autre,pehd,carton,pet_fonce,metal,flou,background,environnement,pet_clair,mal_croppe,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 09 Jul 2025 13:43:57 GMT Content-Length: 0 Connection: close X-Message-Id: I5LstILKTgSVvZa6gMh4qw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1371379751, 1371379749, 1371379748, 1371379747, 1371379572] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379751', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379749', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379748', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379747', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379572', None, None, None, None, None, '3253199') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012217521667480469 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.391014814376831 time spend to save output : 0.01237797737121582 total time spend for step 9 : 4.403392791748047 step10:split_time_score Wed Jul 9 15:43:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 09072025 24753734 Nombre de photos uploadées : 5 / 23040 (0%) 09072025 24753734 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 09072025 24753734 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 4.5299530029296875e-06 ????? elapsed_time : fill_and_build_computed_from_old_data 0.00031495094299316406 elapsed_time : insert_dashboard_record_day_entry 0.02233099937438965 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24753640 order by id desc limit 1 Qualite : 0.014624281427861147 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24753723_09-07-2025_15_42_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24753723 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24753723 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24753732 order by id desc limit 1 Qualite : 0.09784907889660494 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24753734_09-07-2025_15_43_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24753734 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24753734 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'09072025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1371379751, 1371379749, 1371379748, 1371379747, 1371379572] Looping around the photos to save general results len do output : 1 /24753734Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379751', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379749', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379748', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379747', None, None, None, None, None, '3253199') ('3318', None, None, None, None, None, None, None, '3253199') ('3318', '24753734', '1371379572', None, None, None, None, None, '3253199') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013739585876464844 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.4768519401550293 time spend to save output : 0.013899564743041992 total time spend for step 10 : 2.4907515048980713 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 82.72user 88.96system 3:34.62elapsed 79%CPU (0avgtext+0avgdata 4534980maxresident)k 515296inputs+65032outputs (94major+8337122minor)pagefaults 0swaps