python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2022062 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4022489'] with mtr_portfolio_ids : ['28352790'] and first list_photo_ids : [] new path : /proc/2022062/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 17 ; length of list_pids : 17 ; length of list_args : 17 time to download the photos : 2.3573100566864014 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Sat Nov 8 12:20:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3025 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-08 12:20:35.557608: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-08 12:20:35.582557: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-08 12:20:35.584696: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f38ac000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-08 12:20:35.584758: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-08 12:20:35.588783: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-08 12:20:35.828020: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xaf89260 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-08 12:20:35.828083: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-08 12:20:35.829230: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-08 12:20:35.829737: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-08 12:20:35.832925: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-08 12:20:35.835935: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-08 12:20:35.836871: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-08 12:20:35.839415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-08 12:20:35.840537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-08 12:20:35.845084: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-08 12:20:35.846099: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-08 12:20:35.846178: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-08 12:20:35.846759: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-08 12:20:35.846777: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-08 12:20:35.846787: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-08 12:20:35.847653: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2573 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-08 12:20:36.139794: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-08 12:20:36.139886: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-08 12:20:36.139917: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-08 12:20:36.139938: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-08 12:20:36.139956: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-08 12:20:36.139974: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-08 12:20:36.139992: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-08 12:20:36.140011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-08 12:20:36.141003: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-08 12:20:36.142078: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-08 12:20:36.142112: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-08 12:20:36.142132: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-08 12:20:36.142150: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-08 12:20:36.142170: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-08 12:20:36.142189: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-08 12:20:36.142206: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-08 12:20:36.142223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-08 12:20:36.143219: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-08 12:20:36.143253: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-08 12:20:36.143264: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-08 12:20:36.143273: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-08 12:20:36.144310: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2573 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-08 12:20:43.872892: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-08 12:20:44.067128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-08 12:20:45.333737: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-08 12:20:45.333783: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-08 12:20:45.340236: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-08 12:20:45.340258: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-08 12:20:45.389659: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-08 12:20:45.389712: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-08 12:20:45.431931: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-08 12:20:45.431967: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-08 12:20:45.480418: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-08 12:20:45.480464: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-11-08 12:20:45.482563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.51G (1626210304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.483131: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.36G (1463589376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.800467: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-11-08 12:20:45.847695: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.848280: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.849035: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.849599: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.859955: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.860528: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.861523: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.862363: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.863194: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.864027: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.878505: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.879091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.913081: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.913176: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-11-08 12:20:45.914254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.915370: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.922915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.923659: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.931518: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.932135: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.948604: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.949199: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.949774: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.950345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.954396: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.955006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.955616: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.956205: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.957215: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.967370: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.967968: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.976979: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.977552: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.978123: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.978707: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.979281: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-11-08 12:20:45.979843: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 2022679 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1832 tf kernel not reseted sub process len(results) : 17 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 17 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3025 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00031280517578125 nb_pixel_total : 10713 time to create 1 rle with old method : 0.01195979118347168 length of segment : 197 time for calcul the mask position with numpy : 0.0001983642578125 nb_pixel_total : 12377 time to create 1 rle with old method : 0.013709545135498047 length of segment : 116 time for calcul the mask position with numpy : 0.00018978118896484375 nb_pixel_total : 9002 time to create 1 rle with old method : 0.010120153427124023 length of segment : 125 time for calcul the mask position with numpy : 0.00012540817260742188 nb_pixel_total : 7053 time to create 1 rle with old method : 0.008053302764892578 length of segment : 100 time for calcul the mask position with numpy : 0.0001227855682373047 nb_pixel_total : 7075 time to create 1 rle with old method : 0.008406400680541992 length of segment : 74 time for calcul the mask position with numpy : 0.00021219253540039062 nb_pixel_total : 11695 time to create 1 rle with old method : 0.013815879821777344 length of segment : 119 time for calcul the mask position with numpy : 0.0015063285827636719 nb_pixel_total : 85710 time to create 1 rle with old method : 0.09438705444335938 length of segment : 368 time for calcul the mask position with numpy : 0.0003135204315185547 nb_pixel_total : 12186 time to create 1 rle with old method : 0.013612031936645508 length of segment : 156 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1803 time to create 1 rle with old method : 0.002141714096069336 length of segment : 47 time for calcul the mask position with numpy : 0.0002181529998779297 nb_pixel_total : 13144 time to create 1 rle with old method : 0.014648675918579102 length of segment : 100 time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 4536 time to create 1 rle with old method : 0.004895448684692383 length of segment : 109 time for calcul the mask position with numpy : 0.0002269744873046875 nb_pixel_total : 11473 time to create 1 rle with old method : 0.0131683349609375 length of segment : 151 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 6100 time to create 1 rle with old method : 0.006659746170043945 length of segment : 175 time for calcul the mask position with numpy : 0.0001666545867919922 nb_pixel_total : 11216 time to create 1 rle with old method : 0.012392759323120117 length of segment : 113 time for calcul the mask position with numpy : 0.0009877681732177734 nb_pixel_total : 77894 time to create 1 rle with old method : 0.08394980430603027 length of segment : 343 time for calcul the mask position with numpy : 0.0006883144378662109 nb_pixel_total : 38335 time to create 1 rle with old method : 0.04347062110900879 length of segment : 218 time for calcul the mask position with numpy : 0.00021386146545410156 nb_pixel_total : 10285 time to create 1 rle with old method : 0.01155853271484375 length of segment : 171 time for calcul the mask position with numpy : 0.0001266002655029297 nb_pixel_total : 7574 time to create 1 rle with old method : 0.00845646858215332 length of segment : 92 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 3799 time to create 1 rle with old method : 0.004302263259887695 length of segment : 91 time for calcul the mask position with numpy : 0.0001804828643798828 nb_pixel_total : 8588 time to create 1 rle with old method : 0.009662151336669922 length of segment : 187 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 3728 time to create 1 rle with old method : 0.004209995269775391 length of segment : 107 time for calcul the mask position with numpy : 0.00010895729064941406 nb_pixel_total : 5889 time to create 1 rle with old method : 0.006631135940551758 length of segment : 91 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 4610 time to create 1 rle with old method : 0.005137443542480469 length of segment : 77 time for calcul the mask position with numpy : 0.00011730194091796875 nb_pixel_total : 7237 time to create 1 rle with old method : 0.00811147689819336 length of segment : 86 time for calcul the mask position with numpy : 0.00019979476928710938 nb_pixel_total : 11472 time to create 1 rle with old method : 0.012521028518676758 length of segment : 181 time for calcul the mask position with numpy : 0.00018453598022460938 nb_pixel_total : 11666 time to create 1 rle with old method : 0.012787818908691406 length of segment : 164 time for calcul the mask position with numpy : 0.00015211105346679688 nb_pixel_total : 8035 time to create 1 rle with old method : 0.009115934371948242 length of segment : 115 time for calcul the mask position with numpy : 0.00019502639770507812 nb_pixel_total : 9710 time to create 1 rle with old method : 0.01104116439819336 length of segment : 252 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 2973 time to create 1 rle with old method : 0.003429889678955078 length of segment : 60 time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 16359 time to create 1 rle with old method : 0.01854562759399414 length of segment : 285 time for calcul the mask position with numpy : 0.00030541419982910156 nb_pixel_total : 9638 time to create 1 rle with old method : 0.010247945785522461 length of segment : 122 time for calcul the mask position with numpy : 0.00022363662719726562 nb_pixel_total : 6028 time to create 1 rle with old method : 0.006848812103271484 length of segment : 137 time for calcul the mask position with numpy : 0.00026869773864746094 nb_pixel_total : 6246 time to create 1 rle with old method : 0.006823301315307617 length of segment : 145 time for calcul the mask position with numpy : 0.00024366378784179688 nb_pixel_total : 9497 time to create 1 rle with old method : 0.010597467422485352 length of segment : 85 time for calcul the mask position with numpy : 0.00022459030151367188 nb_pixel_total : 2970 time to create 1 rle with old method : 0.0035185813903808594 length of segment : 98 time for calcul the mask position with numpy : 0.0002315044403076172 nb_pixel_total : 8547 time to create 1 rle with old method : 0.009609222412109375 length of segment : 83 time for calcul the mask position with numpy : 0.00023174285888671875 nb_pixel_total : 6366 time to create 1 rle with old method : 0.007089376449584961 length of segment : 102 time for calcul the mask position with numpy : 0.00044918060302734375 nb_pixel_total : 10605 time to create 1 rle with old method : 0.01138448715209961 length of segment : 190 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1640 time to create 1 rle with old method : 0.0019071102142333984 length of segment : 82 time spent for convertir_results : 1.5870897769927979 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 39 chid ids of type : 3594 Number RLEs to save : 5514 save missing photos in datou_result : time spend for datou_step_exec : 25.652670860290527 time spend to save output : 0.3719205856323242 total time spend for step 1 : 26.02459144592285 step2:crop_condition Sat Nov 8 12:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 17 ! batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762600860_2022062 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377422_4bec61df0f9f26e73bad4304f9afd8f2_rle_crop_4027197406_0.png', 0, 126, 184, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377328_10d942fe99bc0d0abb0800cd4cde54e3_rle_crop_4027197408_0.png', 0, 147, 119, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377328_10d942fe99bc0d0abb0800cd4cde54e3_rle_crop_4027197407_0.png', 0, 159, 113, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197412_0.png', 0, 592, 256, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197410_0.png', 0, 123, 74, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197414_0.png', 0, 65, 45, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197413_0.png', 0, 194, 156, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197409_0.png', 0, 86, 100, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7_rle_crop_4027197416_0.png', 0, 57, 107, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7_rle_crop_4027197418_0.png', 0, 64, 120, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377189_4ca2ed24947845423d659d8d21cc16d0_rle_crop_4027197421_0.png', 0, 287, 211, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4_rle_crop_4027197424_0.png', 0, 67, 91, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4_rle_crop_4027197423_0.png', 0, 109, 92, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4_rle_crop_4027197425_0.png', 0, 136, 159, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4_rle_crop_4027197426_0.png', 0, 60, 107, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376779_3a20695d43f5b8199fbb2ff08547f6f9_rle_crop_4027197430_0.png', 0, 114, 181, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376746_1d44501d2d034bf83180f1038f05adcc_rle_crop_4027197431_0.png', 0, 115, 138, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376746_1d44501d2d034bf83180f1038f05adcc_rle_crop_4027197432_0.png', 0, 143, 82, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376745_56e5c185ab836afb5c1afa79f1f3a874_rle_crop_4027197435_0.png', 0, 276, 150, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376745_56e5c185ab836afb5c1afa79f1f3a874_rle_crop_4027197434_0.png', 0, 73, 59, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376745_56e5c185ab836afb5c1afa79f1f3a874_rle_crop_4027197433_0.png', 0, 110, 186, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376735_c787c19f008e5277cfb9fb14fe2e7e8f_rle_crop_4027197437_0.png', 0, 104, 89, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376735_c787c19f008e5277cfb9fb14fe2e7e8f_rle_crop_4027197436_0.png', 0, 105, 122, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376732_595f2f6cb620fff6b11fcb401511bebb_rle_crop_4027197439_0.png', 0, 199, 75, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376731_217d83527cc18accfb035dac5f17a751_rle_crop_4027197440_0.png', 0, 87, 98, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376730_702cba6461d0cdfb80dd7426a99d830b_rle_crop_4027197443_0.png', 0, 98, 190, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376730_702cba6461d0cdfb80dd7426a99d830b_rle_crop_4027197442_0.png', 0, 85, 102, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600865), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376730_702cba6461d0cdfb80dd7426a99d830b_rle_crop_4027197444_0.png', 0, 49, 64, 0, 1762600865,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.236555814743042 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762600867_2022062 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600867), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377189_4ca2ed24947845423d659d8d21cc16d0_rle_crop_4027197422_0.png', 0, 86, 170, 0, 1762600867,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.659764289855957 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762600868_2022062 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600872), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197415_0.png', 0, 191, 86, 0, 1762600872,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600872), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7_rle_crop_4027197417_0.png', 0, 137, 139, 0, 1762600872,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600872), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7_rle_crop_4027197419_0.png', 0, 157, 98, 0, 1762600872,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600872), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377189_4ca2ed24947845423d659d8d21cc16d0_rle_crop_4027197420_0.png', 0, 375, 322, 0, 1762600872,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600872), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376809_920e386ee7fe729cad17a59b88d4a2d4_rle_crop_4027197428_0.png', 0, 73, 77, 0, 1762600872,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600872), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376809_920e386ee7fe729cad17a59b88d4a2d4_rle_crop_4027197429_0.png', 0, 138, 82, 0, 1762600872,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600872), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376809_920e386ee7fe729cad17a59b88d4a2d4_rle_crop_4027197427_0.png', 0, 83, 90, 0, 1762600872,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600872), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376732_595f2f6cb620fff6b11fcb401511bebb_rle_crop_4027197438_0.png', 0, 58, 145, 0, 1762600872,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600872), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393376731_217d83527cc18accfb035dac5f17a751_rle_crop_4027197441_0.png', 0, 148, 77, 0, 1762600872,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.108439683914185 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762600873_2022062 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762600873), 0.0, 0.0, 14, '', 0, 0, '1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197411_0.png', 0, 156, 111, 0, 1762600873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5042755603790283 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1393377422, 1393377386, 1393377328, 1393377268, 1393377221, 1393377189, 1393376878, 1393376842, 1393376809, 1393376779, 1393376746, 1393376745, 1393376735, 1393376732, 1393376731, 1393376730, 1393376712] Looping around the photos to save general results len do output : 39 /1393402640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393402680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377422', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377386', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377328', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377268', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377221', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377189', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376878', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376842', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376809', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376779', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376746', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376745', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376735', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376732', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376731', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376730', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376712', None, None, None, None, None, '4022489') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 134 time used for this insertion : 0.02031731605529785 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.160061836242676 time spend to save output : 0.022244930267333984 total time spend for step 2 : 15.18230676651001 step3:rle_unique_nms_with_priority Sat Nov 8 12:21:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.31116509437561035 time for calcul the mask position with numpy : 0.1320958137512207 nb_pixel_total : 2062887 time to create 1 rle with new method : 0.09092307090759277 time for calcul the mask position with numpy : 0.006270170211791992 nb_pixel_total : 10713 time to create 1 rle with old method : 0.011990070343017578 create new chi : 0.25057506561279297 time to delete rle : 0.025374174118041992 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1474 TO DO : save crop sub photo not yet done ! save time : 0.12075304985046387 No data in photo_id : 1393377386 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.14451384544372559 time for calcul the mask position with numpy : 0.17537546157836914 nb_pixel_total : 2052221 time to create 1 rle with new method : 0.29166150093078613 time for calcul the mask position with numpy : 0.0063130855560302734 nb_pixel_total : 9002 time to create 1 rle with old method : 0.010230779647827148 time for calcul the mask position with numpy : 0.006391286849975586 nb_pixel_total : 12377 time to create 1 rle with old method : 0.013749361038208008 create new chi : 0.5150525569915771 time to delete rle : 0.0002624988555908203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1562 TO DO : save crop sub photo not yet done ! save time : 0.1353778839111328 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.5053319931030273 time for calcul the mask position with numpy : 0.4020674228668213 nb_pixel_total : 1934934 time to create 1 rle with new method : 0.09451937675476074 time for calcul the mask position with numpy : 0.006474971771240234 nb_pixel_total : 13144 time to create 1 rle with old method : 0.014588356018066406 time for calcul the mask position with numpy : 0.006382942199707031 nb_pixel_total : 1803 time to create 1 rle with old method : 0.002105236053466797 time for calcul the mask position with numpy : 0.006344318389892578 nb_pixel_total : 12186 time to create 1 rle with old method : 0.013684988021850586 time for calcul the mask position with numpy : 0.007216453552246094 nb_pixel_total : 85710 time to create 1 rle with old method : 0.09612178802490234 time for calcul the mask position with numpy : 0.006702899932861328 nb_pixel_total : 11695 time to create 1 rle with old method : 0.013281583786010742 time for calcul the mask position with numpy : 0.006268739700317383 nb_pixel_total : 7075 time to create 1 rle with old method : 0.007878541946411133 time for calcul the mask position with numpy : 0.006156444549560547 nb_pixel_total : 7053 time to create 1 rle with old method : 0.0078029632568359375 create new chi : 0.7103900909423828 time to delete rle : 0.0004811286926269531 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 3008 TO DO : save crop sub photo not yet done ! save time : 0.21683025360107422 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.05934643745422363 time for calcul the mask position with numpy : 0.019138574600219727 nb_pixel_total : 2040275 time to create 1 rle with new method : 0.379744291305542 time for calcul the mask position with numpy : 0.007120370864868164 nb_pixel_total : 11216 time to create 1 rle with old method : 0.012324094772338867 time for calcul the mask position with numpy : 0.007128477096557617 nb_pixel_total : 6100 time to create 1 rle with old method : 0.00675201416015625 time for calcul the mask position with numpy : 0.005759477615356445 nb_pixel_total : 11473 time to create 1 rle with old method : 0.012657642364501953 time for calcul the mask position with numpy : 0.005720615386962891 nb_pixel_total : 4536 time to create 1 rle with old method : 0.004713773727416992 create new chi : 0.46146726608276367 time to delete rle : 0.00032520294189453125 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 2176 TO DO : save crop sub photo not yet done ! save time : 0.17122459411621094 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.06088757514953613 time for calcul the mask position with numpy : 0.16872143745422363 nb_pixel_total : 1947086 time to create 1 rle with new method : 0.2156543731689453 time for calcul the mask position with numpy : 0.006530284881591797 nb_pixel_total : 10285 time to create 1 rle with old method : 0.01150822639465332 time for calcul the mask position with numpy : 0.006719827651977539 nb_pixel_total : 38335 time to create 1 rle with old method : 0.04333305358886719 time for calcul the mask position with numpy : 0.006821870803833008 nb_pixel_total : 77894 time to create 1 rle with old method : 0.08376765251159668 create new chi : 0.5517477989196777 time to delete rle : 0.0003814697265625 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2544 TO DO : save crop sub photo not yet done ! save time : 0.19411587715148926 No data in photo_id : 1393376878 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.07975554466247559 time for calcul the mask position with numpy : 0.052582502365112305 nb_pixel_total : 2049911 time to create 1 rle with new method : 0.2002546787261963 time for calcul the mask position with numpy : 0.010639667510986328 nb_pixel_total : 3728 time to create 1 rle with old method : 0.004268646240234375 time for calcul the mask position with numpy : 0.010780096054077148 nb_pixel_total : 8588 time to create 1 rle with old method : 0.010097980499267578 time for calcul the mask position with numpy : 0.01069021224975586 nb_pixel_total : 3799 time to create 1 rle with old method : 0.0044634342193603516 time for calcul the mask position with numpy : 0.010396718978881836 nb_pixel_total : 7574 time to create 1 rle with old method : 0.008428573608398438 create new chi : 0.33127307891845703 time to delete rle : 0.0003762245178222656 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 2034 TO DO : save crop sub photo not yet done ! save time : 0.16835522651672363 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.0850517749786377 time for calcul the mask position with numpy : 0.02037954330444336 nb_pixel_total : 2055864 time to create 1 rle with new method : 0.10714387893676758 time for calcul the mask position with numpy : 0.006371974945068359 nb_pixel_total : 7237 time to create 1 rle with old method : 0.008882284164428711 time for calcul the mask position with numpy : 0.00635838508605957 nb_pixel_total : 4610 time to create 1 rle with old method : 0.00510859489440918 time for calcul the mask position with numpy : 0.006570100784301758 nb_pixel_total : 5889 time to create 1 rle with old method : 0.0064504146575927734 create new chi : 0.17699623107910156 time to delete rle : 0.0003113746643066406 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 1588 TO DO : save crop sub photo not yet done ! save time : 0.13354015350341797 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03699827194213867 time for calcul the mask position with numpy : 0.020826101303100586 nb_pixel_total : 2062128 time to create 1 rle with new method : 0.27854323387145996 time for calcul the mask position with numpy : 0.008173704147338867 nb_pixel_total : 11472 time to create 1 rle with old method : 0.01743936538696289 create new chi : 0.3384077548980713 time to delete rle : 0.0003025531768798828 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1442 TO DO : save crop sub photo not yet done ! save time : 0.11974477767944336 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.22452330589294434 time for calcul the mask position with numpy : 0.11751055717468262 nb_pixel_total : 2053899 time to create 1 rle with new method : 0.11345028877258301 time for calcul the mask position with numpy : 0.00741887092590332 nb_pixel_total : 8035 time to create 1 rle with old method : 0.009130716323852539 time for calcul the mask position with numpy : 0.007367134094238281 nb_pixel_total : 11666 time to create 1 rle with old method : 0.013188362121582031 create new chi : 0.27935194969177246 time to delete rle : 0.0004324913024902344 batch 1 Loaded 5 chid ids of type : 3594 ++++++Number RLEs to save : 1638 TO DO : save crop sub photo not yet done ! save time : 0.13514041900634766 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.19516587257385254 time for calcul the mask position with numpy : 0.06430959701538086 nb_pixel_total : 2044558 time to create 1 rle with new method : 0.26106739044189453 time for calcul the mask position with numpy : 0.0064122676849365234 nb_pixel_total : 16359 time to create 1 rle with old method : 0.018271446228027344 time for calcul the mask position with numpy : 0.006186246871948242 nb_pixel_total : 2973 time to create 1 rle with old method : 0.0033566951751708984 time for calcul the mask position with numpy : 0.006270885467529297 nb_pixel_total : 9710 time to create 1 rle with old method : 0.011116981506347656 create new chi : 0.38676881790161133 time to delete rle : 0.00039076805114746094 batch 1 Loaded 7 chid ids of type : 3594 ++++++++++Number RLEs to save : 2274 TO DO : save crop sub photo not yet done ! save time : 0.17407441139221191 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04573702812194824 time for calcul the mask position with numpy : 0.07448101043701172 nb_pixel_total : 2057934 time to create 1 rle with new method : 0.1742246150970459 time for calcul the mask position with numpy : 0.011355161666870117 nb_pixel_total : 6028 time to create 1 rle with old method : 0.006931781768798828 time for calcul the mask position with numpy : 0.006438493728637695 nb_pixel_total : 9638 time to create 1 rle with old method : 0.014696598052978516 create new chi : 0.29941487312316895 time to delete rle : 0.0004246234893798828 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 1598 TO DO : save crop sub photo not yet done ! save time : 0.13823175430297852 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.19455265998840332 time for calcul the mask position with numpy : 0.05859017372131348 nb_pixel_total : 2057857 time to create 1 rle with new method : 0.12697982788085938 time for calcul the mask position with numpy : 0.006501197814941406 nb_pixel_total : 9497 time to create 1 rle with old method : 0.010675430297851562 time for calcul the mask position with numpy : 0.00644230842590332 nb_pixel_total : 6246 time to create 1 rle with old method : 0.008246660232543945 create new chi : 0.2285630702972412 time to delete rle : 0.0003600120544433594 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 1540 TO DO : save crop sub photo not yet done ! save time : 0.13887834548950195 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04393768310546875 time for calcul the mask position with numpy : 0.5696239471435547 nb_pixel_total : 2062083 time to create 1 rle with new method : 0.13440179824829102 time for calcul the mask position with numpy : 0.006478786468505859 nb_pixel_total : 8547 time to create 1 rle with old method : 0.009345769882202148 time for calcul the mask position with numpy : 0.006050825119018555 nb_pixel_total : 2970 time to create 1 rle with old method : 0.0032873153686523438 create new chi : 0.7389709949493408 time to delete rle : 0.0002665519714355469 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1442 TO DO : save crop sub photo not yet done ! save time : 0.11800050735473633 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.06075000762939453 time for calcul the mask position with numpy : 0.14933562278747559 nb_pixel_total : 2054989 time to create 1 rle with new method : 0.10755419731140137 time for calcul the mask position with numpy : 0.006783008575439453 nb_pixel_total : 1640 time to create 1 rle with old method : 0.0027751922607421875 time for calcul the mask position with numpy : 0.006493091583251953 nb_pixel_total : 10605 time to create 1 rle with old method : 0.017269372940063477 time for calcul the mask position with numpy : 0.006739616394042969 nb_pixel_total : 6366 time to create 1 rle with old method : 0.010361909866333008 create new chi : 0.3203563690185547 time to delete rle : 0.0003986358642578125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1828 TO DO : save crop sub photo not yet done ! save time : 0.13044357299804688 No data in photo_id : 1393376712 map_output_result : {1393377422: (0.0, 'Should be the crop_list due to order', 0), 1393377386: (0.0, 'Should be the crop_list due to order', 0.0), 1393377328: (0.0, 'Should be the crop_list due to order', 0), 1393377268: (0.0, 'Should be the crop_list due to order', 0), 1393377221: (0.0, 'Should be the crop_list due to order', 0), 1393377189: (0.0, 'Should be the crop_list due to order', 0), 1393376878: (0.0, 'Should be the crop_list due to order', 0.0), 1393376842: (0.0, 'Should be the crop_list due to order', 0), 1393376809: (0.0, 'Should be the crop_list due to order', 0), 1393376779: (0.0, 'Should be the crop_list due to order', 0), 1393376746: (0.0, 'Should be the crop_list due to order', 0), 1393376745: (0.0, 'Should be the crop_list due to order', 0), 1393376735: (0.0, 'Should be the crop_list due to order', 0), 1393376732: (0.0, 'Should be the crop_list due to order', 0), 1393376731: (0.0, 'Should be the crop_list due to order', 0), 1393376730: (0.0, 'Should be the crop_list due to order', 0), 1393376712: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1393377422, 1393377386, 1393377328, 1393377268, 1393377221, 1393377189, 1393376878, 1393376842, 1393376809, 1393376779, 1393376746, 1393376745, 1393376735, 1393376732, 1393376731, 1393376730, 1393376712] Looping around the photos to save general results len do output : 17 /1393377422.Didn't retrieve data . /1393377386.Didn't retrieve data . /1393377328.Didn't retrieve data . /1393377268.Didn't retrieve data . /1393377221.Didn't retrieve data . /1393377189.Didn't retrieve data . /1393376878.Didn't retrieve data . /1393376842.Didn't retrieve data . /1393376809.Didn't retrieve data . /1393376779.Didn't retrieve data . /1393376746.Didn't retrieve data . /1393376745.Didn't retrieve data . /1393376735.Didn't retrieve data . /1393376732.Didn't retrieve data . /1393376731.Didn't retrieve data . /1393376730.Didn't retrieve data . /1393376712.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377422', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377386', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377328', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377268', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377221', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377189', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376878', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376842', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376809', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376779', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376746', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376745', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376735', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376732', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376731', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376730', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376712', None, None, None, None, None, '4022489') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 51 time used for this insertion : 0.013419866561889648 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.253880739212036 time spend to save output : 0.014010190963745117 total time spend for step 3 : 10.267890930175781 step4:ventilate_hashtags_in_portfolio Sat Nov 8 12:21:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28352790 get user id for portfolio 28352790 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28352790 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','autre','pehd','papier','environnement','pet_fonce','mal_croppe','flou','pet_clair','metal','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28352790 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','autre','pehd','papier','environnement','pet_fonce','mal_croppe','flou','pet_clair','metal','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28352790 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','autre','pehd','papier','environnement','pet_fonce','mal_croppe','flou','pet_clair','metal','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28353306,28353307,28353308,28353309,28353310,28353311,28353312,28353313,28353314,28353315,28353316?tags=background,autre,pehd,papier,environnement,pet_fonce,mal_croppe,flou,pet_clair,metal,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1393377422, 1393377386, 1393377328, 1393377268, 1393377221, 1393377189, 1393376878, 1393376842, 1393376809, 1393376779, 1393376746, 1393376745, 1393376735, 1393376732, 1393376731, 1393376730, 1393376712] Looping around the photos to save general results len do output : 1 /28352790. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377422', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377386', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377328', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377268', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377221', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377189', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376878', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376842', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376809', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376779', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376746', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376745', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376735', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376732', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376731', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376730', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376712', None, None, None, None, None, '4022489') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.015674114227294922 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6410036087036133 time spend to save output : 0.015954017639160156 total time spend for step 4 : 1.6569576263427734 step5:final Sat Nov 8 12:21:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1393377422: ('0.014007296205519245',), 1393377386: ('0.014007296205519245',), 1393377328: ('0.014007296205519245',), 1393377268: ('0.014007296205519245',), 1393377221: ('0.014007296205519245',), 1393377189: ('0.014007296205519245',), 1393376878: ('0.014007296205519245',), 1393376842: ('0.014007296205519245',), 1393376809: ('0.014007296205519245',), 1393376779: ('0.014007296205519245',), 1393376746: ('0.014007296205519245',), 1393376745: ('0.014007296205519245',), 1393376735: ('0.014007296205519245',), 1393376732: ('0.014007296205519245',), 1393376731: ('0.014007296205519245',), 1393376730: ('0.014007296205519245',), 1393376712: ('0.014007296205519245',)} new output for save of step final : {1393377422: ('0.014007296205519245',), 1393377386: ('0.014007296205519245',), 1393377328: ('0.014007296205519245',), 1393377268: ('0.014007296205519245',), 1393377221: ('0.014007296205519245',), 1393377189: ('0.014007296205519245',), 1393376878: ('0.014007296205519245',), 1393376842: ('0.014007296205519245',), 1393376809: ('0.014007296205519245',), 1393376779: ('0.014007296205519245',), 1393376746: ('0.014007296205519245',), 1393376745: ('0.014007296205519245',), 1393376735: ('0.014007296205519245',), 1393376732: ('0.014007296205519245',), 1393376731: ('0.014007296205519245',), 1393376730: ('0.014007296205519245',), 1393376712: ('0.014007296205519245',)} [1393377422, 1393377386, 1393377328, 1393377268, 1393377221, 1393377189, 1393376878, 1393376842, 1393376809, 1393376779, 1393376746, 1393376745, 1393376735, 1393376732, 1393376731, 1393376730, 1393376712] Looping around the photos to save general results len do output : 17 /1393377422.Didn't retrieve data . /1393377386.Didn't retrieve data . /1393377328.Didn't retrieve data . /1393377268.Didn't retrieve data . /1393377221.Didn't retrieve data . /1393377189.Didn't retrieve data . /1393376878.Didn't retrieve data . /1393376842.Didn't retrieve data . /1393376809.Didn't retrieve data . /1393376779.Didn't retrieve data . /1393376746.Didn't retrieve data . /1393376745.Didn't retrieve data . /1393376735.Didn't retrieve data . /1393376732.Didn't retrieve data . /1393376731.Didn't retrieve data . /1393376730.Didn't retrieve data . /1393376712.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377422', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377386', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377328', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377268', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377221', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377189', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376878', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376842', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376809', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376779', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376746', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376745', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376735', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376732', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376731', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376730', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376712', None, None, None, None, None, '4022489') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 51 time used for this insertion : 0.014278173446655273 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13192343711853027 time spend to save output : 0.014911413192749023 total time spend for step 5 : 0.1468348503112793 step6:blur_detection Sat Nov 8 12:21:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1762600830_2022062_1393377422_4bec61df0f9f26e73bad4304f9afd8f2.jpg resize: (1080, 1920) 1393377422 0.730853874279001 treat image : temp/1762600830_2022062_1393377386_f39eecfaf243791685759c6da5d817e5.jpg resize: (1080, 1920) 1393377386 -0.12161229571046395 treat image : temp/1762600830_2022062_1393377328_10d942fe99bc0d0abb0800cd4cde54e3.jpg resize: (1080, 1920) 1393377328 0.9331832293329613 treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19.jpg resize: (1080, 1920) 1393377268 0.3720331046041721 treat image : temp/1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7.jpg resize: (1080, 1920) 1393377221 0.8534451824199744 treat image : temp/1762600830_2022062_1393377189_4ca2ed24947845423d659d8d21cc16d0.jpg resize: (1080, 1920) 1393377189 -0.025152909187216573 treat image : temp/1762600830_2022062_1393376878_09b40c336db3974d8fec6a612bd89d6d.jpg resize: (1080, 1920) 1393376878 0.31607259280622546 treat image : temp/1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4.jpg resize: (1080, 1920) 1393376842 1.8775658454344184 treat image : temp/1762600830_2022062_1393376809_920e386ee7fe729cad17a59b88d4a2d4.jpg resize: (1080, 1920) 1393376809 0.36890821704912774 treat image : temp/1762600830_2022062_1393376779_3a20695d43f5b8199fbb2ff08547f6f9.jpg resize: (1080, 1920) 1393376779 1.3154668521078514 treat image : temp/1762600830_2022062_1393376746_1d44501d2d034bf83180f1038f05adcc.jpg resize: (1080, 1920) 1393376746 1.4478603543717343 treat image : temp/1762600830_2022062_1393376745_56e5c185ab836afb5c1afa79f1f3a874.jpg resize: (1080, 1920) 1393376745 -0.000749814079139326 treat image : temp/1762600830_2022062_1393376735_c787c19f008e5277cfb9fb14fe2e7e8f.jpg resize: (1080, 1920) 1393376735 0.42389415728334323 treat image : temp/1762600830_2022062_1393376732_595f2f6cb620fff6b11fcb401511bebb.jpg resize: (1080, 1920) 1393376732 -0.48452176143685616 treat image : temp/1762600830_2022062_1393376731_217d83527cc18accfb035dac5f17a751.jpg resize: (1080, 1920) 1393376731 -0.3154416456190851 treat image : temp/1762600830_2022062_1393376730_702cba6461d0cdfb80dd7426a99d830b.jpg resize: (1080, 1920) 1393376730 0.7070255185416885 treat image : temp/1762600830_2022062_1393376712_892bee2e0389f79478ddb5aea9152636.jpg resize: (1080, 1920) 1393376712 0.20787826477467777 treat image : temp/1762600830_2022062_1393377422_4bec61df0f9f26e73bad4304f9afd8f2_rle_crop_4027197406_0.png resize: (184, 126) 1393402640 -1.3161151448516613 treat image : temp/1762600830_2022062_1393377328_10d942fe99bc0d0abb0800cd4cde54e3_rle_crop_4027197408_0.png resize: (119, 147) 1393402641 -1.5436911277425318 treat image : temp/1762600830_2022062_1393377328_10d942fe99bc0d0abb0800cd4cde54e3_rle_crop_4027197407_0.png resize: (113, 159) 1393402642 -0.2387698966735464 treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197412_0.png resize: (256, 592) 1393402643 -0.9711093175331358 treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197410_0.png resize: (74, 123) 1393402644 -1.5927766203345757 treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197414_0.png resize: (45, 65) 1393402645 1.4343124951615693 treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197413_0.png resize: (156, 194) 1393402646 -1.0054218788172187 treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197409_0.png resize: (100, 86) 1393402647 -0.31440712619087163 treat image : temp/1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7_rle_crop_4027197416_0.png resize: (107, 57) 1393402648 -0.03793052801758142 treat image : temp/1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7_rle_crop_4027197418_0.png resize: (120, 64) 1393402649 -1.3557125880290004 treat image : temp/1762600830_2022062_1393377189_4ca2ed24947845423d659d8d21cc16d0_rle_crop_4027197421_0.png resize: (211, 287) 1393402650 -1.5404041342181747 treat image : temp/1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4_rle_crop_4027197424_0.png resize: (91, 67) 1393402651 3.0324718915240045 treat image : temp/1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4_rle_crop_4027197423_0.png resize: (92, 109) 1393402652 -0.10684861034243963 treat image : temp/1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4_rle_crop_4027197425_0.png resize: (159, 136) 1393402653 -2.4858872172001782 treat image : temp/1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4_rle_crop_4027197426_0.png resize: (107, 60) 1393402654 -0.29433145922010406 treat image : temp/1762600830_2022062_1393376779_3a20695d43f5b8199fbb2ff08547f6f9_rle_crop_4027197430_0.png resize: (181, 114) 1393402655 -1.401238137684709 treat image : temp/1762600830_2022062_1393376746_1d44501d2d034bf83180f1038f05adcc_rle_crop_4027197431_0.png resize: (138, 115) 1393402656 0.6929694071439566 treat image : temp/1762600830_2022062_1393376746_1d44501d2d034bf83180f1038f05adcc_rle_crop_4027197432_0.png resize: (82, 143) 1393402657 -0.8431262745638171 treat image : temp/1762600830_2022062_1393376745_56e5c185ab836afb5c1afa79f1f3a874_rle_crop_4027197435_0.png resize: (150, 276) 1393402658 -1.297262323098216 treat image : temp/1762600830_2022062_1393376745_56e5c185ab836afb5c1afa79f1f3a874_rle_crop_4027197434_0.png resize: (59, 73) 1393402659 0.8510832545307144 treat image : temp/1762600830_2022062_1393376745_56e5c185ab836afb5c1afa79f1f3a874_rle_crop_4027197433_0.png resize: (186, 110) 1393402660 -2.976036861818034 treat image : temp/1762600830_2022062_1393376735_c787c19f008e5277cfb9fb14fe2e7e8f_rle_crop_4027197437_0.png resize: (89, 104) 1393402661 -0.5016404733207653 treat image : temp/1762600830_2022062_1393376735_c787c19f008e5277cfb9fb14fe2e7e8f_rle_crop_4027197436_0.png resize: (122, 105) 1393402662 3.3742876577547167 treat image : temp/1762600830_2022062_1393376732_595f2f6cb620fff6b11fcb401511bebb_rle_crop_4027197439_0.png resize: (75, 199) 1393402663 -0.8857228263219927 treat image : temp/1762600830_2022062_1393376731_217d83527cc18accfb035dac5f17a751_rle_crop_4027197440_0.png resize: (98, 87) 1393402664 -2.75196080334268 treat image : temp/1762600830_2022062_1393376730_702cba6461d0cdfb80dd7426a99d830b_rle_crop_4027197443_0.png resize: (190, 98) 1393402665 -1.6753392631157915 treat image : temp/1762600830_2022062_1393376730_702cba6461d0cdfb80dd7426a99d830b_rle_crop_4027197442_0.png resize: (102, 85) 1393402666 -0.17544137708754298 treat image : temp/1762600830_2022062_1393376730_702cba6461d0cdfb80dd7426a99d830b_rle_crop_4027197444_0.png resize: (64, 49) 1393402667 -2.5747670480513247 treat image : temp/1762600830_2022062_1393377189_4ca2ed24947845423d659d8d21cc16d0_rle_crop_4027197422_0.png resize: (170, 86) 1393402668 -1.1546373854192515 treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197415_0.png resize: (86, 191) 1393402670 0.8921650972507893 treat image : temp/1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7_rle_crop_4027197417_0.png resize: (139, 137) 1393402671 -0.6046702405491929 treat image : temp/1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7_rle_crop_4027197419_0.png resize: (98, 157) 1393402672 -1.0410666888597961 treat image : temp/1762600830_2022062_1393377189_4ca2ed24947845423d659d8d21cc16d0_rle_crop_4027197420_0.png resize: (322, 375) 1393402673 -0.8989632269519034 treat image : temp/1762600830_2022062_1393376809_920e386ee7fe729cad17a59b88d4a2d4_rle_crop_4027197428_0.png resize: (77, 73) 1393402674 1.0002377461679715 treat image : temp/1762600830_2022062_1393376809_920e386ee7fe729cad17a59b88d4a2d4_rle_crop_4027197429_0.png resize: (82, 138) 1393402675 -0.3430464580509291 treat image : temp/1762600830_2022062_1393376809_920e386ee7fe729cad17a59b88d4a2d4_rle_crop_4027197427_0.png resize: (90, 83) 1393402676 -0.00750901421679534 treat image : temp/1762600830_2022062_1393376732_595f2f6cb620fff6b11fcb401511bebb_rle_crop_4027197438_0.png resize: (145, 58) 1393402677 -0.6867683527744406 treat image : temp/1762600830_2022062_1393376731_217d83527cc18accfb035dac5f17a751_rle_crop_4027197441_0.png resize: (77, 148) 1393402678 -2.3207899780878076 treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197411_0.png resize: (111, 156) 1393402680 -1.2796429030198935 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 56 time used for this insertion : 0.01414632797241211 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 56 time used for this insertion : 0.013020992279052734 save missing photos in datou_result : time spend for datou_step_exec : 13.623284339904785 time spend to save output : 0.03281831741333008 total time spend for step 6 : 13.656102657318115 step7:brightness Sat Nov 8 12:21:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1762600830_2022062_1393377422_4bec61df0f9f26e73bad4304f9afd8f2.jpg treat image : temp/1762600830_2022062_1393377386_f39eecfaf243791685759c6da5d817e5.jpg treat image : temp/1762600830_2022062_1393377328_10d942fe99bc0d0abb0800cd4cde54e3.jpg treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19.jpg treat image : temp/1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7.jpg treat image : temp/1762600830_2022062_1393377189_4ca2ed24947845423d659d8d21cc16d0.jpg treat image : temp/1762600830_2022062_1393376878_09b40c336db3974d8fec6a612bd89d6d.jpg treat image : temp/1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4.jpg treat image : temp/1762600830_2022062_1393376809_920e386ee7fe729cad17a59b88d4a2d4.jpg treat image : temp/1762600830_2022062_1393376779_3a20695d43f5b8199fbb2ff08547f6f9.jpg treat image : temp/1762600830_2022062_1393376746_1d44501d2d034bf83180f1038f05adcc.jpg treat image : temp/1762600830_2022062_1393376745_56e5c185ab836afb5c1afa79f1f3a874.jpg treat image : temp/1762600830_2022062_1393376735_c787c19f008e5277cfb9fb14fe2e7e8f.jpg treat image : temp/1762600830_2022062_1393376732_595f2f6cb620fff6b11fcb401511bebb.jpg treat image : temp/1762600830_2022062_1393376731_217d83527cc18accfb035dac5f17a751.jpg treat image : temp/1762600830_2022062_1393376730_702cba6461d0cdfb80dd7426a99d830b.jpg treat image : temp/1762600830_2022062_1393376712_892bee2e0389f79478ddb5aea9152636.jpg treat image : temp/1762600830_2022062_1393377422_4bec61df0f9f26e73bad4304f9afd8f2_rle_crop_4027197406_0.png treat image : temp/1762600830_2022062_1393377328_10d942fe99bc0d0abb0800cd4cde54e3_rle_crop_4027197408_0.png treat image : temp/1762600830_2022062_1393377328_10d942fe99bc0d0abb0800cd4cde54e3_rle_crop_4027197407_0.png treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197412_0.png treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197410_0.png treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197414_0.png treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197413_0.png treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197409_0.png treat image : temp/1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7_rle_crop_4027197416_0.png treat image : temp/1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7_rle_crop_4027197418_0.png treat image : temp/1762600830_2022062_1393377189_4ca2ed24947845423d659d8d21cc16d0_rle_crop_4027197421_0.png treat image : temp/1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4_rle_crop_4027197424_0.png treat image : temp/1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4_rle_crop_4027197423_0.png treat image : temp/1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4_rle_crop_4027197425_0.png treat image : temp/1762600830_2022062_1393376842_ca3de5674839088aa0b337dfdff627b4_rle_crop_4027197426_0.png treat image : temp/1762600830_2022062_1393376779_3a20695d43f5b8199fbb2ff08547f6f9_rle_crop_4027197430_0.png treat image : temp/1762600830_2022062_1393376746_1d44501d2d034bf83180f1038f05adcc_rle_crop_4027197431_0.png treat image : temp/1762600830_2022062_1393376746_1d44501d2d034bf83180f1038f05adcc_rle_crop_4027197432_0.png treat image : temp/1762600830_2022062_1393376745_56e5c185ab836afb5c1afa79f1f3a874_rle_crop_4027197435_0.png treat image : temp/1762600830_2022062_1393376745_56e5c185ab836afb5c1afa79f1f3a874_rle_crop_4027197434_0.png treat image : temp/1762600830_2022062_1393376745_56e5c185ab836afb5c1afa79f1f3a874_rle_crop_4027197433_0.png treat image : temp/1762600830_2022062_1393376735_c787c19f008e5277cfb9fb14fe2e7e8f_rle_crop_4027197437_0.png treat image : temp/1762600830_2022062_1393376735_c787c19f008e5277cfb9fb14fe2e7e8f_rle_crop_4027197436_0.png treat image : temp/1762600830_2022062_1393376732_595f2f6cb620fff6b11fcb401511bebb_rle_crop_4027197439_0.png treat image : temp/1762600830_2022062_1393376731_217d83527cc18accfb035dac5f17a751_rle_crop_4027197440_0.png treat image : temp/1762600830_2022062_1393376730_702cba6461d0cdfb80dd7426a99d830b_rle_crop_4027197443_0.png treat image : temp/1762600830_2022062_1393376730_702cba6461d0cdfb80dd7426a99d830b_rle_crop_4027197442_0.png treat image : temp/1762600830_2022062_1393376730_702cba6461d0cdfb80dd7426a99d830b_rle_crop_4027197444_0.png treat image : temp/1762600830_2022062_1393377189_4ca2ed24947845423d659d8d21cc16d0_rle_crop_4027197422_0.png treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197415_0.png treat image : temp/1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7_rle_crop_4027197417_0.png treat image : temp/1762600830_2022062_1393377221_dffdc402d92d79f37743882dc82b8fa7_rle_crop_4027197419_0.png treat image : temp/1762600830_2022062_1393377189_4ca2ed24947845423d659d8d21cc16d0_rle_crop_4027197420_0.png treat image : temp/1762600830_2022062_1393376809_920e386ee7fe729cad17a59b88d4a2d4_rle_crop_4027197428_0.png treat image : temp/1762600830_2022062_1393376809_920e386ee7fe729cad17a59b88d4a2d4_rle_crop_4027197429_0.png treat image : temp/1762600830_2022062_1393376809_920e386ee7fe729cad17a59b88d4a2d4_rle_crop_4027197427_0.png treat image : temp/1762600830_2022062_1393376732_595f2f6cb620fff6b11fcb401511bebb_rle_crop_4027197438_0.png treat image : temp/1762600830_2022062_1393376731_217d83527cc18accfb035dac5f17a751_rle_crop_4027197441_0.png treat image : temp/1762600830_2022062_1393377268_bf8c0cb0dfcdb6d6275e2e6e15145b19_rle_crop_4027197411_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 56 time used for this insertion : 0.014139890670776367 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 56 time used for this insertion : 0.015205621719360352 save missing photos in datou_result : time spend for datou_step_exec : 3.827786445617676 time spend to save output : 0.03421521186828613 total time spend for step 7 : 3.862001657485962 step8:velours_tree Sat Nov 8 12:21:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.2581191062927246 time spend to save output : 3.7670135498046875e-05 total time spend for step 8 : 0.25815677642822266 step9:send_mail_cod Sat Nov 8 12:21:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28352790_08-11-2025_12_21_43.pdf 28353306 imagette283533061762600903 28353307 imagette283533071762600903 28353308 imagette283533081762600903 28353309 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette283533091762600903 28353311 change filename to text .imagette283533111762600904 28353312 imagette283533121762600904 28353313 imagette283533131762600904 28353314 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette283533141762600904 28353315 imagette283533151762600905 28353316 change filename to text .imagette283533161762600905 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28352790 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28353306,28353307,28353308,28353309,28353310,28353311,28353312,28353313,28353314,28353315,28353316?tags=background,autre,pehd,papier,environnement,pet_fonce,mal_croppe,flou,pet_clair,metal,carton args[1393377422] : ((1393377422, 0.730853874279001, 492688767), (1393377422, 0.8408813176204489, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393377386] : ((1393377386, -0.12161229571046395, 492688767), (1393377386, 0.5390737560099611, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393377328] : ((1393377328, 0.9331832293329613, 492688767), (1393377328, 0.8716056295873559, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393377268] : ((1393377268, 0.3720331046041721, 492688767), (1393377268, 0.22145975185762865, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393377221] : ((1393377221, 0.8534451824199744, 492688767), (1393377221, 0.8314045033398858, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393377189] : ((1393377189, -0.025152909187216573, 492688767), (1393377189, 0.7833707777582297, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393376878] : ((1393376878, 0.31607259280622546, 492688767), (1393376878, 0.7056428701614492, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393376842] : ((1393376842, 1.8775658454344184, 492688767), (1393376842, 0.6183992203548055, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393376809] : ((1393376809, 0.36890821704912774, 492688767), (1393376809, 0.6966789739579985, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393376779] : ((1393376779, 1.3154668521078514, 492688767), (1393376779, 0.6900944170985601, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393376746] : ((1393376746, 1.4478603543717343, 492688767), (1393376746, 0.7101512830300737, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393376745] : ((1393376745, -0.000749814079139326, 492688767), (1393376745, 0.7878181576658687, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393376735] : ((1393376735, 0.42389415728334323, 492688767), (1393376735, 0.9618403265627105, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393376732] : ((1393376732, -0.48452176143685616, 492688767), (1393376732, 0.9273397852949183, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393376731] : ((1393376731, -0.3154416456190851, 492688767), (1393376731, 0.7558709771676764, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393376730] : ((1393376730, 0.7070255185416885, 492688767), (1393376730, 0.7431571538691957, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com args[1393376712] : ((1393376712, 0.20787826477467777, 492688767), (1393376712, 0.5706578878194164, 2107752395), '0.014007296205519245') We are sending mail with results at report@fotonower.com refus_total : 0.014007296205519245 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28352790 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28352790_08-11-2025_12_21_43.pdf results_Auto_P28352790_08-11-2025_12_21_43.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28352790_08-11-2025_12_21_43.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28352790','results_Auto_P28352790_08-11-2025_12_21_43.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28352790_08-11-2025_12_21_43.pdf','pdf','','0.19','0.014007296205519245') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28352790

https://www.fotonower.com/image?json=false&list_photos_id=1393377422
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393377386
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393377328
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393377268
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393377221
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393377189
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393376878
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393376842
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.8775658454344184)
https://www.fotonower.com/image?json=false&list_photos_id=1393376809
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393376779
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3154668521078514)
https://www.fotonower.com/image?json=false&list_photos_id=1393376746
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.4478603543717343)
https://www.fotonower.com/image?json=false&list_photos_id=1393376745
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393376735
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393376732
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393376731
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393376730
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393376712
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 1.40%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/28353309?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/28353311?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28353314?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28353316?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28352790_08-11-2025_12_21_43.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28353306,28353307,28353308,28353309,28353310,28353311,28353312,28353313,28353314,28353315,28353316?tags=background,autre,pehd,papier,environnement,pet_fonce,mal_croppe,flou,pet_clair,metal,carton.


L'équipe Fotonower 202 b'' Date: Sat, 08 Nov 2025 11:21:47 GMT Content-Length: 0 Connection: close Server: nginx X-Message-Id: xHQysJo5ReyozdlQMbCitQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1393377422, 1393377386, 1393377328, 1393377268, 1393377221, 1393377189, 1393376878, 1393376842, 1393376809, 1393376779, 1393376746, 1393376745, 1393376735, 1393376732, 1393376731, 1393376730, 1393376712] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377422', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377386', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377328', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377268', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377221', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377189', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376878', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376842', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376809', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376779', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376746', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376745', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376735', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376732', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376731', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376730', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376712', None, None, None, None, None, '4022489') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 17 time used for this insertion : 0.014477729797363281 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.208470821380615 time spend to save output : 0.014748096466064453 total time spend for step 9 : 4.22321891784668 step10:split_time_score Sat Nov 8 12:21:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 17),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08112025 28352790 Nombre de photos uploadées : 17 / 23040 (0%) 08112025 28352790 Nombre de photos taguées (types de déchets): 0 / 17 (0%) 08112025 28352790 Nombre de photos taguées (volume) : 0 / 17 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007729530334472656 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.19553208351135254 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09208728780864198 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28348936_08-11-2025_11_01_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28348936 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28348936 AND mptpi.`type`=3594 To do Qualite : 0.014007296205519245 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28352790_08-11-2025_12_21_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28352790 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28352790 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28352791 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28352794 order by id desc limit 1 Qualite : 0.05583881896219136 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28352797_08-11-2025_11_51_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28352797 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28352797 AND mptpi.`type`=3594 To do Qualite : 0.06286572868441358 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28352799_08-11-2025_11_41_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28352799 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28352799 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08112025': {'nb_upload': 17, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1393377422, 1393377386, 1393377328, 1393377268, 1393377221, 1393377189, 1393376878, 1393376842, 1393376809, 1393376779, 1393376746, 1393376745, 1393376735, 1393376732, 1393376731, 1393376730, 1393376712] Looping around the photos to save general results len do output : 1 /28352790Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377422', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377386', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377328', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377268', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377221', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393377189', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376878', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376842', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376809', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376779', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376746', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376745', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376735', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376732', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376731', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376730', None, None, None, None, None, '4022489') ('3318', None, None, None, None, None, None, None, '4022489') ('3318', '28352790', '1393376712', None, None, None, None, None, '4022489') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.015299081802368164 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.9826407432556152 time spend to save output : 0.015492439270019531 total time spend for step 10 : 2.9981331825256348 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 17 set_done_treatment 40.13user 23.06system 1:24.65elapsed 74%CPU (0avgtext+0avgdata 2839232maxresident)k 649168inputs+12984outputs (465major+1762514minor)pagefaults 0swaps