python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1521267 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3657463'] with mtr_portfolio_ids : ['26478214'] and first list_photo_ids : [] new path : /proc/1521267/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 15 ; length of list_pids : 15 ; length of list_args : 15 time to download the photos : 2.0558528900146484 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Sep 3 09:40:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10600 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-03 09:40:31.956054: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-03 09:40:31.984585: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-03 09:40:31.986983: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ffa34000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-03 09:40:31.987057: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-03 09:40:31.992557: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-03 09:40:32.178973: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x10bc1370 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-03 09:40:32.179010: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-03 09:40:32.180170: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-03 09:40:32.180612: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-03 09:40:32.199476: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-03 09:40:32.209743: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-03 09:40:32.212372: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-03 09:40:32.239034: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-03 09:40:32.243501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-03 09:40:32.295912: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-03 09:40:32.297757: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-03 09:40:32.297835: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-03 09:40:32.298744: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-03 09:40:32.298763: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-03 09:40:32.298773: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-03 09:40:32.300764: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9818 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-03 09:40:32.602325: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-03 09:40:32.602445: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-03 09:40:32.602469: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-03 09:40:32.602489: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-03 09:40:32.602508: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-03 09:40:32.602528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-03 09:40:32.602547: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-03 09:40:32.602566: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-03 09:40:32.604273: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-03 09:40:32.605970: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-03 09:40:32.606012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-03 09:40:32.606031: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-03 09:40:32.606048: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-03 09:40:32.606065: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-03 09:40:32.606081: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-03 09:40:32.606098: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-03 09:40:32.606115: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-03 09:40:32.607321: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-03 09:40:32.607364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-03 09:40:32.607373: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-03 09:40:32.607382: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-03 09:40:32.608716: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9818 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-03 09:40:36.702674: W tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 51380224 exceeds 10% of free system memory. 2025-09-03 09:40:40.372647: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-03 09:40:40.584220: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 1521929 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4509 tf kernel not reseted sub process len(results) : 15 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 15 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9645 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00021076202392578125 nb_pixel_total : 7787 time to create 1 rle with old method : 0.009320735931396484 length of segment : 98 time for calcul the mask position with numpy : 0.0006589889526367188 nb_pixel_total : 37488 time to create 1 rle with old method : 0.04604816436767578 length of segment : 197 time for calcul the mask position with numpy : 0.0003571510314941406 nb_pixel_total : 11191 time to create 1 rle with old method : 0.01783156394958496 length of segment : 188 time for calcul the mask position with numpy : 0.00016355514526367188 nb_pixel_total : 6824 time to create 1 rle with old method : 0.008320093154907227 length of segment : 134 time for calcul the mask position with numpy : 0.00016808509826660156 nb_pixel_total : 7555 time to create 1 rle with old method : 0.009693384170532227 length of segment : 111 time for calcul the mask position with numpy : 0.00015592575073242188 nb_pixel_total : 5637 time to create 1 rle with old method : 0.007140159606933594 length of segment : 84 time for calcul the mask position with numpy : 0.049738407135009766 nb_pixel_total : 1253011 time to create 1 rle with new method : 0.3163480758666992 length of segment : 1196 time for calcul the mask position with numpy : 0.00022721290588378906 nb_pixel_total : 12296 time to create 1 rle with old method : 0.015216588973999023 length of segment : 114 time for calcul the mask position with numpy : 0.00010347366333007812 nb_pixel_total : 4714 time to create 1 rle with old method : 0.0057277679443359375 length of segment : 90 time for calcul the mask position with numpy : 0.0016214847564697266 nb_pixel_total : 93317 time to create 1 rle with old method : 0.10909390449523926 length of segment : 508 time for calcul the mask position with numpy : 0.00017690658569335938 nb_pixel_total : 8985 time to create 1 rle with old method : 0.010877847671508789 length of segment : 111 time for calcul the mask position with numpy : 0.00012063980102539062 nb_pixel_total : 4072 time to create 1 rle with old method : 0.004993438720703125 length of segment : 85 time for calcul the mask position with numpy : 0.0001461505889892578 nb_pixel_total : 7112 time to create 1 rle with old method : 0.008754491806030273 length of segment : 112 time for calcul the mask position with numpy : 0.0018219947814941406 nb_pixel_total : 117752 time to create 1 rle with old method : 0.16081595420837402 length of segment : 531 time for calcul the mask position with numpy : 0.00011587142944335938 nb_pixel_total : 4193 time to create 1 rle with old method : 0.00503993034362793 length of segment : 84 time for calcul the mask position with numpy : 0.013652324676513672 nb_pixel_total : 1141992 time to create 1 rle with new method : 0.0494236946105957 length of segment : 1407 time for calcul the mask position with numpy : 0.0002338886260986328 nb_pixel_total : 12182 time to create 1 rle with old method : 0.014487743377685547 length of segment : 135 time for calcul the mask position with numpy : 0.025318384170532227 nb_pixel_total : 1106810 time to create 1 rle with new method : 0.2394099235534668 length of segment : 1297 time for calcul the mask position with numpy : 0.0001742839813232422 nb_pixel_total : 6130 time to create 1 rle with old method : 0.007419586181640625 length of segment : 113 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 3812 time to create 1 rle with old method : 0.004766941070556641 length of segment : 98 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 2633 time to create 1 rle with old method : 0.0033164024353027344 length of segment : 65 time spent for convertir_results : 2.476409435272217 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 21 chid ids of type : 3594 Number RLEs to save : 6758 save missing photos in datou_result : time spend for datou_step_exec : 26.9042649269104 time spend to save output : 0.44089412689208984 total time spend for step 1 : 27.34515905380249 step2:crop_condition Wed Sep 3 09:40:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 15 ! batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756885257_1521267 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.038975715637207 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756885259_1521267 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2280712127685547 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756885276_1521267 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.216658353805542 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1381040483, 1381040435, 1381040388, 1381040336, 1381040293, 1381040098, 1381040073, 1381040050, 1381040011, 1381039964, 1381039922, 1381039574, 1381039525, 1381039471, 1381039425] Looping around the photos to save general results len do output : 21 /1381046852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381046885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040483', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040435', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040388', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040336', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040293', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040098', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040073', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040050', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040011', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039964', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039922', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039574', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039525', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039471', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039425', None, None, None, None, None, '3657463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 78 time used for this insertion : 0.022536754608154297 save_final save missing photos in datou_result : time spend for datou_step_exec : 23.320554733276367 time spend to save output : 0.0236053466796875 total time spend for step 2 : 23.344160079956055 step3:rle_unique_nms_with_priority Wed Sep 3 09:41:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++++++++++++ No data in photo_id : 1381040483 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.27078986167907715 time for calcul the mask position with numpy : 0.06978607177734375 nb_pixel_total : 2028325 time to create 1 rle with new method : 0.1193845272064209 time for calcul the mask position with numpy : 0.007388114929199219 nb_pixel_total : 37488 time to create 1 rle with old method : 0.04573202133178711 time for calcul the mask position with numpy : 0.006429910659790039 nb_pixel_total : 7787 time to create 1 rle with old method : 0.008990049362182617 create new chi : 0.2697019577026367 time to delete rle : 0.030368804931640625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1670 TO DO : save crop sub photo not yet done ! save time : 0.14371442794799805 No data in photo_id : 1381040388 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.14580965042114258 time for calcul the mask position with numpy : 0.1918497085571289 nb_pixel_total : 2055585 time to create 1 rle with new method : 0.14135003089904785 time for calcul the mask position with numpy : 0.006379842758178711 nb_pixel_total : 6824 time to create 1 rle with old method : 0.007631540298461914 time for calcul the mask position with numpy : 0.006016969680786133 nb_pixel_total : 11191 time to create 1 rle with old method : 0.012354612350463867 create new chi : 0.37621474266052246 time to delete rle : 0.00031447410583496094 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1724 TO DO : save crop sub photo not yet done ! save time : 0.1492617130279541 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03767871856689453 time for calcul the mask position with numpy : 0.027304887771606445 nb_pixel_total : 2066045 time to create 1 rle with new method : 0.1837916374206543 time for calcul the mask position with numpy : 0.006289482116699219 nb_pixel_total : 7555 time to create 1 rle with old method : 0.008817434310913086 create new chi : 0.2360081672668457 time to delete rle : 0.0002791881561279297 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1302 TO DO : save crop sub photo not yet done ! save time : 0.12326693534851074 No data in photo_id : 1381040098 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.11227655410766602 time for calcul the mask position with numpy : 0.020639419555664062 nb_pixel_total : 820589 time to create 1 rle with new method : 0.10044193267822266 time for calcul the mask position with numpy : 0.12854313850402832 nb_pixel_total : 1247374 time to create 1 rle with new method : 0.09170985221862793 time for calcul the mask position with numpy : 0.008101940155029297 nb_pixel_total : 5637 time to create 1 rle with old method : 0.006489753723144531 create new chi : 0.3711693286895752 time to delete rle : 0.0007512569427490234 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3640 TO DO : save crop sub photo not yet done ! save time : 0.2655766010284424 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05154132843017578 time for calcul the mask position with numpy : 0.09986734390258789 nb_pixel_total : 2061304 time to create 1 rle with new method : 0.08537960052490234 time for calcul the mask position with numpy : 0.0077588558197021484 nb_pixel_total : 12296 time to create 1 rle with old method : 0.014268875122070312 create new chi : 0.21895980834960938 time to delete rle : 0.00034928321838378906 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1308 TO DO : save crop sub photo not yet done ! save time : 0.11899924278259277 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.24022603034973145 time for calcul the mask position with numpy : 0.07500362396240234 nb_pixel_total : 1962512 time to create 1 rle with new method : 0.19457054138183594 time for calcul the mask position with numpy : 0.007623434066772461 nb_pixel_total : 4072 time to create 1 rle with old method : 0.004641294479370117 time for calcul the mask position with numpy : 0.007318258285522461 nb_pixel_total : 8985 time to create 1 rle with old method : 0.010553836822509766 time for calcul the mask position with numpy : 0.008231163024902344 nb_pixel_total : 93317 time to create 1 rle with old method : 0.10840773582458496 time for calcul the mask position with numpy : 0.0076634883880615234 nb_pixel_total : 4714 time to create 1 rle with old method : 0.0055544376373291016 create new chi : 0.44137144088745117 time to delete rle : 0.0006794929504394531 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2668 TO DO : save crop sub photo not yet done ! save time : 0.19853997230529785 No data in photo_id : 1381039964 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04974222183227539 time for calcul the mask position with numpy : 0.034542083740234375 nb_pixel_total : 2066488 time to create 1 rle with new method : 0.15084505081176758 time for calcul the mask position with numpy : 0.008152246475219727 nb_pixel_total : 7112 time to create 1 rle with old method : 0.00827336311340332 create new chi : 0.20209336280822754 time to delete rle : 0.00035953521728515625 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1304 TO DO : save crop sub photo not yet done ! save time : 0.12149381637573242 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.07181143760681152 time for calcul the mask position with numpy : 0.013428926467895508 nb_pixel_total : 810154 time to create 1 rle with new method : 0.09963417053222656 time for calcul the mask position with numpy : 0.006227016448974609 nb_pixel_total : 3702 time to create 1 rle with old method : 0.00418543815612793 time for calcul the mask position with numpy : 0.10382437705993652 nb_pixel_total : 1137799 time to create 1 rle with new method : 0.11254262924194336 time for calcul the mask position with numpy : 0.0066373348236083984 nb_pixel_total : 4193 time to create 1 rle with old method : 0.005108833312988281 time for calcul the mask position with numpy : 0.006851673126220703 nb_pixel_total : 117752 time to create 1 rle with old method : 0.13419365882873535 create new chi : 0.5070974826812744 time to delete rle : 0.0006349086761474609 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 5223 TO DO : save crop sub photo not yet done ! save time : 0.32866358757019043 No data in photo_id : 1381039525 No data in photo_id : 1381039471 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.08847427368164062 time for calcul the mask position with numpy : 0.02246379852294922 nb_pixel_total : 960660 time to create 1 rle with new method : 0.15446949005126953 time for calcul the mask position with numpy : 0.006866455078125 nb_pixel_total : 6130 time to create 1 rle with old method : 0.007163047790527344 time for calcul the mask position with numpy : 0.015938282012939453 nb_pixel_total : 1106810 time to create 1 rle with new method : 0.155242919921875 create new chi : 0.38031983375549316 time to delete rle : 0.0008151531219482422 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 3900 TO DO : save crop sub photo not yet done ! save time : 0.2492513656616211 map_output_result : {1381040483: (0.0, 'Should be the crop_list due to order', 0.0), 1381040435: (0.0, 'Should be the crop_list due to order', 0), 1381040388: (0.0, 'Should be the crop_list due to order', 0.0), 1381040336: (0.0, 'Should be the crop_list due to order', 0), 1381040293: (0.0, 'Should be the crop_list due to order', 0), 1381040098: (0.0, 'Should be the crop_list due to order', 0.0), 1381040073: (0.0, 'Should be the crop_list due to order', 0), 1381040050: (0.0, 'Should be the crop_list due to order', 0), 1381040011: (0.0, 'Should be the crop_list due to order', 0), 1381039964: (0.0, 'Should be the crop_list due to order', 0.0), 1381039922: (0.0, 'Should be the crop_list due to order', 0), 1381039574: (0.0, 'Should be the crop_list due to order', 0), 1381039525: (0.0, 'Should be the crop_list due to order', 0.0), 1381039471: (0.0, 'Should be the crop_list due to order', 0.0), 1381039425: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1381040483, 1381040435, 1381040388, 1381040336, 1381040293, 1381040098, 1381040073, 1381040050, 1381040011, 1381039964, 1381039922, 1381039574, 1381039525, 1381039471, 1381039425] Looping around the photos to save general results len do output : 15 /1381040483.Didn't retrieve data . /1381040435.Didn't retrieve data . /1381040388.Didn't retrieve data . /1381040336.Didn't retrieve data . /1381040293.Didn't retrieve data . /1381040098.Didn't retrieve data . /1381040073.Didn't retrieve data . /1381040050.Didn't retrieve data . /1381040011.Didn't retrieve data . /1381039964.Didn't retrieve data . /1381039922.Didn't retrieve data . /1381039574.Didn't retrieve data . /1381039525.Didn't retrieve data . /1381039471.Didn't retrieve data . /1381039425.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040483', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040435', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040388', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040336', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040293', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040098', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040073', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040050', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040011', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039964', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039922', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039574', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039525', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039471', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039425', None, None, None, None, None, '3657463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.017057180404663086 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.160734176635742 time spend to save output : 0.01764655113220215 total time spend for step 3 : 6.178380727767944 step4:ventilate_hashtags_in_portfolio Wed Sep 3 09:41:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26478214 get user id for portfolio 26478214 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26478214 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','flou','metal','carton','pet_fonce','papier','pehd','autre','environnement','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26478214 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','flou','metal','carton','pet_fonce','papier','pehd','autre','environnement','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26478214 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','flou','metal','carton','pet_fonce','papier','pehd','autre','environnement','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26478293,26478294,26478296,26478297,26478298,26478299,26478300,26478301,26478302,26478303,26478304?tags=background,flou,metal,carton,pet_fonce,papier,pehd,autre,environnement,pet_clair,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1381040483, 1381040435, 1381040388, 1381040336, 1381040293, 1381040098, 1381040073, 1381040050, 1381040011, 1381039964, 1381039922, 1381039574, 1381039525, 1381039471, 1381039425] Looping around the photos to save general results len do output : 1 /26478214. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040483', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040435', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040388', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040336', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040293', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040098', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040073', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040050', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040011', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039964', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039922', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039574', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039525', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039471', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039425', None, None, None, None, None, '3657463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.019287586212158203 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6691644191741943 time spend to save output : 0.019632339477539062 total time spend for step 4 : 1.6887967586517334 step5:final Wed Sep 3 09:41:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1381040483: ('0.12315901491769546',), 1381040435: ('0.12315901491769546',), 1381040388: ('0.12315901491769546',), 1381040336: ('0.12315901491769546',), 1381040293: ('0.12315901491769546',), 1381040098: ('0.12315901491769546',), 1381040073: ('0.12315901491769546',), 1381040050: ('0.12315901491769546',), 1381040011: ('0.12315901491769546',), 1381039964: ('0.12315901491769546',), 1381039922: ('0.12315901491769546',), 1381039574: ('0.12315901491769546',), 1381039525: ('0.12315901491769546',), 1381039471: ('0.12315901491769546',), 1381039425: ('0.12315901491769546',)} new output for save of step final : {1381040483: ('0.12315901491769546',), 1381040435: ('0.12315901491769546',), 1381040388: ('0.12315901491769546',), 1381040336: ('0.12315901491769546',), 1381040293: ('0.12315901491769546',), 1381040098: ('0.12315901491769546',), 1381040073: ('0.12315901491769546',), 1381040050: ('0.12315901491769546',), 1381040011: ('0.12315901491769546',), 1381039964: ('0.12315901491769546',), 1381039922: ('0.12315901491769546',), 1381039574: ('0.12315901491769546',), 1381039525: ('0.12315901491769546',), 1381039471: ('0.12315901491769546',), 1381039425: ('0.12315901491769546',)} [1381040483, 1381040435, 1381040388, 1381040336, 1381040293, 1381040098, 1381040073, 1381040050, 1381040011, 1381039964, 1381039922, 1381039574, 1381039525, 1381039471, 1381039425] Looping around the photos to save general results len do output : 15 /1381040483.Didn't retrieve data . /1381040435.Didn't retrieve data . /1381040388.Didn't retrieve data . /1381040336.Didn't retrieve data . /1381040293.Didn't retrieve data . /1381040098.Didn't retrieve data . /1381040073.Didn't retrieve data . /1381040050.Didn't retrieve data . /1381040011.Didn't retrieve data . /1381039964.Didn't retrieve data . /1381039922.Didn't retrieve data . /1381039574.Didn't retrieve data . /1381039525.Didn't retrieve data . /1381039471.Didn't retrieve data . /1381039425.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040483', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040435', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040388', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040336', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040293', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040098', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040073', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040050', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040011', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039964', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039922', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039574', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039525', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039471', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039425', None, None, None, None, None, '3657463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.014021873474121094 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1168975830078125 time spend to save output : 0.014775753021240234 total time spend for step 5 : 0.13167333602905273 step6:blur_detection Wed Sep 3 09:41:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756885226_1521267_1381040483_e5d7a12258f19b9a7cdea25472a93351.jpg resize: (1080, 1920) 1381040483 -2.7996178600604864 treat image : temp/1756885226_1521267_1381040435_233c0b54e6c3b4896953ad72a1424361.jpg resize: (1080, 1920) 1381040435 -2.4385949535437454 treat image : temp/1756885226_1521267_1381040388_14908dee4c479dbf70277b10cee35961.jpg resize: (1080, 1920) 1381040388 -2.318654062284856 treat image : temp/1756885226_1521267_1381040336_ea90ac4c65020e6e7a871b0a5dbd5844.jpg resize: (1080, 1920) 1381040336 -1.4908397590795253 treat image : temp/1756885226_1521267_1381040293_4810955e6c5392eb16f3222f90bde671.jpg resize: (1080, 1920) 1381040293 -1.0141259243235068 treat image : temp/1756885226_1521267_1381040098_c7f9356b499bf851231cfdde762ad85d.jpg resize: (1080, 1920) 1381040098 -2.86203197751998 treat image : temp/1756885226_1521267_1381040073_86cda3ec3da234a10363af89d87cd678.jpg resize: (1080, 1920) 1381040073 -2.1567941639387556 treat image : temp/1756885226_1521267_1381040050_14e660b8671fd15a025701e6ee214ff4.jpg resize: (1080, 1920) 1381040050 -2.7923406552344856 treat image : temp/1756885226_1521267_1381040011_a3f4ba273fc2fe43976fd8f092da6d92.jpg resize: (1080, 1920) 1381040011 -1.8773673444592278 treat image : temp/1756885226_1521267_1381039964_4711c03bbc0b9bd16b99a0bcfd13b85c.jpg resize: (1080, 1920) 1381039964 -1.761566718534512 treat image : temp/1756885226_1521267_1381039922_60bb81606cd0324dce090142f9aadc60.jpg resize: (1080, 1920) 1381039922 -2.2879856174087823 treat image : temp/1756885226_1521267_1381039574_1c6f6e813ec03061d664e44de5e2084a.jpg resize: (1080, 1920) 1381039574 -2.3640921340218135 treat image : temp/1756885226_1521267_1381039525_a2bf9bf60b55c5954eaec1ea6d0df389.jpg resize: (1080, 1920) 1381039525 -0.07134742446439513 treat image : temp/1756885226_1521267_1381039471_91c57aac998e2f259bbbacbf6d6de443.jpg resize: (1080, 1920) 1381039471 1.0488392999041658 treat image : temp/1756885226_1521267_1381039425_b8ebaa798db6ea333a0151f7c6572e88.jpg resize: (1080, 1920) 1381039425 -2.3801839013961716 treat image : temp/1756885226_1521267_1381040336_ea90ac4c65020e6e7a871b0a5dbd5844_rle_crop_3941791098_0.png resize: (187, 117) 1381046852 -1.0370959835184272 treat image : temp/1756885226_1521267_1381040293_4810955e6c5392eb16f3222f90bde671_rle_crop_3941791100_0.png resize: (111, 111) 1381046853 -1.763578269696152 treat image : temp/1756885226_1521267_1381040011_a3f4ba273fc2fe43976fd8f092da6d92_rle_crop_3941791107_0.png resize: (85, 76) 1381046854 -1.6651637492334384 treat image : temp/1756885226_1521267_1381039574_1c6f6e813ec03061d664e44de5e2084a_rle_crop_3941791110_0.png resize: (84, 82) 1381046855 -2.012727627532435 treat image : temp/1756885226_1521267_1381039425_b8ebaa798db6ea333a0151f7c6572e88_rle_crop_3941791115_0.png resize: (88, 59) 1381046856 -1.1859125350593616 treat image : temp/1756885226_1521267_1381039425_b8ebaa798db6ea333a0151f7c6572e88_rle_crop_3941791116_0.png resize: (65, 59) 1381046857 -0.31224539503253607 treat image : temp/1756885226_1521267_1381039425_b8ebaa798db6ea333a0151f7c6572e88_rle_crop_3941791114_0.png resize: (113, 97) 1381046858 -2.9358740271719195 treat image : temp/1756885226_1521267_1381040073_86cda3ec3da234a10363af89d87cd678_rle_crop_3941791101_0.png resize: (84, 112) 1381046859 -1.8596877304852673 treat image : temp/1756885226_1521267_1381040050_14e660b8671fd15a025701e6ee214ff4_rle_crop_3941791103_0.png resize: (111, 134) 1381046860 0.4859200409398343 treat image : temp/1756885226_1521267_1381039922_60bb81606cd0324dce090142f9aadc60_rle_crop_3941791108_0.png resize: (95, 110) 1381046861 -2.0762477665929957 treat image : temp/1756885226_1521267_1381040435_233c0b54e6c3b4896953ad72a1424361_rle_crop_3941791097_0.png resize: (191, 240) 1381046874 -3.5084553228301627 treat image : temp/1756885226_1521267_1381040435_233c0b54e6c3b4896953ad72a1424361_rle_crop_3941791096_0.png resize: (93, 101) 1381046875 -3.094258576893244 treat image : temp/1756885226_1521267_1381040336_ea90ac4c65020e6e7a871b0a5dbd5844_rle_crop_3941791099_0.png resize: (134, 67) 1381046876 -1.8455138677310605 treat image : temp/1756885226_1521267_1381040073_86cda3ec3da234a10363af89d87cd678_rle_crop_3941791102_0.png resize: (953, 1419) 1381046877 -2.448295539986999 treat image : temp/1756885226_1521267_1381040011_a3f4ba273fc2fe43976fd8f092da6d92_rle_crop_3941791104_0.png resize: (90, 62) 1381046878 1.7222823955486444 treat image : temp/1756885226_1521267_1381040011_a3f4ba273fc2fe43976fd8f092da6d92_rle_crop_3941791106_0.png resize: (110, 103) 1381046879 -1.241495526977214 treat image : temp/1756885226_1521267_1381040011_a3f4ba273fc2fe43976fd8f092da6d92_rle_crop_3941791105_0.png resize: (494, 320) 1381046880 -0.492786672687151 treat image : temp/1756885226_1521267_1381039574_1c6f6e813ec03061d664e44de5e2084a_rle_crop_3941791111_0.png resize: (915, 1605) 1381046881 -0.544528746788663 treat image : temp/1756885226_1521267_1381039574_1c6f6e813ec03061d664e44de5e2084a_rle_crop_3941791112_0.png resize: (129, 126) 1381046882 -1.1161613602718443 treat image : temp/1756885226_1521267_1381039574_1c6f6e813ec03061d664e44de5e2084a_rle_crop_3941791109_0.png resize: (526, 360) 1381046884 0.4409739944863749 treat image : temp/1756885226_1521267_1381039425_b8ebaa798db6ea333a0151f7c6572e88_rle_crop_3941791113_0.png resize: (886, 1696) 1381046885 -0.7941458099863579 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 36 time used for this insertion : 0.014778852462768555 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 36 time used for this insertion : 0.015116453170776367 save missing photos in datou_result : time spend for datou_step_exec : 14.668624639511108 time spend to save output : 0.0463104248046875 total time spend for step 6 : 14.714935064315796 step7:brightness Wed Sep 3 09:41:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756885226_1521267_1381040483_e5d7a12258f19b9a7cdea25472a93351.jpg treat image : temp/1756885226_1521267_1381040435_233c0b54e6c3b4896953ad72a1424361.jpg treat image : temp/1756885226_1521267_1381040388_14908dee4c479dbf70277b10cee35961.jpg treat image : temp/1756885226_1521267_1381040336_ea90ac4c65020e6e7a871b0a5dbd5844.jpg treat image : temp/1756885226_1521267_1381040293_4810955e6c5392eb16f3222f90bde671.jpg treat image : temp/1756885226_1521267_1381040098_c7f9356b499bf851231cfdde762ad85d.jpg treat image : temp/1756885226_1521267_1381040073_86cda3ec3da234a10363af89d87cd678.jpg treat image : temp/1756885226_1521267_1381040050_14e660b8671fd15a025701e6ee214ff4.jpg treat image : temp/1756885226_1521267_1381040011_a3f4ba273fc2fe43976fd8f092da6d92.jpg treat image : temp/1756885226_1521267_1381039964_4711c03bbc0b9bd16b99a0bcfd13b85c.jpg treat image : temp/1756885226_1521267_1381039922_60bb81606cd0324dce090142f9aadc60.jpg treat image : temp/1756885226_1521267_1381039574_1c6f6e813ec03061d664e44de5e2084a.jpg treat image : temp/1756885226_1521267_1381039525_a2bf9bf60b55c5954eaec1ea6d0df389.jpg treat image : temp/1756885226_1521267_1381039471_91c57aac998e2f259bbbacbf6d6de443.jpg treat image : temp/1756885226_1521267_1381039425_b8ebaa798db6ea333a0151f7c6572e88.jpg treat image : temp/1756885226_1521267_1381040336_ea90ac4c65020e6e7a871b0a5dbd5844_rle_crop_3941791098_0.png treat image : temp/1756885226_1521267_1381040293_4810955e6c5392eb16f3222f90bde671_rle_crop_3941791100_0.png treat image : temp/1756885226_1521267_1381040011_a3f4ba273fc2fe43976fd8f092da6d92_rle_crop_3941791107_0.png treat image : temp/1756885226_1521267_1381039574_1c6f6e813ec03061d664e44de5e2084a_rle_crop_3941791110_0.png treat image : temp/1756885226_1521267_1381039425_b8ebaa798db6ea333a0151f7c6572e88_rle_crop_3941791115_0.png treat image : temp/1756885226_1521267_1381039425_b8ebaa798db6ea333a0151f7c6572e88_rle_crop_3941791116_0.png treat image : temp/1756885226_1521267_1381039425_b8ebaa798db6ea333a0151f7c6572e88_rle_crop_3941791114_0.png treat image : temp/1756885226_1521267_1381040073_86cda3ec3da234a10363af89d87cd678_rle_crop_3941791101_0.png treat image : temp/1756885226_1521267_1381040050_14e660b8671fd15a025701e6ee214ff4_rle_crop_3941791103_0.png treat image : temp/1756885226_1521267_1381039922_60bb81606cd0324dce090142f9aadc60_rle_crop_3941791108_0.png treat image : temp/1756885226_1521267_1381040435_233c0b54e6c3b4896953ad72a1424361_rle_crop_3941791097_0.png treat image : temp/1756885226_1521267_1381040435_233c0b54e6c3b4896953ad72a1424361_rle_crop_3941791096_0.png treat image : temp/1756885226_1521267_1381040336_ea90ac4c65020e6e7a871b0a5dbd5844_rle_crop_3941791099_0.png treat image : temp/1756885226_1521267_1381040073_86cda3ec3da234a10363af89d87cd678_rle_crop_3941791102_0.png treat image : temp/1756885226_1521267_1381040011_a3f4ba273fc2fe43976fd8f092da6d92_rle_crop_3941791104_0.png treat image : temp/1756885226_1521267_1381040011_a3f4ba273fc2fe43976fd8f092da6d92_rle_crop_3941791106_0.png treat image : temp/1756885226_1521267_1381040011_a3f4ba273fc2fe43976fd8f092da6d92_rle_crop_3941791105_0.png treat image : temp/1756885226_1521267_1381039574_1c6f6e813ec03061d664e44de5e2084a_rle_crop_3941791111_0.png treat image : temp/1756885226_1521267_1381039574_1c6f6e813ec03061d664e44de5e2084a_rle_crop_3941791112_0.png treat image : temp/1756885226_1521267_1381039574_1c6f6e813ec03061d664e44de5e2084a_rle_crop_3941791109_0.png treat image : temp/1756885226_1521267_1381039425_b8ebaa798db6ea333a0151f7c6572e88_rle_crop_3941791113_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 36 time used for this insertion : 0.018226146697998047 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 36 time used for this insertion : 0.013486385345458984 save missing photos in datou_result : time spend for datou_step_exec : 4.042385816574097 time spend to save output : 0.036518096923828125 total time spend for step 7 : 4.078903913497925 step8:velours_tree Wed Sep 3 09:41:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.088338851928711 time spend to save output : 7.414817810058594e-05 total time spend for step 8 : 1.0884130001068115 step9:send_mail_cod Wed Sep 3 09:41:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26478214_03-09-2025_09_41_47.pdf 26478293 imagette264782931756885307 26478294 imagette264782941756885307 26478296 imagette264782961756885307 26478297 change filename to text .change filename to text .change filename to text .imagette264782971756885307 26478298 imagette264782981756885307 26478299 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264782991756885307 26478300 imagette264783001756885307 26478301 imagette264783011756885307 26478303 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264783031756885307 26478304 imagette264783041756885308 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26478214 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26478293,26478294,26478296,26478297,26478298,26478299,26478300,26478301,26478302,26478303,26478304?tags=background,flou,metal,carton,pet_fonce,papier,pehd,autre,environnement,pet_clair,mal_croppe args[1381040483] : ((1381040483, -2.7996178600604864, 492609224), (1381040483, 0.7088715398530956, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381040435] : ((1381040435, -2.4385949535437454, 492609224), (1381040435, 0.8626812593283815, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381040388] : ((1381040388, -2.318654062284856, 492609224), (1381040388, 0.6421735403261574, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381040336] : ((1381040336, -1.4908397590795253, 492688767), (1381040336, 0.7364428295165234, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381040293] : ((1381040293, -1.0141259243235068, 492688767), (1381040293, 0.4574810691671674, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381040098] : ((1381040098, -2.86203197751998, 492609224), (1381040098, 0.45259999515526966, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381040073] : ((1381040073, -2.1567941639387556, 492609224), (1381040073, 0.3687833273731033, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381040050] : ((1381040050, -2.7923406552344856, 492609224), (1381040050, 0.558007124358722, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381040011] : ((1381040011, -1.8773673444592278, 492688767), (1381040011, 0.5870326973278008, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381039964] : ((1381039964, -1.761566718534512, 492688767), (1381039964, 0.4347119607923385, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381039922] : ((1381039922, -2.2879856174087823, 492609224), (1381039922, 0.643370044722411, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381039574] : ((1381039574, -2.3640921340218135, 492609224), (1381039574, 0.3555188138994866, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381039525] : ((1381039525, -0.07134742446439513, 492688767), (1381039525, 0.9242458769336905, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381039471] : ((1381039471, 1.0488392999041658, 492688767), (1381039471, 0.7958985885150012, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com args[1381039425] : ((1381039425, -2.3801839013961716, 492609224), (1381039425, 0.5203244533528482, 2107752395), '0.12315901491769546') We are sending mail with results at report@fotonower.com refus_total : 0.12315901491769546 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26478214 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26478214_03-09-2025_09_41_47.pdf results_Auto_P26478214_03-09-2025_09_41_47.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26478214_03-09-2025_09_41_47.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26478214','results_Auto_P26478214_03-09-2025_09_41_47.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26478214_03-09-2025_09_41_47.pdf','pdf','','0.48','0.12315901491769546') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26478214

https://www.fotonower.com/image?json=false&list_photos_id=1381040483
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381040435
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381040388
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381040336
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381040293
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381040098
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381040073
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381040050
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381040011
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381039964
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381039922
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381039574
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381039525
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381039471
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0488392999041658)
https://www.fotonower.com/image?json=false&list_photos_id=1381039425
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.32%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/26478297?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26478299?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26478303?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26478214_03-09-2025_09_41_47.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26478293,26478294,26478296,26478297,26478298,26478299,26478300,26478301,26478302,26478303,26478304?tags=background,flou,metal,carton,pet_fonce,papier,pehd,autre,environnement,pet_clair,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 03 Sep 2025 07:41:50 GMT Content-Length: 0 Connection: close X-Message-Id: VUFzvwzFSFO9kXBaRXk4eg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1381040483, 1381040435, 1381040388, 1381040336, 1381040293, 1381040098, 1381040073, 1381040050, 1381040011, 1381039964, 1381039922, 1381039574, 1381039525, 1381039471, 1381039425] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040483', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040435', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040388', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040336', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040293', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040098', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040073', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040050', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040011', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039964', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039922', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039574', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039525', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039471', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039425', None, None, None, None, None, '3657463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.015361785888671875 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.5214340686798096 time spend to save output : 0.015616655349731445 total time spend for step 9 : 3.537050724029541 step10:split_time_score Wed Sep 3 09:41:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 15),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03092025 26478214 Nombre de photos uploadées : 15 / 23040 (0%) 03092025 26478214 Nombre de photos taguées (types de déchets): 0 / 15 (0%) 03092025 26478214 Nombre de photos taguées (volume) : 0 / 15 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 3.814697265625e-06 ??????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0004627704620361328 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21115732192993164 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26478209 order by id desc limit 1 Qualite : 0.12315901491769546 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26478214_03-09-2025_09_41_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26478214 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26478214 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03092025': {'nb_upload': 15, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1381040483, 1381040435, 1381040388, 1381040336, 1381040293, 1381040098, 1381040073, 1381040050, 1381040011, 1381039964, 1381039922, 1381039574, 1381039525, 1381039471, 1381039425] Looping around the photos to save general results len do output : 1 /26478214Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040483', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040435', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040388', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040336', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040293', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040098', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040073', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040050', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381040011', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039964', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039922', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039574', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039525', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039471', None, None, None, None, None, '3657463') ('3318', None, None, None, None, None, None, None, '3657463') ('3318', '26478214', '1381039425', None, None, None, None, None, '3657463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.014834880828857422 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.4164321422576904 time spend to save output : 0.015229225158691406 total time spend for step 10 : 1.4316613674163818 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 15 set_done_treatment 55.56user 19.23system 1:27.72elapsed 85%CPU (0avgtext+0avgdata 2828016maxresident)k 983832inputs+33984outputs (12434major+1653788minor)pagefaults 0swaps