python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2045037 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3710536'] with mtr_portfolio_ids : ['26783341'] and first list_photo_ids : [] new path : /proc/2045037/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 1.2733278274536133 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Sep 12 11:00:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10591 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-12 11:00:35.818351: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-12 11:00:35.852568: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-12 11:00:35.855292: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f04ec000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-12 11:00:35.855366: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-12 11:00:35.862094: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-12 11:00:36.049479: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x265c6d70 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-12 11:00:36.049575: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-12 11:00:36.051697: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-12 11:00:36.052689: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 11:00:36.059081: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 11:00:36.078527: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-12 11:00:36.080336: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-12 11:00:36.113013: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-12 11:00:36.117770: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-12 11:00:36.172826: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-12 11:00:36.174798: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-12 11:00:36.175245: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 11:00:36.177092: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-12 11:00:36.177120: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-12 11:00:36.177132: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-12 11:00:36.179330: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9811 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-12 11:00:36.611337: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-12 11:00:36.611496: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 11:00:36.611520: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 11:00:36.611540: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-12 11:00:36.611560: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-12 11:00:36.611579: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-12 11:00:36.611598: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-12 11:00:36.611618: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-12 11:00:36.613251: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-12 11:00:36.614804: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-12 11:00:36.614845: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-12 11:00:36.614865: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 11:00:36.614883: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-12 11:00:36.614901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-12 11:00:36.614919: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-12 11:00:36.614937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-12 11:00:36.614955: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-12 11:00:36.616548: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-12 11:00:36.616591: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-12 11:00:36.616602: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-12 11:00:36.616612: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-12 11:00:36.618254: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9811 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-12 11:00:48.734628: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-12 11:00:49.182328: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 Detection mask done ! Trying to reset tf kernel 2045769 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5300 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10591 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.002101898193359375 nb_pixel_total : 83656 time to create 1 rle with old method : 0.0953516960144043 length of segment : 228 time for calcul the mask position with numpy : 0.0008413791656494141 nb_pixel_total : 44689 time to create 1 rle with old method : 0.05170440673828125 length of segment : 238 time for calcul the mask position with numpy : 0.0007331371307373047 nb_pixel_total : 29907 time to create 1 rle with old method : 0.033924102783203125 length of segment : 337 time for calcul the mask position with numpy : 0.00043964385986328125 nb_pixel_total : 17517 time to create 1 rle with old method : 0.02202630043029785 length of segment : 263 time for calcul the mask position with numpy : 0.001409292221069336 nb_pixel_total : 78062 time to create 1 rle with old method : 0.08867049217224121 length of segment : 471 time for calcul the mask position with numpy : 0.0005688667297363281 nb_pixel_total : 24118 time to create 1 rle with old method : 0.02786397933959961 length of segment : 207 time for calcul the mask position with numpy : 0.000919342041015625 nb_pixel_total : 47604 time to create 1 rle with old method : 0.05408120155334473 length of segment : 311 time for calcul the mask position with numpy : 0.003292560577392578 nb_pixel_total : 107921 time to create 1 rle with old method : 0.12883400917053223 length of segment : 934 time for calcul the mask position with numpy : 0.0050318241119384766 nb_pixel_total : 156358 time to create 1 rle with new method : 0.01435542106628418 length of segment : 678 time for calcul the mask position with numpy : 0.0014619827270507812 nb_pixel_total : 61440 time to create 1 rle with old method : 0.06967544555664062 length of segment : 709 time for calcul the mask position with numpy : 0.002518892288208008 nb_pixel_total : 152654 time to create 1 rle with new method : 0.009113073348999023 length of segment : 519 time for calcul the mask position with numpy : 0.000469207763671875 nb_pixel_total : 22100 time to create 1 rle with old method : 0.02521967887878418 length of segment : 259 time for calcul the mask position with numpy : 0.0004379749298095703 nb_pixel_total : 19727 time to create 1 rle with old method : 0.022784709930419922 length of segment : 228 time for calcul the mask position with numpy : 0.0003783702850341797 nb_pixel_total : 20720 time to create 1 rle with old method : 0.023929595947265625 length of segment : 228 time for calcul the mask position with numpy : 0.0005619525909423828 nb_pixel_total : 34282 time to create 1 rle with old method : 0.03954339027404785 length of segment : 171 time for calcul the mask position with numpy : 0.0005106925964355469 nb_pixel_total : 30332 time to create 1 rle with old method : 0.035581350326538086 length of segment : 166 time for calcul the mask position with numpy : 0.0012278556823730469 nb_pixel_total : 87001 time to create 1 rle with old method : 0.0989680290222168 length of segment : 291 time for calcul the mask position with numpy : 0.0009725093841552734 nb_pixel_total : 47904 time to create 1 rle with old method : 0.05605125427246094 length of segment : 362 time for calcul the mask position with numpy : 0.0004830360412597656 nb_pixel_total : 22670 time to create 1 rle with old method : 0.038289785385131836 length of segment : 128 time for calcul the mask position with numpy : 0.0061342716217041016 nb_pixel_total : 243054 time to create 1 rle with new method : 0.024682283401489258 length of segment : 857 time for calcul the mask position with numpy : 0.0005276203155517578 nb_pixel_total : 27703 time to create 1 rle with old method : 0.034013986587524414 length of segment : 231 time for calcul the mask position with numpy : 0.0003554821014404297 nb_pixel_total : 17848 time to create 1 rle with old method : 0.02243971824645996 length of segment : 147 time for calcul the mask position with numpy : 0.00015044212341308594 nb_pixel_total : 6321 time to create 1 rle with old method : 0.007585287094116211 length of segment : 76 time for calcul the mask position with numpy : 0.0033478736877441406 nb_pixel_total : 230333 time to create 1 rle with new method : 0.011352300643920898 length of segment : 649 time for calcul the mask position with numpy : 0.0005381107330322266 nb_pixel_total : 31081 time to create 1 rle with old method : 0.035468101501464844 length of segment : 245 time for calcul the mask position with numpy : 0.0005452632904052734 nb_pixel_total : 38673 time to create 1 rle with old method : 0.04416346549987793 length of segment : 163 time for calcul the mask position with numpy : 0.0025119781494140625 nb_pixel_total : 158704 time to create 1 rle with new method : 0.009815454483032227 length of segment : 386 time for calcul the mask position with numpy : 0.0022802352905273438 nb_pixel_total : 165446 time to create 1 rle with new method : 0.01250910758972168 length of segment : 523 time for calcul the mask position with numpy : 0.0006957054138183594 nb_pixel_total : 51448 time to create 1 rle with old method : 0.058228492736816406 length of segment : 154 time for calcul the mask position with numpy : 0.0012166500091552734 nb_pixel_total : 58696 time to create 1 rle with old method : 0.06791996955871582 length of segment : 230 time for calcul the mask position with numpy : 0.0008568763732910156 nb_pixel_total : 23040 time to create 1 rle with old method : 0.0334935188293457 length of segment : 147 time for calcul the mask position with numpy : 0.0029211044311523438 nb_pixel_total : 92304 time to create 1 rle with old method : 0.10997867584228516 length of segment : 295 time for calcul the mask position with numpy : 0.006072998046875 nb_pixel_total : 212380 time to create 1 rle with new method : 0.014401912689208984 length of segment : 805 time for calcul the mask position with numpy : 0.0007741451263427734 nb_pixel_total : 38342 time to create 1 rle with old method : 0.05486917495727539 length of segment : 287 time for calcul the mask position with numpy : 0.0016973018646240234 nb_pixel_total : 55763 time to create 1 rle with old method : 0.06446576118469238 length of segment : 432 time for calcul the mask position with numpy : 0.0005424022674560547 nb_pixel_total : 15294 time to create 1 rle with old method : 0.017719507217407227 length of segment : 126 time for calcul the mask position with numpy : 0.0007393360137939453 nb_pixel_total : 19010 time to create 1 rle with old method : 0.023088693618774414 length of segment : 194 time for calcul the mask position with numpy : 0.006392002105712891 nb_pixel_total : 290323 time to create 1 rle with new method : 0.01403665542602539 length of segment : 823 time for calcul the mask position with numpy : 0.003243684768676758 nb_pixel_total : 165194 time to create 1 rle with new method : 0.00997781753540039 length of segment : 624 time for calcul the mask position with numpy : 0.001934051513671875 nb_pixel_total : 55871 time to create 1 rle with old method : 0.06387114524841309 length of segment : 308 time for calcul the mask position with numpy : 0.0023190975189208984 nb_pixel_total : 81667 time to create 1 rle with old method : 0.0921480655670166 length of segment : 456 time for calcul the mask position with numpy : 0.0017445087432861328 nb_pixel_total : 40939 time to create 1 rle with old method : 0.04900979995727539 length of segment : 300 time for calcul the mask position with numpy : 0.000982046127319336 nb_pixel_total : 44043 time to create 1 rle with old method : 0.05144333839416504 length of segment : 283 time for calcul the mask position with numpy : 0.0004467964172363281 nb_pixel_total : 19446 time to create 1 rle with old method : 0.0229341983795166 length of segment : 153 time for calcul the mask position with numpy : 0.0010805130004882812 nb_pixel_total : 53987 time to create 1 rle with old method : 0.06487202644348145 length of segment : 250 time for calcul the mask position with numpy : 0.0012238025665283203 nb_pixel_total : 29164 time to create 1 rle with old method : 0.03497123718261719 length of segment : 204 time for calcul the mask position with numpy : 0.0017480850219726562 nb_pixel_total : 35188 time to create 1 rle with old method : 0.04892778396606445 length of segment : 224 time for calcul the mask position with numpy : 0.00457000732421875 nb_pixel_total : 49941 time to create 1 rle with old method : 0.06479406356811523 length of segment : 231 time for calcul the mask position with numpy : 0.0018377304077148438 nb_pixel_total : 33574 time to create 1 rle with old method : 0.04513382911682129 length of segment : 267 time for calcul the mask position with numpy : 0.0035352706909179688 nb_pixel_total : 136656 time to create 1 rle with old method : 0.15530896186828613 length of segment : 426 time for calcul the mask position with numpy : 0.0008733272552490234 nb_pixel_total : 24220 time to create 1 rle with old method : 0.028330087661743164 length of segment : 205 time for calcul the mask position with numpy : 0.0007143020629882812 nb_pixel_total : 18678 time to create 1 rle with old method : 0.02185535430908203 length of segment : 212 time for calcul the mask position with numpy : 0.00036978721618652344 nb_pixel_total : 7435 time to create 1 rle with old method : 0.008957624435424805 length of segment : 103 time for calcul the mask position with numpy : 0.0021257400512695312 nb_pixel_total : 41504 time to create 1 rle with old method : 0.04816937446594238 length of segment : 416 time for calcul the mask position with numpy : 0.0030298233032226562 nb_pixel_total : 68675 time to create 1 rle with old method : 0.07811641693115234 length of segment : 427 time for calcul the mask position with numpy : 0.0005934238433837891 nb_pixel_total : 13096 time to create 1 rle with old method : 0.015349388122558594 length of segment : 145 time for calcul the mask position with numpy : 0.00046181678771972656 nb_pixel_total : 13140 time to create 1 rle with old method : 0.015038251876831055 length of segment : 120 time for calcul the mask position with numpy : 0.00119781494140625 nb_pixel_total : 28239 time to create 1 rle with old method : 0.03297162055969238 length of segment : 140 time for calcul the mask position with numpy : 0.0007152557373046875 nb_pixel_total : 33036 time to create 1 rle with old method : 0.03781843185424805 length of segment : 183 time for calcul the mask position with numpy : 0.0009493827819824219 nb_pixel_total : 29093 time to create 1 rle with old method : 0.03412890434265137 length of segment : 177 time for calcul the mask position with numpy : 0.0017921924591064453 nb_pixel_total : 34387 time to create 1 rle with old method : 0.03995084762573242 length of segment : 290 time for calcul the mask position with numpy : 0.0032808780670166016 nb_pixel_total : 151549 time to create 1 rle with new method : 0.010251998901367188 length of segment : 574 time for calcul the mask position with numpy : 0.002615213394165039 nb_pixel_total : 136147 time to create 1 rle with old method : 0.1546630859375 length of segment : 401 time spent for convertir_results : 6.262538194656372 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 63 chid ids of type : 3594 Number RLEs to save : 20617 save missing photos in datou_result : time spend for datou_step_exec : 51.117677211761475 time spend to save output : 1.2990643978118896 total time spend for step 1 : 52.416741609573364 step2:crop_condition Fri Sep 12 11:01:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 63 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 48 About to insert : list_path_to_insert length 48 new photo from crops ! About to upload 48 photos upload in portfolio : 3736932 init cache_photo without model_param we have 48 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667702_2045037 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 48 photos in the portfolio 3736932 time of upload the photos Elapsed time : 15.317602396011353 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667720_2045037 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.7943520545959473 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667724_2045037 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7861549854278564 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757667728_2045037 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1483144760131836 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1383372034, 1383371947, 1383371734, 1383371622, 1383371584] Looping around the photos to save general results len do output : 63 /1383379137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1383379265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383372034', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371947', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371734', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371622', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371584', None, None, None, None, None, '3710536') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 194 time used for this insertion : 0.0314633846282959 save_final save missing photos in datou_result : time spend for datou_step_exec : 44.83906102180481 time spend to save output : 0.0579838752746582 total time spend for step 2 : 44.89704489707947 step3:rle_unique_nms_with_priority Fri Sep 12 11:02:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 63 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 8.78938364982605 time for calcul the mask position with numpy : 0.6757373809814453 nb_pixel_total : 7393650 time to create 1 rle with new method : 0.9789140224456787 time for calcul the mask position with numpy : 0.042571067810058594 nb_pixel_total : 34277 time to create 1 rle with old method : 0.03911900520324707 time for calcul the mask position with numpy : 0.045385122299194336 nb_pixel_total : 20720 time to create 1 rle with old method : 0.023175716400146484 time for calcul the mask position with numpy : 0.04038119316101074 nb_pixel_total : 19727 time to create 1 rle with old method : 0.02236771583557129 time for calcul the mask position with numpy : 0.026140213012695312 nb_pixel_total : 22100 time to create 1 rle with old method : 0.026273488998413086 time for calcul the mask position with numpy : 0.027801036834716797 nb_pixel_total : 152654 time to create 1 rle with new method : 0.929502010345459 time for calcul the mask position with numpy : 0.02863454818725586 nb_pixel_total : 61440 time to create 1 rle with old method : 0.07043600082397461 time for calcul the mask position with numpy : 0.027251243591308594 nb_pixel_total : 156358 time to create 1 rle with new method : 0.7368061542510986 time for calcul the mask position with numpy : 0.025821924209594727 nb_pixel_total : 107921 time to create 1 rle with old method : 0.12188529968261719 time for calcul the mask position with numpy : 0.026042938232421875 nb_pixel_total : 47604 time to create 1 rle with old method : 0.05326056480407715 time for calcul the mask position with numpy : 0.026482582092285156 nb_pixel_total : 24118 time to create 1 rle with old method : 0.02712869644165039 time for calcul the mask position with numpy : 0.02830362319946289 nb_pixel_total : 78062 time to create 1 rle with old method : 0.0879666805267334 time for calcul the mask position with numpy : 0.02521204948425293 nb_pixel_total : 17517 time to create 1 rle with old method : 0.019595623016357422 time for calcul the mask position with numpy : 0.025028228759765625 nb_pixel_total : 29907 time to create 1 rle with old method : 0.033277273178100586 time for calcul the mask position with numpy : 0.025258541107177734 nb_pixel_total : 44689 time to create 1 rle with old method : 0.050251007080078125 time for calcul the mask position with numpy : 0.027252912521362305 nb_pixel_total : 83656 time to create 1 rle with old method : 0.09386849403381348 create new chi : 4.535851955413818 time to delete rle : 0.027049541473388672 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 13704 TO DO : save crop sub photo not yet done ! save time : 1.2684693336486816 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 6.3324079513549805 time for calcul the mask position with numpy : 0.9639933109283447 nb_pixel_total : 7202192 time to create 1 rle with new method : 0.6608626842498779 time for calcul the mask position with numpy : 0.027004718780517578 nb_pixel_total : 51448 time to create 1 rle with old method : 0.0604398250579834 time for calcul the mask position with numpy : 0.026950597763061523 nb_pixel_total : 165446 time to create 1 rle with new method : 0.7073094844818115 time for calcul the mask position with numpy : 0.026461362838745117 nb_pixel_total : 158704 time to create 1 rle with new method : 0.7085821628570557 time for calcul the mask position with numpy : 0.024359941482543945 nb_pixel_total : 38673 time to create 1 rle with old method : 0.042093515396118164 time for calcul the mask position with numpy : 0.02444934844970703 nb_pixel_total : 31081 time to create 1 rle with old method : 0.03387618064880371 time for calcul the mask position with numpy : 0.02516794204711914 nb_pixel_total : 230333 time to create 1 rle with new method : 0.5532944202423096 time for calcul the mask position with numpy : 0.025438308715820312 nb_pixel_total : 6321 time to create 1 rle with old method : 0.0070950984954833984 time for calcul the mask position with numpy : 0.02443838119506836 nb_pixel_total : 17848 time to create 1 rle with old method : 0.01933002471923828 time for calcul the mask position with numpy : 0.025348186492919922 nb_pixel_total : 27703 time to create 1 rle with old method : 0.03128337860107422 time for calcul the mask position with numpy : 0.025828838348388672 nb_pixel_total : 176744 time to create 1 rle with new method : 0.6181526184082031 time for calcul the mask position with numpy : 0.024732351303100586 nb_pixel_total : 22670 time to create 1 rle with old method : 0.02413010597229004 time for calcul the mask position with numpy : 0.0243072509765625 nb_pixel_total : 47904 time to create 1 rle with old method : 0.05177760124206543 time for calcul the mask position with numpy : 0.02413034439086914 nb_pixel_total : 87001 time to create 1 rle with old method : 0.09415102005004883 time for calcul the mask position with numpy : 0.024649620056152344 nb_pixel_total : 30332 time to create 1 rle with old method : 0.03272199630737305 create new chi : 5.119815826416016 time to delete rle : 0.0017642974853515625 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 10512 TO DO : save crop sub photo not yet done ! save time : 26.41556978225708 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 3.4041545391082764 time for calcul the mask position with numpy : 0.7751169204711914 nb_pixel_total : 7798581 time to create 1 rle with new method : 0.8517003059387207 time for calcul the mask position with numpy : 0.024658679962158203 nb_pixel_total : 15294 time to create 1 rle with old method : 0.017016172409057617 time for calcul the mask position with numpy : 0.025225162506103516 nb_pixel_total : 55763 time to create 1 rle with old method : 0.06189465522766113 time for calcul the mask position with numpy : 0.025417566299438477 nb_pixel_total : 38342 time to create 1 rle with old method : 0.04310107231140137 time for calcul the mask position with numpy : 0.027719736099243164 nb_pixel_total : 212380 time to create 1 rle with new method : 0.5049340724945068 time for calcul the mask position with numpy : 0.026531457901000977 nb_pixel_total : 92304 time to create 1 rle with old method : 0.10345578193664551 time for calcul the mask position with numpy : 0.026540756225585938 nb_pixel_total : 23040 time to create 1 rle with old method : 0.025994539260864258 time for calcul the mask position with numpy : 0.02696061134338379 nb_pixel_total : 58696 time to create 1 rle with old method : 0.07608866691589355 create new chi : 2.7247235774993896 time to delete rle : 0.0009953975677490234 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 6804 TO DO : save crop sub photo not yet done ! save time : 0.5204696655273438 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 3.969815731048584 time for calcul the mask position with numpy : 0.44511842727661133 nb_pixel_total : 7523920 time to create 1 rle with new method : 1.0505070686340332 time for calcul the mask position with numpy : 0.02665877342224121 nb_pixel_total : 53987 time to create 1 rle with old method : 0.059857845306396484 time for calcul the mask position with numpy : 0.025280237197875977 nb_pixel_total : 19446 time to create 1 rle with old method : 0.02176189422607422 time for calcul the mask position with numpy : 0.02526259422302246 nb_pixel_total : 44043 time to create 1 rle with old method : 0.04892110824584961 time for calcul the mask position with numpy : 0.02605438232421875 nb_pixel_total : 40939 time to create 1 rle with old method : 0.06414580345153809 time for calcul the mask position with numpy : 0.028229713439941406 nb_pixel_total : 81667 time to create 1 rle with old method : 0.08984780311584473 time for calcul the mask position with numpy : 0.0261077880859375 nb_pixel_total : 55871 time to create 1 rle with old method : 0.06316924095153809 time for calcul the mask position with numpy : 0.03053736686706543 nb_pixel_total : 165194 time to create 1 rle with new method : 0.7784738540649414 time for calcul the mask position with numpy : 0.027357816696166992 nb_pixel_total : 290323 time to create 1 rle with new method : 0.6162333488464355 time for calcul the mask position with numpy : 0.026744604110717773 nb_pixel_total : 19010 time to create 1 rle with old method : 0.021326780319213867 create new chi : 3.6016674041748047 time to delete rle : 0.0011470317840576172 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8942 TO DO : save crop sub photo not yet done ! save time : 0.5922303199768066 nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 6.670743703842163 time for calcul the mask position with numpy : 0.6520795822143555 nb_pixel_total : 7609025 time to create 1 rle with new method : 0.9621059894561768 time for calcul the mask position with numpy : 0.04185199737548828 nb_pixel_total : 3848 time to create 1 rle with old method : 0.004738807678222656 time for calcul the mask position with numpy : 0.039411067962646484 nb_pixel_total : 85501 time to create 1 rle with old method : 0.09427142143249512 time for calcul the mask position with numpy : 0.024689197540283203 nb_pixel_total : 34387 time to create 1 rle with old method : 0.038141727447509766 time for calcul the mask position with numpy : 0.024630069732666016 nb_pixel_total : 29093 time to create 1 rle with old method : 0.03289437294006348 time for calcul the mask position with numpy : 0.025716543197631836 nb_pixel_total : 33036 time to create 1 rle with old method : 0.03737688064575195 time for calcul the mask position with numpy : 0.025107145309448242 nb_pixel_total : 28239 time to create 1 rle with old method : 0.03160548210144043 time for calcul the mask position with numpy : 0.025051593780517578 nb_pixel_total : 13140 time to create 1 rle with old method : 0.014847993850708008 time for calcul the mask position with numpy : 0.0289156436920166 nb_pixel_total : 13096 time to create 1 rle with old method : 0.021164417266845703 time for calcul the mask position with numpy : 0.07500863075256348 nb_pixel_total : 68675 time to create 1 rle with old method : 0.09813189506530762 time for calcul the mask position with numpy : 0.027681350708007812 nb_pixel_total : 41504 time to create 1 rle with old method : 0.04680752754211426 time for calcul the mask position with numpy : 0.02686762809753418 nb_pixel_total : 7435 time to create 1 rle with old method : 0.008411645889282227 time for calcul the mask position with numpy : 0.028864383697509766 nb_pixel_total : 18678 time to create 1 rle with old method : 0.021134614944458008 time for calcul the mask position with numpy : 0.029208660125732422 nb_pixel_total : 24220 time to create 1 rle with old method : 0.02724480628967285 time for calcul the mask position with numpy : 0.02777099609375 nb_pixel_total : 136656 time to create 1 rle with old method : 0.15374970436096191 time for calcul the mask position with numpy : 0.026686429977416992 nb_pixel_total : 33574 time to create 1 rle with old method : 0.043710947036743164 time for calcul the mask position with numpy : 0.02656388282775879 nb_pixel_total : 49941 time to create 1 rle with old method : 0.05709433555603027 time for calcul the mask position with numpy : 0.02638554573059082 nb_pixel_total : 35188 time to create 1 rle with old method : 0.044158935546875 time for calcul the mask position with numpy : 0.026997804641723633 nb_pixel_total : 29164 time to create 1 rle with old method : 0.03259992599487305 create new chi : 3.0229721069335938 time to delete rle : 0.0013566017150878906 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 11066 TO DO : save crop sub photo not yet done ! save time : 0.6812605857849121 map_output_result : {1383372034: (0.0, 'Should be the crop_list due to order', 0), 1383371947: (0.0, 'Should be the crop_list due to order', 0), 1383371734: (0.0, 'Should be the crop_list due to order', 0), 1383371622: (0.0, 'Should be the crop_list due to order', 0), 1383371584: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1383372034, 1383371947, 1383371734, 1383371622, 1383371584] Looping around the photos to save general results len do output : 5 /1383372034.Didn't retrieve data . /1383371947.Didn't retrieve data . /1383371734.Didn't retrieve data . /1383371622.Didn't retrieve data . /1383371584.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383372034', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371947', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371734', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371622', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371584', None, None, None, None, None, '3710536') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.013540029525756836 save_final save missing photos in datou_result : time spend for datou_step_exec : 78.5378794670105 time spend to save output : 0.013870954513549805 total time spend for step 3 : 78.55175042152405 step4:ventilate_hashtags_in_portfolio Fri Sep 12 11:03:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26783341 get user id for portfolio 26783341 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26783341 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','carton','papier','pet_clair','background','pehd','pet_fonce','autre','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26783341 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','carton','papier','pet_clair','background','pehd','pet_fonce','autre','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26783341 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','carton','papier','pet_clair','background','pehd','pet_fonce','autre','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26784199,26784200,26784201,26784202,26784203,26784204,26784205,26784206,26784207,26784208,26784209?tags=environnement,flou,carton,papier,pet_clair,background,pehd,pet_fonce,autre,metal,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1383372034, 1383371947, 1383371734, 1383371622, 1383371584] Looping around the photos to save general results len do output : 1 /26783341. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383372034', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371947', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371734', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371622', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371584', None, None, None, None, None, '3710536') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.014752388000488281 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7200102806091309 time spend to save output : 0.01512002944946289 total time spend for step 4 : 1.7351303100585938 step5:final Fri Sep 12 11:03:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1383372034: ('0.09511554783950618',), 1383371947: ('0.09511554783950618',), 1383371734: ('0.09511554783950618',), 1383371622: ('0.09511554783950618',), 1383371584: ('0.09511554783950618',)} new output for save of step final : {1383372034: ('0.09511554783950618',), 1383371947: ('0.09511554783950618',), 1383371734: ('0.09511554783950618',), 1383371622: ('0.09511554783950618',), 1383371584: ('0.09511554783950618',)} [1383372034, 1383371947, 1383371734, 1383371622, 1383371584] Looping around the photos to save general results len do output : 5 /1383372034.Didn't retrieve data . /1383371947.Didn't retrieve data . /1383371734.Didn't retrieve data . /1383371622.Didn't retrieve data . /1383371584.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383372034', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371947', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371734', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371622', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371584', None, None, None, None, None, '3710536') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.013106822967529297 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11275529861450195 time spend to save output : 0.013437747955322266 total time spend for step 5 : 0.12619304656982422 step6:blur_detection Fri Sep 12 11:03:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e.jpg resize: (2160, 3840) 1383372034 -6.959301881525275 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1.jpg resize: (2160, 3840) 1383371947 -6.422356021384832 treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3.jpg resize: (2160, 3840) 1383371734 -6.824791029891618 treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad.jpg resize: (2160, 3840) 1383371622 -6.866253330795261 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a.jpg resize: (2160, 3840) 1383371584 -6.872832779975465 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245101_0.png resize: (216, 396) 1383379137 3.354108634577029 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245102_0.png resize: (314, 189) 1383379138 -4.239407663706181 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245104_0.png resize: (282, 419) 1383379139 -1.1846347414410952 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245105_0.png resize: (194, 221) 1383379140 -0.447421209199832 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245106_0.png resize: (309, 206) 1383379141 -4.02354472383985 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245107_0.png resize: (578, 371) 1383379142 -4.340368801595844 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245108_0.png resize: (674, 399) 1383379143 -4.470776398124072 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245109_0.png resize: (581, 209) 1383379144 -4.138828092802179 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245110_0.png resize: (447, 460) 1383379145 -3.6228039632316555 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245111_0.png resize: (259, 123) 1383379146 -3.5940202682983653 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245113_0.png resize: (227, 118) 1383379147 -3.583696260163445 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245114_0.png resize: (170, 257) 1383379148 -2.742684837695807 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245115_0.png resize: (166, 308) 1383379149 -3.577347703509543 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245116_0.png resize: (288, 433) 1383379150 -1.9899054796696443 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245117_0.png resize: (361, 252) 1383379151 -3.037866356595123 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245118_0.png resize: (127, 227) 1383379152 -2.4774335083651926 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245119_0.png resize: (810, 534) 1383379153 -4.16293859597132 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245120_0.png resize: (228, 175) 1383379154 -4.215214226470036 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245121_0.png resize: (147, 213) 1383379155 -4.39870711410534 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245122_0.png resize: (73, 110) 1383379156 -3.8631454815249358 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245123_0.png resize: (647, 474) 1383379157 -3.1352681584476394 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245124_0.png resize: (244, 192) 1383379158 -3.465844381845343 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245126_0.png resize: (373, 620) 1383379159 -1.9346731320388946 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245127_0.png resize: (412, 505) 1383379160 -4.916316458124354 treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245130_0.png resize: (146, 232) 1383379161 -2.821193203089355 treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245131_0.png resize: (294, 531) 1383379162 -1.8173969585411707 treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245132_0.png resize: (694, 479) 1383379164 -3.6979185288745873 treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245135_0.png resize: (126, 160) 1383379165 -3.9487030165636234 treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245137_0.png resize: (728, 502) 1383379167 -5.651658730461856 treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245138_0.png resize: (599, 428) 1383379168 -4.145368934298429 treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245139_0.png resize: (286, 305) 1383379169 -2.602974926179117 treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245140_0.png resize: (421, 319) 1383379171 -4.014051793874663 treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245142_0.png resize: (283, 220) 1383379172 -5.478278176510388 treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245143_0.png resize: (149, 176) 1383379173 -2.7195893005495173 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245145_0.png resize: (204, 191) 1383379175 0.5972945889031293 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245146_0.png resize: (220, 194) 1383379176 -2.947826623798277 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245147_0.png resize: (230, 355) 1383379177 0.384431705821991 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245148_0.png resize: (248, 232) 1383379179 -3.4409592879433357 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245149_0.png resize: (393, 439) 1383379180 -3.1105812546752363 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245150_0.png resize: (197, 189) 1383379181 -3.0515969230223865 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245151_0.png resize: (198, 168) 1383379183 -3.6550642873291608 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245152_0.png resize: (103, 96) 1383379184 -2.6419032518374554 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245153_0.png resize: (416, 265) 1383379185 -3.148562313077495 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245154_0.png resize: (372, 464) 1383379187 -3.8996671443522604 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245156_0.png resize: (116, 134) 1383379188 -2.3297326354028187 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245157_0.png resize: (133, 357) 1383379189 -1.4008944595347053 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245159_0.png resize: (151, 256) 1383379191 -4.248226075857364 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245160_0.png resize: (265, 319) 1383379192 -1.1317972464927135 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245103_0.png resize: (262, 90) 1383379207 -1.811988325473589 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245112_0.png resize: (218, 120) 1383379208 -1.9918142096634837 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245125_0.png resize: (154, 311) 1383379209 -3.0094082324419587 treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245129_0.png resize: (226, 316) 1383379212 -3.7153238787243104 treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245133_0.png resize: (287, 243) 1383379213 -2.6501908634481217 treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245134_0.png resize: (373, 275) 1383379214 -3.7537578488289656 treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245136_0.png resize: (171, 195) 1383379217 -2.334565298034983 treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245144_0.png resize: (235, 301) 1383379218 -3.5780095133376992 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245158_0.png resize: (178, 208) 1383379219 -3.004456277859232 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245162_0.png resize: (389, 442) 1383379222 -3.1671400027548886 treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245128_0.png resize: (150, 455) 1383379242 -4.812056554355973 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245155_0.png resize: (145, 137) 1383379244 -4.095505883230531 treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245100_0.png resize: (227, 504) 1383379263 -5.101355084001962 treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245141_0.png resize: (273, 263) 1383379264 -3.8146410194304825 treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245161_0.png resize: (417, 608) 1383379265 -5.008218542542184 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 68 time used for this insertion : 0.013732433319091797 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 68 time used for this insertion : 0.014264822006225586 save missing photos in datou_result : time spend for datou_step_exec : 22.003142833709717 time spend to save output : 0.03319597244262695 total time spend for step 6 : 22.036338806152344 step7:brightness Fri Sep 12 11:03:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e.jpg treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1.jpg treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3.jpg treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad.jpg treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a.jpg treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245101_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245102_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245104_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245105_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245106_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245107_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245108_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245109_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245110_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245111_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245113_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245114_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245115_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245116_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245117_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245118_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245119_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245120_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245121_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245122_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245123_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245124_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245126_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245127_0.png treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245130_0.png treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245131_0.png treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245132_0.png treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245135_0.png treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245137_0.png treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245138_0.png treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245139_0.png treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245140_0.png treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245142_0.png treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245143_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245145_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245146_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245147_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245148_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245149_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245150_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245151_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245152_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245153_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245154_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245156_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245157_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245159_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245160_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245103_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245112_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245125_0.png treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245129_0.png treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245133_0.png treat image : temp/1757667630_2045037_1383371734_6f1ec9e415a80fc7eba31fc027a764b3_rle_crop_3956245134_0.png treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245136_0.png treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245144_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245158_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245162_0.png treat image : temp/1757667630_2045037_1383371947_a90d86ca9c46b4fe6f480117df446bb1_rle_crop_3956245128_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245155_0.png treat image : temp/1757667630_2045037_1383372034_88719841ebe8a2a42caaa1d525a8f55e_rle_crop_3956245100_0.png treat image : temp/1757667630_2045037_1383371622_d9da30fe70ddce28e516d787d6418dad_rle_crop_3956245141_0.png treat image : temp/1757667630_2045037_1383371584_a361a42b7cfdcda26ff0929da3042e2a_rle_crop_3956245161_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 68 time used for this insertion : 0.01707601547241211 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 68 time used for this insertion : 0.01526784896850586 save missing photos in datou_result : time spend for datou_step_exec : 8.287641048431396 time spend to save output : 0.037355899810791016 total time spend for step 7 : 8.324996948242188 step8:velours_tree Fri Sep 12 11:03:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09601545333862305 time spend to save output : 5.364418029785156e-05 total time spend for step 8 : 0.0960690975189209 step9:send_mail_cod Fri Sep 12 11:03:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26783341_12-09-2025_11_03_59.pdf 26784200 imagette267842001757667839 26784201 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267842011757667839 26784202 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette267842021757667840 26784203 change filename to text .change filename to text .change filename to text .imagette267842031757667842 26784204 imagette267842041757667842 26784205 imagette267842051757667842 26784206 imagette267842061757667842 26784207 imagette267842071757667842 26784208 change filename to text .change filename to text .imagette267842081757667842 26784209 imagette267842091757667842 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26783341 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26784199,26784200,26784201,26784202,26784203,26784204,26784205,26784206,26784207,26784208,26784209?tags=environnement,flou,carton,papier,pet_clair,background,pehd,pet_fonce,autre,metal,mal_croppe args[1383372034] : ((1383372034, -6.959301881525275, 492609224), (1383372034, 1.1608900909685251, 2107752395), '0.09511554783950618') We are sending mail with results at report@fotonower.com args[1383371947] : ((1383371947, -6.422356021384832, 492609224), (1383371947, 0.5411470231406728, 2107752395), '0.09511554783950618') We are sending mail with results at report@fotonower.com args[1383371734] : ((1383371734, -6.824791029891618, 492609224), (1383371734, 0.6083538349678579, 2107752395), '0.09511554783950618') We are sending mail with results at report@fotonower.com args[1383371622] : ((1383371622, -6.866253330795261, 492609224), (1383371622, 0.7511200545043775, 2107752395), '0.09511554783950618') We are sending mail with results at report@fotonower.com args[1383371584] : ((1383371584, -6.872832779975465, 492609224), (1383371584, 1.0947726241970506, 2107752395), '0.09511554783950618') We are sending mail with results at report@fotonower.com refus_total : 0.09511554783950618 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26783341 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26783341_12-09-2025_11_03_59.pdf results_Auto_P26783341_12-09-2025_11_03_59.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26783341_12-09-2025_11_03_59.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26783341','results_Auto_P26783341_12-09-2025_11_03_59.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26783341_12-09-2025_11_03_59.pdf','pdf','','0.46','0.09511554783950618') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26783341

https://www.fotonower.com/image?json=false&list_photos_id=1383372034
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383371947
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383371734
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383371622
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1383371584
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 9.51%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/26784201?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26784202?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26784203?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26784208?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26783341_12-09-2025_11_03_59.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26784199,26784200,26784201,26784202,26784203,26784204,26784205,26784206,26784207,26784208,26784209?tags=environnement,flou,carton,papier,pet_clair,background,pehd,pet_fonce,autre,metal,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 12 Sep 2025 09:04:04 GMT Content-Length: 0 Connection: close X-Message-Id: lK1g_JrcQiG1PfbI6fKcnA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1383372034, 1383371947, 1383371734, 1383371622, 1383371584] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383372034', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371947', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371734', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371622', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371584', None, None, None, None, None, '3710536') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012555837631225586 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.177751064300537 time spend to save output : 0.012758731842041016 total time spend for step 9 : 5.190509796142578 step10:split_time_score Fri Sep 12 11:04:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 12092025 26783341 Nombre de photos uploadées : 5 / 23040 (0%) 12092025 26783341 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 12092025 26783341 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 7.152557373046875e-06 ????? elapsed_time : fill_and_build_computed_from_old_data 0.00031065940856933594 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2154707908630371 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09511554783950618 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26783341_12-09-2025_11_03_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26783341 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26783341 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'12092025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1383372034, 1383371947, 1383371734, 1383371622, 1383371584] Looping around the photos to save general results len do output : 1 /26783341Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383372034', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371947', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371734', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371622', None, None, None, None, None, '3710536') ('3318', None, None, None, None, None, None, None, '3710536') ('3318', '26783341', '1383371584', None, None, None, None, None, '3710536') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.014682292938232422 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.46141910552978516 time spend to save output : 0.014931917190551758 total time spend for step 10 : 0.4763510227203369 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 85.50user 75.03system 3:40.22elapsed 72%CPU (0avgtext+0avgdata 3568188maxresident)k 2272488inputs+78264outputs (8171major+7339523minor)pagefaults 0swaps