python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1899923 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2803618'] with mtr_portfolio_ids : ['22773755'] and first list_photo_ids : [] new path : /proc/1899923/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.2421765327453613 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed May 7 18:30:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4493 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-07 18:30:32.636492: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-07 18:30:32.667194: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-07 18:30:32.669546: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fadc4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-07 18:30:32.669609: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-07 18:30:32.674236: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-07 18:30:32.930364: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x215b9de0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-07 18:30:32.930429: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-07 18:30:32.931694: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 18:30:32.932830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 18:30:32.938565: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 18:30:32.946039: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 18:30:32.947922: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 18:30:32.962056: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 18:30:32.966150: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 18:30:32.992318: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 18:30:32.993667: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 18:30:32.993749: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 18:30:32.994469: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-07 18:30:32.994488: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-07 18:30:32.994498: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-07 18:30:32.996152: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4041 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-07 18:30:33.307042: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 18:30:33.307135: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 18:30:33.307158: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 18:30:33.307180: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 18:30:33.307200: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 18:30:33.307220: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 18:30:33.307239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 18:30:33.307259: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 18:30:33.308383: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 18:30:33.309458: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-07 18:30:33.309491: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-07 18:30:33.309510: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 18:30:33.309527: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-07 18:30:33.309544: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-07 18:30:33.309561: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-07 18:30:33.309578: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-07 18:30:33.309595: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 18:30:33.310741: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-07 18:30:33.310771: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-07 18:30:33.310782: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-07 18:30:33.310791: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-07 18:30:33.311987: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4041 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-07 18:30:45.080698: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-07 18:30:45.086798: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_NOT_INITIALIZED 2025-05-07 18:30:45.087995: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_NOT_INITIALIZED 2025-05-07 18:30:45.097033: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-07 18:30:45.127847: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-07 18:30:45.133963: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-07 18:30:48.908651: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.704446: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-05-07 18:30:49.783415: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.783508: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 18:30:49.784637: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.784669: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 18:30:49.791824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.791859: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 18:30:49.792605: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.792629: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 18:30:49.841324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.841421: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 18:30:49.842577: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.842618: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 18:30:49.843784: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.843819: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 18:30:49.844897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.844923: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 18:30:49.854778: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.854864: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 18:30:49.855649: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.855680: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-07 18:30:49.876396: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.877178: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.877904: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.878584: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.883214: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.884068: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.884766: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.885481: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.886856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.886887: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-07 18:30:49.897196: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.897943: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.907677: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.908438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.909175: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.909911: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.910641: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-07 18:30:49.911376: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.45G (3702390784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1746635427_1899923_1356661536_e3157957c1774537862ed26dae9d557d.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/map/while/loop_body_control/_33/_71]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 Detection mask done ! Trying to reset tf kernel 1900618 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3298 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4493 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.001116037368774414 nb_pixel_total : 23429 time to create 1 rle with old method : 0.028443098068237305 length of segment : 192 time for calcul the mask position with numpy : 0.0016090869903564453 nb_pixel_total : 46851 time to create 1 rle with old method : 0.058130502700805664 length of segment : 285 time for calcul the mask position with numpy : 0.0007927417755126953 nb_pixel_total : 13377 time to create 1 rle with old method : 0.026875019073486328 length of segment : 134 time for calcul the mask position with numpy : 0.002099752426147461 nb_pixel_total : 70232 time to create 1 rle with old method : 0.09698343276977539 length of segment : 435 time for calcul the mask position with numpy : 0.0009121894836425781 nb_pixel_total : 19098 time to create 1 rle with old method : 0.029946088790893555 length of segment : 252 time for calcul the mask position with numpy : 0.0012841224670410156 nb_pixel_total : 28394 time to create 1 rle with old method : 0.045856475830078125 length of segment : 156 time for calcul the mask position with numpy : 0.0008177757263183594 nb_pixel_total : 15387 time to create 1 rle with old method : 0.031243324279785156 length of segment : 160 time for calcul the mask position with numpy : 0.0058135986328125 nb_pixel_total : 114276 time to create 1 rle with old method : 0.15862584114074707 length of segment : 642 time for calcul the mask position with numpy : 0.0007467269897460938 nb_pixel_total : 20721 time to create 1 rle with old method : 0.026227235794067383 length of segment : 313 time for calcul the mask position with numpy : 0.0004975795745849609 nb_pixel_total : 10448 time to create 1 rle with old method : 0.01317453384399414 length of segment : 122 time for calcul the mask position with numpy : 0.0025146007537841797 nb_pixel_total : 74522 time to create 1 rle with old method : 0.10138249397277832 length of segment : 565 time for calcul the mask position with numpy : 0.0007297992706298828 nb_pixel_total : 26426 time to create 1 rle with old method : 0.03889179229736328 length of segment : 115 time for calcul the mask position with numpy : 0.003854036331176758 nb_pixel_total : 112984 time to create 1 rle with old method : 0.1476454734802246 length of segment : 358 time for calcul the mask position with numpy : 0.0006747245788574219 nb_pixel_total : 17184 time to create 1 rle with old method : 0.02803778648376465 length of segment : 156 time for calcul the mask position with numpy : 0.0003819465637207031 nb_pixel_total : 6639 time to create 1 rle with old method : 0.01066279411315918 length of segment : 78 time for calcul the mask position with numpy : 0.004536628723144531 nb_pixel_total : 102593 time to create 1 rle with old method : 0.1419358253479004 length of segment : 781 time for calcul the mask position with numpy : 0.000469207763671875 nb_pixel_total : 17653 time to create 1 rle with old method : 0.021958589553833008 length of segment : 116 time for calcul the mask position with numpy : 0.005069732666015625 nb_pixel_total : 168078 time to create 1 rle with new method : 0.019039630889892578 length of segment : 750 time for calcul the mask position with numpy : 0.0008988380432128906 nb_pixel_total : 15544 time to create 1 rle with old method : 0.02173304557800293 length of segment : 225 time for calcul the mask position with numpy : 0.006006002426147461 nb_pixel_total : 173553 time to create 1 rle with new method : 0.022322654724121094 length of segment : 785 time for calcul the mask position with numpy : 0.0023450851440429688 nb_pixel_total : 48792 time to create 1 rle with old method : 0.05932950973510742 length of segment : 225 time for calcul the mask position with numpy : 0.0015876293182373047 nb_pixel_total : 19722 time to create 1 rle with old method : 0.02476978302001953 length of segment : 369 time for calcul the mask position with numpy : 0.001035928726196289 nb_pixel_total : 18935 time to create 1 rle with old method : 0.02322697639465332 length of segment : 241 time for calcul the mask position with numpy : 0.0019659996032714844 nb_pixel_total : 31258 time to create 1 rle with old method : 0.04450702667236328 length of segment : 271 time for calcul the mask position with numpy : 0.0015294551849365234 nb_pixel_total : 25626 time to create 1 rle with old method : 0.03125739097595215 length of segment : 180 time for calcul the mask position with numpy : 0.0019376277923583984 nb_pixel_total : 46166 time to create 1 rle with old method : 0.05550527572631836 length of segment : 339 time for calcul the mask position with numpy : 0.0033545494079589844 nb_pixel_total : 83926 time to create 1 rle with old method : 0.10460925102233887 length of segment : 401 time for calcul the mask position with numpy : 0.0022814273834228516 nb_pixel_total : 48225 time to create 1 rle with old method : 0.05775284767150879 length of segment : 221 time for calcul the mask position with numpy : 0.006189584732055664 nb_pixel_total : 150215 time to create 1 rle with new method : 0.012318134307861328 length of segment : 550 time for calcul the mask position with numpy : 0.003727436065673828 nb_pixel_total : 59447 time to create 1 rle with old method : 0.07001423835754395 length of segment : 336 time for calcul the mask position with numpy : 0.027495861053466797 nb_pixel_total : 336498 time to create 1 rle with new method : 0.041181325912475586 length of segment : 767 time for calcul the mask position with numpy : 0.0013616085052490234 nb_pixel_total : 25821 time to create 1 rle with old method : 0.03158926963806152 length of segment : 145 time for calcul the mask position with numpy : 0.0007703304290771484 nb_pixel_total : 10584 time to create 1 rle with old method : 0.015381097793579102 length of segment : 89 time for calcul the mask position with numpy : 0.0045964717864990234 nb_pixel_total : 86980 time to create 1 rle with old method : 0.10225129127502441 length of segment : 506 time for calcul the mask position with numpy : 0.002423524856567383 nb_pixel_total : 40963 time to create 1 rle with old method : 0.05185222625732422 length of segment : 316 time for calcul the mask position with numpy : 0.0026466846466064453 nb_pixel_total : 71645 time to create 1 rle with old method : 0.0873262882232666 length of segment : 334 time for calcul the mask position with numpy : 0.0036973953247070312 nb_pixel_total : 80559 time to create 1 rle with old method : 0.09924077987670898 length of segment : 415 time for calcul the mask position with numpy : 0.002061128616333008 nb_pixel_total : 52483 time to create 1 rle with old method : 0.08745789527893066 length of segment : 342 time for calcul the mask position with numpy : 0.007797956466674805 nb_pixel_total : 194127 time to create 1 rle with new method : 0.012976884841918945 length of segment : 1201 time for calcul the mask position with numpy : 0.0011341571807861328 nb_pixel_total : 32591 time to create 1 rle with old method : 0.03984832763671875 length of segment : 231 time for calcul the mask position with numpy : 0.001432180404663086 nb_pixel_total : 42290 time to create 1 rle with old method : 0.054511070251464844 length of segment : 279 time for calcul the mask position with numpy : 0.0015361309051513672 nb_pixel_total : 71485 time to create 1 rle with old method : 0.08541059494018555 length of segment : 199 time for calcul the mask position with numpy : 0.0007102489471435547 nb_pixel_total : 25694 time to create 1 rle with old method : 0.040013790130615234 length of segment : 167 time for calcul the mask position with numpy : 0.0005018711090087891 nb_pixel_total : 14625 time to create 1 rle with old method : 0.025321245193481445 length of segment : 172 time for calcul the mask position with numpy : 0.0022356510162353516 nb_pixel_total : 124108 time to create 1 rle with old method : 0.14528155326843262 length of segment : 283 time for calcul the mask position with numpy : 0.0032875537872314453 nb_pixel_total : 99854 time to create 1 rle with old method : 0.11714935302734375 length of segment : 364 time for calcul the mask position with numpy : 0.00042557716369628906 nb_pixel_total : 13928 time to create 1 rle with old method : 0.016885757446289062 length of segment : 135 time for calcul the mask position with numpy : 0.0005147457122802734 nb_pixel_total : 15326 time to create 1 rle with old method : 0.018772125244140625 length of segment : 164 time for calcul the mask position with numpy : 0.00423121452331543 nb_pixel_total : 204152 time to create 1 rle with new method : 0.010739803314208984 length of segment : 562 time for calcul the mask position with numpy : 0.0028328895568847656 nb_pixel_total : 125044 time to create 1 rle with old method : 0.15235114097595215 length of segment : 390 time for calcul the mask position with numpy : 0.006636857986450195 nb_pixel_total : 273156 time to create 1 rle with new method : 0.023463010787963867 length of segment : 893 time for calcul the mask position with numpy : 0.004185914993286133 nb_pixel_total : 223826 time to create 1 rle with new method : 0.009506940841674805 length of segment : 605 time for calcul the mask position with numpy : 0.0003535747528076172 nb_pixel_total : 19486 time to create 1 rle with old method : 0.02332925796508789 length of segment : 151 time for calcul the mask position with numpy : 0.0012366771697998047 nb_pixel_total : 41404 time to create 1 rle with old method : 0.049902915954589844 length of segment : 254 time for calcul the mask position with numpy : 0.00034618377685546875 nb_pixel_total : 15657 time to create 1 rle with old method : 0.0189974308013916 length of segment : 174 time for calcul the mask position with numpy : 0.0020666122436523438 nb_pixel_total : 66598 time to create 1 rle with old method : 0.08945298194885254 length of segment : 531 time for calcul the mask position with numpy : 0.0005288124084472656 nb_pixel_total : 12238 time to create 1 rle with old method : 0.015119552612304688 length of segment : 136 time for calcul the mask position with numpy : 0.0241243839263916 nb_pixel_total : 423113 time to create 1 rle with new method : 0.031859636306762695 length of segment : 821 time for calcul the mask position with numpy : 0.0007712841033935547 nb_pixel_total : 21122 time to create 1 rle with old method : 0.026195764541625977 length of segment : 275 time for calcul the mask position with numpy : 0.00696563720703125 nb_pixel_total : 270907 time to create 1 rle with new method : 0.37952709197998047 length of segment : 1081 time for calcul the mask position with numpy : 0.0010192394256591797 nb_pixel_total : 33215 time to create 1 rle with old method : 0.038681983947753906 length of segment : 257 time for calcul the mask position with numpy : 0.0007884502410888672 nb_pixel_total : 42726 time to create 1 rle with old method : 0.049988746643066406 length of segment : 333 time for calcul the mask position with numpy : 0.004865169525146484 nb_pixel_total : 272301 time to create 1 rle with new method : 0.012869834899902344 length of segment : 491 time for calcul the mask position with numpy : 0.00038433074951171875 nb_pixel_total : 22250 time to create 1 rle with old method : 0.026785850524902344 length of segment : 125 time for calcul the mask position with numpy : 0.0031523704528808594 nb_pixel_total : 180478 time to create 1 rle with new method : 0.005981922149658203 length of segment : 377 time for calcul the mask position with numpy : 0.0004508495330810547 nb_pixel_total : 11464 time to create 1 rle with old method : 0.013916730880737305 length of segment : 151 time for calcul the mask position with numpy : 0.001058816909790039 nb_pixel_total : 33292 time to create 1 rle with old method : 0.03977680206298828 length of segment : 267 time for calcul the mask position with numpy : 0.0005354881286621094 nb_pixel_total : 11915 time to create 1 rle with old method : 0.014251470565795898 length of segment : 138 time for calcul the mask position with numpy : 0.0074613094329833984 nb_pixel_total : 249807 time to create 1 rle with new method : 0.016887187957763672 length of segment : 997 time for calcul the mask position with numpy : 0.0009250640869140625 nb_pixel_total : 38903 time to create 1 rle with old method : 0.045499324798583984 length of segment : 303 time for calcul the mask position with numpy : 0.003814697265625 nb_pixel_total : 189190 time to create 1 rle with new method : 0.007155418395996094 length of segment : 406 time for calcul the mask position with numpy : 0.008429288864135742 nb_pixel_total : 362337 time to create 1 rle with new method : 0.021169185638427734 length of segment : 655 time for calcul the mask position with numpy : 0.00021338462829589844 nb_pixel_total : 3050 time to create 1 rle with old method : 0.0038423538208007812 length of segment : 177 time for calcul the mask position with numpy : 0.0008349418640136719 nb_pixel_total : 27022 time to create 1 rle with old method : 0.03204226493835449 length of segment : 133 time for calcul the mask position with numpy : 0.001748800277709961 nb_pixel_total : 73457 time to create 1 rle with old method : 0.08496403694152832 length of segment : 591 time for calcul the mask position with numpy : 0.0005218982696533203 nb_pixel_total : 11562 time to create 1 rle with old method : 0.013839006423950195 length of segment : 160 time for calcul the mask position with numpy : 0.00013399124145507812 nb_pixel_total : 1478 time to create 1 rle with old method : 0.0019614696502685547 length of segment : 63 time for calcul the mask position with numpy : 0.023230552673339844 nb_pixel_total : 512852 time to create 1 rle with new method : 0.30037736892700195 length of segment : 877 time for calcul the mask position with numpy : 0.002065420150756836 nb_pixel_total : 59250 time to create 1 rle with old method : 0.06887555122375488 length of segment : 397 time for calcul the mask position with numpy : 0.0009081363677978516 nb_pixel_total : 20657 time to create 1 rle with old method : 0.024404525756835938 length of segment : 262 time for calcul the mask position with numpy : 0.0004622936248779297 nb_pixel_total : 19882 time to create 1 rle with old method : 0.023689746856689453 length of segment : 261 time for calcul the mask position with numpy : 0.0005834102630615234 nb_pixel_total : 16541 time to create 1 rle with old method : 0.020022153854370117 length of segment : 133 time for calcul the mask position with numpy : 0.001270294189453125 nb_pixel_total : 49004 time to create 1 rle with old method : 0.057410478591918945 length of segment : 180 time for calcul the mask position with numpy : 0.05322265625 nb_pixel_total : 583265 time to create 1 rle with new method : 0.047759056091308594 length of segment : 1017 time for calcul the mask position with numpy : 0.0014002323150634766 nb_pixel_total : 62083 time to create 1 rle with old method : 0.07271671295166016 length of segment : 283 time for calcul the mask position with numpy : 0.0003120899200439453 nb_pixel_total : 4460 time to create 1 rle with old method : 0.005949497222900391 length of segment : 109 time for calcul the mask position with numpy : 0.012768983840942383 nb_pixel_total : 616818 time to create 1 rle with new method : 0.03265666961669922 length of segment : 764 time for calcul the mask position with numpy : 0.0006117820739746094 nb_pixel_total : 42473 time to create 1 rle with old method : 0.048934221267700195 length of segment : 275 time for calcul the mask position with numpy : 0.0016503334045410156 nb_pixel_total : 67137 time to create 1 rle with old method : 0.07856535911560059 length of segment : 367 time for calcul the mask position with numpy : 0.0002703666687011719 nb_pixel_total : 12534 time to create 1 rle with old method : 0.015381097793579102 length of segment : 108 time for calcul the mask position with numpy : 0.00022101402282714844 nb_pixel_total : 10825 time to create 1 rle with old method : 0.013106584548950195 length of segment : 112 time spent for convertir_results : 10.215704679489136 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 91 chid ids of type : 3594 Number RLEs to save : 32504 save missing photos in datou_result : time spend for datou_step_exec : 60.39118766784668 time spend to save output : 2.1692428588867188 total time spend for step 1 : 62.5604305267334 step2:crop_condition Wed May 7 18:31:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 91 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 56 About to insert : list_path_to_insert length 56 new photo from crops ! About to upload 56 photos upload in portfolio : 3736932 init cache_photo without model_param we have 56 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746635507_1899923 we have uploaded 56 photos in the portfolio 3736932 time of upload the photos Elapsed time : 14.765949726104736 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746635528_1899923 we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.001267910003662 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 3736932 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746635549_1899923 we have uploaded 18 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.981801986694336 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746635557_1899923 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.006927251815796 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1356661536, 1356661501, 1356661197, 1356661141, 1356661081, 1356661015, 1356660993, 1356659663] Looping around the photos to save general results len do output : 91 /1356788965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356788999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356789076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661536', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661501', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661197', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661141', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661081', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661015', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356660993', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356659663', None, None, None, None, None, '2803618') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 281 time used for this insertion : 0.029097318649291992 save_final save missing photos in datou_result : time spend for datou_step_exec : 66.51794004440308 time spend to save output : 0.03327798843383789 total time spend for step 2 : 66.55121803283691 step3:rle_unique_nms_with_priority Wed May 7 18:32:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 91 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ No data in photo_id : 1356661536 nb_obj : 20 nb_hashtags : 2 time to prepare the origin masks : 6.640512943267822 time for calcul the mask position with numpy : 0.36992454528808594 nb_pixel_total : 5975839 time to create 1 rle with new method : 0.4570446014404297 time for calcul the mask position with numpy : 0.023301362991333008 nb_pixel_total : 173553 time to create 1 rle with new method : 0.6318988800048828 time for calcul the mask position with numpy : 0.021657943725585938 nb_pixel_total : 15544 time to create 1 rle with old method : 0.018147945404052734 time for calcul the mask position with numpy : 0.022321701049804688 nb_pixel_total : 168078 time to create 1 rle with new method : 0.3794724941253662 time for calcul the mask position with numpy : 0.023344755172729492 nb_pixel_total : 17653 time to create 1 rle with old method : 0.020890235900878906 time for calcul the mask position with numpy : 0.022960662841796875 nb_pixel_total : 102593 time to create 1 rle with old method : 0.12019014358520508 time for calcul the mask position with numpy : 0.024112462997436523 nb_pixel_total : 6605 time to create 1 rle with old method : 0.0076444149017333984 time for calcul the mask position with numpy : 0.020528316497802734 nb_pixel_total : 14230 time to create 1 rle with old method : 0.016389131546020508 time for calcul the mask position with numpy : 0.021950483322143555 nb_pixel_total : 112984 time to create 1 rle with old method : 0.12982892990112305 time for calcul the mask position with numpy : 0.026250839233398438 nb_pixel_total : 26426 time to create 1 rle with old method : 0.030266761779785156 time for calcul the mask position with numpy : 0.025568723678588867 nb_pixel_total : 74522 time to create 1 rle with old method : 0.08638429641723633 time for calcul the mask position with numpy : 0.02447032928466797 nb_pixel_total : 10448 time to create 1 rle with old method : 0.0123443603515625 time for calcul the mask position with numpy : 0.03060460090637207 nb_pixel_total : 20721 time to create 1 rle with old method : 0.033608436584472656 time for calcul the mask position with numpy : 0.026292800903320312 nb_pixel_total : 114276 time to create 1 rle with old method : 0.13175630569458008 time for calcul the mask position with numpy : 0.021572113037109375 nb_pixel_total : 15387 time to create 1 rle with old method : 0.01812577247619629 time for calcul the mask position with numpy : 0.02181386947631836 nb_pixel_total : 28394 time to create 1 rle with old method : 0.03302359580993652 time for calcul the mask position with numpy : 0.027904510498046875 nb_pixel_total : 19098 time to create 1 rle with old method : 0.022228479385375977 time for calcul the mask position with numpy : 0.023418426513671875 nb_pixel_total : 70232 time to create 1 rle with old method : 0.08535575866699219 time for calcul the mask position with numpy : 0.022694110870361328 nb_pixel_total : 13377 time to create 1 rle with old method : 0.01565241813659668 time for calcul the mask position with numpy : 0.022435665130615234 nb_pixel_total : 46851 time to create 1 rle with old method : 0.05605363845825195 time for calcul the mask position with numpy : 0.022027969360351562 nb_pixel_total : 23429 time to create 1 rle with old method : 0.02729201316833496 create new chi : 3.256483316421509 time to delete rle : 0.027936220169067383 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 15296 TO DO : save crop sub photo not yet done ! save time : 0.9710578918457031 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 7.7020368576049805 time for calcul the mask position with numpy : 0.38147974014282227 nb_pixel_total : 5864920 time to create 1 rle with new method : 0.32100915908813477 time for calcul the mask position with numpy : 0.0219268798828125 nb_pixel_total : 80559 time to create 1 rle with old method : 0.09437799453735352 time for calcul the mask position with numpy : 0.03083062171936035 nb_pixel_total : 71603 time to create 1 rle with old method : 0.0824735164642334 time for calcul the mask position with numpy : 0.03709244728088379 nb_pixel_total : 40963 time to create 1 rle with old method : 0.046343326568603516 time for calcul the mask position with numpy : 0.03952789306640625 nb_pixel_total : 86980 time to create 1 rle with old method : 0.09963679313659668 time for calcul the mask position with numpy : 0.03556632995605469 nb_pixel_total : 10584 time to create 1 rle with old method : 0.012282371520996094 time for calcul the mask position with numpy : 0.0394589900970459 nb_pixel_total : 25821 time to create 1 rle with old method : 0.030069351196289062 time for calcul the mask position with numpy : 0.03948545455932617 nb_pixel_total : 336498 time to create 1 rle with new method : 0.4793386459350586 time for calcul the mask position with numpy : 0.0351564884185791 nb_pixel_total : 59447 time to create 1 rle with old method : 0.0699617862701416 time for calcul the mask position with numpy : 0.03458380699157715 nb_pixel_total : 150215 time to create 1 rle with new method : 0.30225634574890137 time for calcul the mask position with numpy : 0.02440190315246582 nb_pixel_total : 48225 time to create 1 rle with old method : 0.05494356155395508 time for calcul the mask position with numpy : 0.021390438079833984 nb_pixel_total : 83926 time to create 1 rle with old method : 0.09463119506835938 time for calcul the mask position with numpy : 0.02252936363220215 nb_pixel_total : 46166 time to create 1 rle with old method : 0.05319547653198242 time for calcul the mask position with numpy : 0.02244281768798828 nb_pixel_total : 25626 time to create 1 rle with old method : 0.029885053634643555 time for calcul the mask position with numpy : 0.020966291427612305 nb_pixel_total : 31258 time to create 1 rle with old method : 0.036206960678100586 time for calcul the mask position with numpy : 0.02216029167175293 nb_pixel_total : 18935 time to create 1 rle with old method : 0.021822690963745117 time for calcul the mask position with numpy : 0.021724700927734375 nb_pixel_total : 19722 time to create 1 rle with old method : 0.02276921272277832 time for calcul the mask position with numpy : 0.02176499366760254 nb_pixel_total : 48792 time to create 1 rle with old method : 0.0574345588684082 create new chi : 2.863118886947632 time to delete rle : 0.0017299652099609375 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 13545 TO DO : save crop sub photo not yet done ! save time : 0.9331350326538086 nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 4.951070308685303 time for calcul the mask position with numpy : 0.658531665802002 nb_pixel_total : 6392983 time to create 1 rle with new method : 0.7671186923980713 time for calcul the mask position with numpy : 0.03641533851623535 nb_pixel_total : 99854 time to create 1 rle with old method : 0.11327695846557617 time for calcul the mask position with numpy : 0.035856008529663086 nb_pixel_total : 124108 time to create 1 rle with old method : 0.1433417797088623 time for calcul the mask position with numpy : 0.0393218994140625 nb_pixel_total : 14625 time to create 1 rle with old method : 0.021605253219604492 time for calcul the mask position with numpy : 0.042464494705200195 nb_pixel_total : 25694 time to create 1 rle with old method : 0.03820395469665527 time for calcul the mask position with numpy : 0.037575721740722656 nb_pixel_total : 71485 time to create 1 rle with old method : 0.08432340621948242 time for calcul the mask position with numpy : 0.039151668548583984 nb_pixel_total : 42290 time to create 1 rle with old method : 0.049535512924194336 time for calcul the mask position with numpy : 0.02644181251525879 nb_pixel_total : 32591 time to create 1 rle with old method : 0.04095292091369629 time for calcul the mask position with numpy : 0.045970916748046875 nb_pixel_total : 194127 time to create 1 rle with new method : 0.5116252899169922 time for calcul the mask position with numpy : 0.02922821044921875 nb_pixel_total : 52483 time to create 1 rle with old method : 0.06001615524291992 create new chi : 2.887334108352661 time to delete rle : 0.0018749237060546875 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 8636 TO DO : save crop sub photo not yet done ! save time : 0.6152548789978027 nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 4.512165069580078 time for calcul the mask position with numpy : 0.9778783321380615 nb_pixel_total : 6133511 time to create 1 rle with new method : 0.6730422973632812 time for calcul the mask position with numpy : 0.03536629676818848 nb_pixel_total : 12612 time to create 1 rle with old method : 0.014513015747070312 time for calcul the mask position with numpy : 0.03465986251831055 nb_pixel_total : 41404 time to create 1 rle with old method : 0.04702472686767578 time for calcul the mask position with numpy : 0.034037113189697266 nb_pixel_total : 7281 time to create 1 rle with old method : 0.008355140686035156 time for calcul the mask position with numpy : 0.036870479583740234 nb_pixel_total : 223826 time to create 1 rle with new method : 0.581519603729248 time for calcul the mask position with numpy : 0.036110639572143555 nb_pixel_total : 273156 time to create 1 rle with new method : 0.5000665187835693 time for calcul the mask position with numpy : 0.022233963012695312 nb_pixel_total : 125044 time to create 1 rle with old method : 0.14616036415100098 time for calcul the mask position with numpy : 0.022397994995117188 nb_pixel_total : 204152 time to create 1 rle with new method : 0.5167901515960693 time for calcul the mask position with numpy : 0.02313542366027832 nb_pixel_total : 15326 time to create 1 rle with old method : 0.01718449592590332 time for calcul the mask position with numpy : 0.022856712341308594 nb_pixel_total : 13928 time to create 1 rle with old method : 0.015039443969726562 create new chi : 3.87383770942688 time to delete rle : 0.0018918514251708984 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 8630 TO DO : save crop sub photo not yet done ! save time : 0.5959756374359131 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 3.31921648979187 time for calcul the mask position with numpy : 0.49268174171447754 nb_pixel_total : 5713851 time to create 1 rle with new method : 0.3626401424407959 time for calcul the mask position with numpy : 0.036566972732543945 nb_pixel_total : 11464 time to create 1 rle with old method : 0.01633930206298828 time for calcul the mask position with numpy : 0.02461528778076172 nb_pixel_total : 180478 time to create 1 rle with new method : 0.5783507823944092 time for calcul the mask position with numpy : 0.023797035217285156 nb_pixel_total : 2227 time to create 1 rle with old method : 0.0026993751525878906 time for calcul the mask position with numpy : 0.025000333786010742 nb_pixel_total : 272301 time to create 1 rle with new method : 0.373950719833374 time for calcul the mask position with numpy : 0.022087812423706055 nb_pixel_total : 42726 time to create 1 rle with old method : 0.04891347885131836 time for calcul the mask position with numpy : 0.023019075393676758 nb_pixel_total : 33215 time to create 1 rle with old method : 0.039853572845458984 time for calcul the mask position with numpy : 0.025257349014282227 nb_pixel_total : 270907 time to create 1 rle with new method : 0.45546984672546387 time for calcul the mask position with numpy : 0.02313232421875 nb_pixel_total : 21122 time to create 1 rle with old method : 0.028200149536132812 time for calcul the mask position with numpy : 0.027048826217651367 nb_pixel_total : 423113 time to create 1 rle with new method : 0.36240410804748535 time for calcul the mask position with numpy : 0.021884679794311523 nb_pixel_total : 12238 time to create 1 rle with old method : 0.014347076416015625 time for calcul the mask position with numpy : 0.021471261978149414 nb_pixel_total : 66598 time to create 1 rle with old method : 0.09049367904663086 create new chi : 3.271507501602173 time to delete rle : 0.002068042755126953 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 11108 TO DO : save crop sub photo not yet done ! save time : 0.7253661155700684 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 6.575607538223267 time for calcul the mask position with numpy : 0.43538832664489746 nb_pixel_total : 5486978 time to create 1 rle with new method : 0.9592573642730713 time for calcul the mask position with numpy : 0.022853612899780273 nb_pixel_total : 326 time to create 1 rle with old method : 0.0005092620849609375 time for calcul the mask position with numpy : 0.022416353225708008 nb_pixel_total : 20657 time to create 1 rle with old method : 0.024194955825805664 time for calcul the mask position with numpy : 0.022661924362182617 nb_pixel_total : 59250 time to create 1 rle with old method : 0.06879043579101562 time for calcul the mask position with numpy : 0.025514841079711914 nb_pixel_total : 484355 time to create 1 rle with new method : 1.0705854892730713 time for calcul the mask position with numpy : 0.023659944534301758 nb_pixel_total : 126 time to create 1 rle with old method : 0.0002148151397705078 time for calcul the mask position with numpy : 0.023257970809936523 nb_pixel_total : 11562 time to create 1 rle with old method : 0.01602625846862793 time for calcul the mask position with numpy : 0.02324819564819336 nb_pixel_total : 73457 time to create 1 rle with old method : 0.10053372383117676 time for calcul the mask position with numpy : 0.02444934844970703 nb_pixel_total : 27022 time to create 1 rle with old method : 0.03651905059814453 time for calcul the mask position with numpy : 0.024427175521850586 nb_pixel_total : 1063 time to create 1 rle with old method : 0.0012965202331542969 time for calcul the mask position with numpy : 0.026679515838623047 nb_pixel_total : 362337 time to create 1 rle with new method : 0.6558222770690918 time for calcul the mask position with numpy : 0.03718233108520508 nb_pixel_total : 189190 time to create 1 rle with new method : 1.005234718322754 time for calcul the mask position with numpy : 0.03354334831237793 nb_pixel_total : 38903 time to create 1 rle with old method : 0.045185089111328125 time for calcul the mask position with numpy : 0.02391529083251953 nb_pixel_total : 249807 time to create 1 rle with new method : 0.5565991401672363 time for calcul the mask position with numpy : 0.021716833114624023 nb_pixel_total : 11915 time to create 1 rle with old method : 0.013811826705932617 time for calcul the mask position with numpy : 0.022342920303344727 nb_pixel_total : 33292 time to create 1 rle with old method : 0.03813362121582031 create new chi : 5.544639587402344 time to delete rle : 0.001865386962890625 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 12875 TO DO : save crop sub photo not yet done ! save time : 0.8487043380737305 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 3.82800030708313 time for calcul the mask position with numpy : 0.3950846195220947 nb_pixel_total : 5636816 time to create 1 rle with new method : 0.9802272319793701 time for calcul the mask position with numpy : 0.022928237915039062 nb_pixel_total : 5696 time to create 1 rle with old method : 0.0068476200103759766 time for calcul the mask position with numpy : 0.04167318344116211 nb_pixel_total : 2798 time to create 1 rle with old method : 0.00419306755065918 time for calcul the mask position with numpy : 0.03847980499267578 nb_pixel_total : 67137 time to create 1 rle with old method : 0.0972282886505127 time for calcul the mask position with numpy : 0.026608705520629883 nb_pixel_total : 5622 time to create 1 rle with old method : 0.008214235305786133 time for calcul the mask position with numpy : 0.03144097328186035 nb_pixel_total : 616818 time to create 1 rle with new method : 0.8698623180389404 time for calcul the mask position with numpy : 0.02222585678100586 nb_pixel_total : 4460 time to create 1 rle with old method : 0.005262851715087891 time for calcul the mask position with numpy : 0.022909164428710938 nb_pixel_total : 62083 time to create 1 rle with old method : 0.07215261459350586 time for calcul the mask position with numpy : 0.02578115463256836 nb_pixel_total : 583265 time to create 1 rle with new method : 0.41640353202819824 time for calcul the mask position with numpy : 0.024733304977416992 nb_pixel_total : 49004 time to create 1 rle with old method : 0.05766868591308594 time for calcul the mask position with numpy : 0.025803565979003906 nb_pixel_total : 16541 time to create 1 rle with old method : 0.022136688232421875 create new chi : 3.3131704330444336 time to delete rle : 0.0015397071838378906 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 8229 TO DO : save crop sub photo not yet done ! save time : 0.562809944152832 map_output_result : {1356661536: (0.0, 'Should be the crop_list due to order', 0.0), 1356661501: (0.0, 'Should be the crop_list due to order', 0), 1356661197: (0.0, 'Should be the crop_list due to order', 0), 1356661141: (0.0, 'Should be the crop_list due to order', 0), 1356661081: (0.0, 'Should be the crop_list due to order', 0), 1356661015: (0.0, 'Should be the crop_list due to order', 0), 1356660993: (0.0, 'Should be the crop_list due to order', 0), 1356659663: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1356661536, 1356661501, 1356661197, 1356661141, 1356661081, 1356661015, 1356660993, 1356659663] Looping around the photos to save general results len do output : 8 /1356661536.Didn't retrieve data . /1356661501.Didn't retrieve data . /1356661197.Didn't retrieve data . /1356661141.Didn't retrieve data . /1356661081.Didn't retrieve data . /1356661015.Didn't retrieve data . /1356660993.Didn't retrieve data . /1356659663.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661536', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661501', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661197', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661141', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661081', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661015', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356660993', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356659663', None, None, None, None, None, '2803618') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.016890287399291992 save_final save missing photos in datou_result : time spend for datou_step_exec : 68.80804944038391 time spend to save output : 0.017399311065673828 total time spend for step 3 : 68.82544875144958 step4:ventilate_hashtags_in_portfolio Wed May 7 18:33:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22773755 get user id for portfolio 22773755 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22773755 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','autre','pet_clair','papier','metal','environnement','background','mal_croppe','pehd','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22773755 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','autre','pet_clair','papier','metal','environnement','background','mal_croppe','pehd','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22773755 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','autre','pet_clair','papier','metal','environnement','background','mal_croppe','pehd','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22779998,22779999,22780000,22780001,22780002,22780003,22780004,22780005,22780006,22780007,22780008?tags=flou,autre,pet_clair,papier,metal,environnement,background,mal_croppe,pehd,carton,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1356661536, 1356661501, 1356661197, 1356661141, 1356661081, 1356661015, 1356660993, 1356659663] Looping around the photos to save general results len do output : 1 /22773755. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661536', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661501', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661197', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661141', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661081', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661015', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356660993', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356659663', None, None, None, None, None, '2803618') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01418614387512207 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5486526489257812 time spend to save output : 0.014401674270629883 total time spend for step 4 : 1.5630543231964111 step5:final Wed May 7 18:33:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1356661536: ('0.14444157220179737',), 1356661501: ('0.14444157220179737',), 1356661197: ('0.14444157220179737',), 1356661141: ('0.14444157220179737',), 1356661081: ('0.14444157220179737',), 1356661015: ('0.14444157220179737',), 1356660993: ('0.14444157220179737',), 1356659663: ('0.14444157220179737',)} new output for save of step final : {1356661536: ('0.14444157220179737',), 1356661501: ('0.14444157220179737',), 1356661197: ('0.14444157220179737',), 1356661141: ('0.14444157220179737',), 1356661081: ('0.14444157220179737',), 1356661015: ('0.14444157220179737',), 1356660993: ('0.14444157220179737',), 1356659663: ('0.14444157220179737',)} [1356661536, 1356661501, 1356661197, 1356661141, 1356661081, 1356661015, 1356660993, 1356659663] Looping around the photos to save general results len do output : 8 /1356661536.Didn't retrieve data . /1356661501.Didn't retrieve data . /1356661197.Didn't retrieve data . /1356661141.Didn't retrieve data . /1356661081.Didn't retrieve data . /1356661015.Didn't retrieve data . /1356660993.Didn't retrieve data . /1356659663.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661536', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661501', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661197', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661141', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661081', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661015', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356660993', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356659663', None, None, None, None, None, '2803618') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.015306949615478516 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10625839233398438 time spend to save output : 0.015700101852416992 total time spend for step 5 : 0.12195849418640137 step6:blur_detection Wed May 7 18:33:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1746635427_1899923_1356661536_e3157957c1774537862ed26dae9d557d.jpg resize: (2160, 3264) 1356661536 -1.6963187305618164 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd.jpg resize: (2160, 3264) 1356661501 0.7521688095495855 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575.jpg resize: (2160, 3264) 1356661197 -0.6090261767456006 treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a.jpg resize: (2160, 3264) 1356661141 2.4480134753536733 treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5.jpg resize: (2160, 3264) 1356661081 -0.05924601945269364 treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec.jpg resize: (2160, 3264) 1356661015 0.44049726419714075 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa.jpg resize: (2160, 3264) 1356660993 -4.0983764616631175 treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c.jpg resize: (2160, 3264) 1356659663 -1.3100941019244075 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048177_0.png resize: (192, 237) 1356788965 -0.6479421870280464 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048178_0.png resize: (265, 245) 1356788966 -1.5562523474875611 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048180_0.png resize: (430, 219) 1356788967 -0.4067556910181779 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048181_0.png resize: (191, 178) 1356788968 -1.4388571104795593 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048182_0.png resize: (156, 274) 1356788969 -0.130528460725566 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048184_0.png resize: (534, 398) 1356788970 -1.23363634543023 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048185_0.png resize: (313, 93) 1356788971 -1.6240900370850997 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048186_0.png resize: (121, 125) 1356788972 -2.558660407084645 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048188_0.png resize: (114, 271) 1356788973 -0.0019121420053809437 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048189_0.png resize: (356, 441) 1356788974 0.12047893089359783 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048191_0.png resize: (76, 127) 1356788975 -1.1292690811176767 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048192_0.png resize: (603, 294) 1356788976 -1.6350283982962548 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048194_0.png resize: (748, 388) 1356788977 -1.122089869306752 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048195_0.png resize: (220, 105) 1356788978 -2.356041027157573 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048197_0.png resize: (212, 318) 1356788979 -0.9331244156855651 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048198_0.png resize: (315, 157) 1356788980 -2.4345194097243192 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048199_0.png resize: (223, 162) 1356788981 -1.5519979558925363 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048200_0.png resize: (271, 204) 1356788982 -1.8529064944969773 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048202_0.png resize: (321, 186) 1356788983 -0.948099166536784 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048206_0.png resize: (336, 363) 1356788984 0.7992549762119238 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048208_0.png resize: (142, 282) 1356788985 -0.6150132889944628 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048209_0.png resize: (88, 180) 1356788986 -1.253952586266781 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048211_0.png resize: (219, 324) 1356788987 -2.4136074743643463 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048212_0.png resize: (312, 299) 1356788988 -1.219653532781136 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048213_0.png resize: (355, 337) 1356788989 -1.73799360299147 treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048214_0.png resize: (342, 225) 1356788990 -1.426215619172029 treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048217_0.png resize: (279, 203) 1356788991 -1.556908115799879 treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048220_0.png resize: (172, 155) 1356788992 -1.8202122773759906 treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048221_0.png resize: (278, 552) 1356788993 0.01836608173940828 treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048222_0.png resize: (363, 398) 1356788994 0.6173145519538052 treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048223_0.png resize: (134, 157) 1356788995 -1.5441944209689547 treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048224_0.png resize: (161, 162) 1356788996 -0.2848852888376905 treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048225_0.png resize: (533, 580) 1356788997 0.33863083375586267 treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048227_0.png resize: (893, 492) 1356788998 0.12309294784411726 treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048229_0.png resize: (145, 171) 1356788999 0.3335368964748648 treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048231_0.png resize: (172, 193) 1356789001 -0.043370468007000305 treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048232_0.png resize: (523, 163) 1356789003 -1.0877673998844164 treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048233_0.png resize: (136, 154) 1356789004 -1.4557848406877734 treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048236_0.png resize: (1022, 459) 1356789005 -0.34781839556803656 treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048237_0.png resize: (247, 222) 1356789006 -0.9734510260450377 treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048238_0.png resize: (332, 175) 1356789007 -0.7947604148018261 treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048242_0.png resize: (151, 133) 1356789008 0.626857097156582 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048243_0.png resize: (255, 221) 1356789009 -5.296143589998038 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048244_0.png resize: (138, 150) 1356789010 -3.485219354717125 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048245_0.png resize: (960, 435) 1356789011 -3.05320405425228 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048246_0.png resize: (300, 181) 1356789012 -1.0889253703504402 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048249_0.png resize: (143, 89) 1356789013 -2.8054525563413972 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048251_0.png resize: (514, 196) 1356789014 -2.1378161059625227 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048252_0.png resize: (160, 135) 1356789015 -2.8758528480487486 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048253_0.png resize: (53, 54) 1356789016 -2.009362634189533 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048257_0.png resize: (261, 96) 1356789017 -1.1075618225448327 treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048258_0.png resize: (133, 191) 1356789018 -0.8491748197451257 treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048259_0.png resize: (162, 465) 1356789019 0.5806484790410321 treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048262_0.png resize: (109, 54) 1356789020 -1.3497264531212192 treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048264_0.png resize: (275, 239) 1356789021 -0.884241914950754 treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048267_0.png resize: (84, 187) 1356789022 -2.2157564365243414 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048179_0.png resize: (134, 143) 1356789025 -0.4646666528170967 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048183_0.png resize: (153, 170) 1356789026 -2.0891549010169963 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048187_0.png resize: (421, 264) 1356789027 -2.5172530640786794 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048190_0.png resize: (154, 175) 1356789028 -1.8664389643452812 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048193_0.png resize: (115, 206) 1356789029 -1.40850442517751 treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048196_0.png resize: (784, 419) 1356789030 -0.2673565252083066 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048201_0.png resize: (170, 234) 1356789031 -1.19798290872906 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048203_0.png resize: (361, 306) 1356789032 -0.8236243429329438 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048205_0.png resize: (478, 467) 1356789033 -1.068990373885053 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048210_0.png resize: (499, 315) 1356789034 -0.7673333746206713 treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048235_0.png resize: (263, 102) 1356789035 -0.5085221599657105 treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048239_0.png resize: (491, 729) 1356789036 -0.40604569447242594 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048256_0.png resize: (262, 100) 1356789037 -1.0518381475770928 treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048261_0.png resize: (265, 273) 1356789038 -0.6758705020929145 treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048266_0.png resize: (106, 156) 1356789039 -0.6224096341754883 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048204_0.png resize: (217, 297) 1356789055 -2.6308199254731552 treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048207_0.png resize: (625, 765) 1356789056 -1.3873813292038684 treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048215_0.png resize: (953, 296) 1356789057 -1.428463419782019 treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048216_0.png resize: (231, 202) 1356789058 -0.19033215629204453 treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048218_0.png resize: (196, 487) 1356789059 0.7764944560027847 treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048219_0.png resize: (160, 233) 1356789060 -1.452919612465017 treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048226_0.png resize: (355, 396) 1356789061 -0.8022139814155673 treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048228_0.png resize: (571, 553) 1356789062 -0.3442635775806158 treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048230_0.png resize: (254, 273) 1356789063 -4.05744952603009 treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048234_0.png resize: (763, 700) 1356789064 -1.1938296279386964 treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048240_0.png resize: (120, 260) 1356789065 -2.724985538095071 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048248_0.png resize: (584, 816) 1356789066 -4.216398047383467 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048250_0.png resize: (133, 287) 1356789067 -4.042761150511263 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048254_0.png resize: (873, 672) 1356789068 -1.8193732407200993 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048255_0.png resize: (396, 252) 1356789069 -3.5492405920386596 treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048260_0.png resize: (990, 875) 1356789070 -1.1832054636123446 treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048263_0.png resize: (704, 978) 1356789071 -3.7774297619612978 treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048265_0.png resize: (367, 222) 1356789072 -0.42143657625239933 treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048241_0.png resize: (368, 520) 1356789075 1.6084436294806783 treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048247_0.png resize: (398, 540) 1356789076 -0.9962035527693514 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 99 time used for this insertion : 0.02179408073425293 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 99 time used for this insertion : 0.019231319427490234 save missing photos in datou_result : time spend for datou_step_exec : 33.53200054168701 time spend to save output : 0.045679569244384766 total time spend for step 6 : 33.5776801109314 step7:brightness Wed May 7 18:34:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746635427_1899923_1356661536_e3157957c1774537862ed26dae9d557d.jpg treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd.jpg treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575.jpg treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a.jpg treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5.jpg treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec.jpg treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa.jpg treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c.jpg treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048177_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048178_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048180_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048181_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048182_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048184_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048185_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048186_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048188_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048189_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048191_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048192_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048194_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048195_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048197_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048198_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048199_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048200_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048202_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048206_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048208_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048209_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048211_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048212_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048213_0.png treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048214_0.png treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048217_0.png treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048220_0.png treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048221_0.png treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048222_0.png treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048223_0.png treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048224_0.png treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048225_0.png treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048227_0.png treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048229_0.png treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048231_0.png treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048232_0.png treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048233_0.png treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048236_0.png treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048237_0.png treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048238_0.png treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048242_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048243_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048244_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048245_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048246_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048249_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048251_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048252_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048253_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048257_0.png treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048258_0.png treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048259_0.png treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048262_0.png treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048264_0.png treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048267_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048179_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048183_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048187_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048190_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048193_0.png treat image : temp/1746635427_1899923_1356661501_a26d04ba67b5083d95750459f5c7dbcd_rle_crop_3789048196_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048201_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048203_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048205_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048210_0.png treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048235_0.png treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048239_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048256_0.png treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048261_0.png treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048266_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048204_0.png treat image : temp/1746635427_1899923_1356661197_f3cd8a44baae2a6543ee9b653c8a9575_rle_crop_3789048207_0.png treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048215_0.png treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048216_0.png treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048218_0.png treat image : temp/1746635427_1899923_1356661141_681a4fc4e7c2467f4eeb753c9f4abb8a_rle_crop_3789048219_0.png treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048226_0.png treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048228_0.png treat image : temp/1746635427_1899923_1356661081_09e35cdbfa9d6f8ee0c009df65e86ef5_rle_crop_3789048230_0.png treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048234_0.png treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048240_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048248_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048250_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048254_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048255_0.png treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048260_0.png treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048263_0.png treat image : temp/1746635427_1899923_1356659663_46e1ee1349bc351d036bb4ae933de80c_rle_crop_3789048265_0.png treat image : temp/1746635427_1899923_1356661015_d124d688b046c89186d8f2836a7653ec_rle_crop_3789048241_0.png treat image : temp/1746635427_1899923_1356660993_d7dac706c7a25ea22bf0c86f30541faa_rle_crop_3789048247_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 99 time used for this insertion : 0.015471458435058594 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 99 time used for this insertion : 0.01810431480407715 save missing photos in datou_result : time spend for datou_step_exec : 9.005546808242798 time spend to save output : 0.03814387321472168 total time spend for step 7 : 9.04369068145752 step8:velours_tree Wed May 7 18:34:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.15351295471191406 time spend to save output : 3.886222839355469e-05 total time spend for step 8 : 0.15355181694030762 step9:send_mail_cod Wed May 7 18:34:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22773755_07-05-2025_18_34_31.pdf 22779998 imagette227799981746635671 22779999 change filename to text .change filename to text .imagette227799991746635671 22780000 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227800001746635671 22780001 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227800011746635673 22780002 imagette227800021746635675 22780004 imagette227800041746635675 22780005 imagette227800051746635675 22780006 imagette227800061746635675 22780007 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette227800071746635675 22780008 imagette227800081746635676 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22773755 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22779998,22779999,22780000,22780001,22780002,22780003,22780004,22780005,22780006,22780007,22780008?tags=flou,autre,pet_clair,papier,metal,environnement,background,mal_croppe,pehd,carton,pet_fonce args[1356661536] : ((1356661536, -1.6963187305618164, 492688767), (1356661536, 0.3710147930426829, 2107752395), '0.14444157220179737') We are sending mail with results at report@fotonower.com args[1356661501] : ((1356661501, 0.7521688095495855, 492688767), (1356661501, -0.11253322026232965, 496442774), '0.14444157220179737') We are sending mail with results at report@fotonower.com args[1356661197] : ((1356661197, -0.6090261767456006, 492688767), (1356661197, -0.014238566923759107, 2107752395), '0.14444157220179737') We are sending mail with results at report@fotonower.com args[1356661141] : ((1356661141, 2.4480134753536733, 492688767), (1356661141, -0.10525448589210025, 496442774), '0.14444157220179737') We are sending mail with results at report@fotonower.com args[1356661081] : ((1356661081, -0.05924601945269364, 492688767), (1356661081, 0.20523140305567605, 2107752395), '0.14444157220179737') We are sending mail with results at report@fotonower.com args[1356661015] : ((1356661015, 0.44049726419714075, 492688767), (1356661015, 0.46576055823764817, 2107752395), '0.14444157220179737') We are sending mail with results at report@fotonower.com args[1356660993] : ((1356660993, -4.0983764616631175, 492609224), (1356660993, 0.4980224210580019, 2107752395), '0.14444157220179737') We are sending mail with results at report@fotonower.com args[1356659663] : ((1356659663, -1.3100941019244075, 492688767), (1356659663, 0.5342512477182246, 2107752395), '0.14444157220179737') We are sending mail with results at report@fotonower.com refus_total : 0.14444157220179737 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22773755 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22773755_07-05-2025_18_34_31.pdf results_Auto_P22773755_07-05-2025_18_34_31.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22773755_07-05-2025_18_34_31.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22773755','results_Auto_P22773755_07-05-2025_18_34_31.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22773755_07-05-2025_18_34_31.pdf','pdf','','0.86','0.14444157220179737') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22773755

https://www.fotonower.com/image?json=false&list_photos_id=1356661536
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356661501
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356661197
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356661141
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.4480134753536733)
https://www.fotonower.com/image?json=false&list_photos_id=1356661081
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356661015
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356660993
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356659663
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 14.44%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/22779999?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22780000?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22780001?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22780007?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22773755_07-05-2025_18_34_31.pdf.

Lien vers velours :https://www.fotonower.com/velours/22779998,22779999,22780000,22780001,22780002,22780003,22780004,22780005,22780006,22780007,22780008?tags=flou,autre,pet_clair,papier,metal,environnement,background,mal_croppe,pehd,carton,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 07 May 2025 16:34:38 GMT Content-Length: 0 Connection: close X-Message-Id: 3-gkqlMuR8O_l5NuIBbs9w Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1356661536, 1356661501, 1356661197, 1356661141, 1356661081, 1356661015, 1356660993, 1356659663] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661536', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661501', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661197', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661141', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661081', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661015', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356660993', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356659663', None, None, None, None, None, '2803618') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.016368627548217773 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.522100210189819 time spend to save output : 0.016698122024536133 total time spend for step 9 : 7.5387983322143555 step10:split_time_score Wed May 7 18:34:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 07052025 22773755 Nombre de photos uploadées : 8 / 23040 (0%) 07052025 22773755 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 07052025 22773755 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 6.67572021484375e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0004901885986328125 elapsed_time : insert_dashboard_record_day_entry 0.026016950607299805 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.11345237892610745 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22755885_07-05-2025_08_15_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22755885 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22755885 AND mptpi.`type`=3594 To do Qualite : 0.13392497985884166 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22758212_07-05-2025_09_15_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22758212 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22758212 AND mptpi.`type`=3594 To do Qualite : 0.04687108504624727 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22758941_07-05-2025_09_41_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22758941 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22758941 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22773719 order by id desc limit 1 Qualite : 0.13204628494916487 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22773739_07-05-2025_16_37_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22773739 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22773739 AND mptpi.`type`=3594 To do Qualite : 0.15027050906723088 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22773740_07-05-2025_17_38_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22773740 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22773740 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22773749 order by id desc limit 1 Qualite : 0.14444157220179737 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22773755_07-05-2025_18_34_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22773755 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22773755 AND mptpi.`type`=3594 To do Qualite : 0.1801751977040387 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22773756_07-05-2025_16_36_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22773756 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22773756 AND mptpi.`type`=3726 To do Qualite : 0.03329469809169341 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22773759_07-05-2025_16_12_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22773759 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22773759 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'07052025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1356661536, 1356661501, 1356661197, 1356661141, 1356661081, 1356661015, 1356660993, 1356659663] Looping around the photos to save general results len do output : 1 /22773755Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661536', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661501', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661197', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661141', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661081', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356661015', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356660993', None, None, None, None, None, '2803618') ('3318', None, None, None, None, None, None, None, '2803618') ('3318', '22773755', '1356659663', None, None, None, None, None, '2803618') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014122724533081055 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.3495709896087646 time spend to save output : 0.014357328414916992 total time spend for step 10 : 2.3639283180236816 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 116.34user 103.56system 4:16.62elapsed 85%CPU (0avgtext+0avgdata 4498380maxresident)k 761176inputs+86048outputs (5384major+9588521minor)pagefaults 0swaps