python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 ~/workarea/git/Velours/python/prod/memo/memo.py --job=sla_per_day --raspi=20084 --dashboard_places=dechet_Valcor_v2 --last_days 7 -u_s' -s sla_RUBBIA -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 20084, Date : _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_RUBBIA TODO : Insert select and so on ***** analysis of device with port 20084 for dashboard dechet_Valcor_v2 ***** **** analysis of day 2025/04/26/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! 0:00:00 apple pause between two photos 10 Find filename in sqlite. Info from logs total number of images : 8519 coverage for 10 seconds : 23:04:19 (96.13%) coverage for 20 seconds : 23:43:55 (98.88%) max time between two photos : 0:01:20 results of pre-diagnostic : light ok 8519, not duplicated 7474, two criteria ok 7474, nb forced upload 0 end of day status of photos as found in sqllite duplicated : 1045 nothing_done : 13 ok_for_neural_classification : 7461 Unable to find info for dashboard number 132 for day 2025-04-26 06:36:28.345041 Info from dashboard total number of uploaded images : 0 number of useful images : 7474 number of finished photos : 0 (0.00% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 0 (0.00% of two criteria ok) **** analysis of day 2025/04/27/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! 0:00:00 apple pause between two photos 10 Find filename in sqlite. Info from logs total number of images : 8520 coverage for 10 seconds : 23:07:40 (96.37%) coverage for 20 seconds : 23:44:10 (98.90%) max time between two photos : 0:01:21 results of pre-diagnostic : light ok 8532, not duplicated 6681, two criteria ok 6681, nb forced upload 0 end of day status of photos as found in sqllite duplicated : 1848 nothing_done : 7 ok_for_neural_classification : 6665 Unable to find info for dashboard number 132 for day 2025-04-27 06:36:28.345041 Info from dashboard total number of uploaded images : 0 number of useful images : 6681 number of finished photos : 0 (0.00% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 0 (0.00% of two criteria ok) **** analysis of day 2025/04/28/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! 0:00:00 apple pause between two photos 10 Find filename in sqlite. Info from logs total number of images : 8543 coverage for 10 seconds : 23:10:34 (96.57%) coverage for 20 seconds : 23:48:00 (99.17%) max time between two photos : 0:01:20 results of pre-diagnostic : light ok 8549, not duplicated 7009, two criteria ok 7009, nb forced upload 0 end of day status of photos as found in sqllite duplicated : 1537 nothing_done : 7 ok_for_neural_classification : 2523 uploaded : 4476 Info from dashboard total number of uploaded images : 4554 number of useful images : 7009 number of finished photos : 776 (11.07% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 0 (0.00% of two criteria ok) number of finished batches : 99 (100.00% of total) number of finished batches for older algorithm : 0 (0.00% of total) number of started batches : 0 (0.00% of total) last update : 2025-04-29 06:01:49 **** analysis of day 2025/04/29/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! 0:00:00 apple pause between two photos 10 Find filename in sqlite. Info from logs total number of images : 8526 coverage for 10 seconds : 23:03:56 (96.11%) coverage for 20 seconds : 23:44:18 (98.91%) max time between two photos : 0:01:21 results of pre-diagnostic : light ok 8538, not duplicated 7389, two criteria ok 7389, nb forced upload 0 end of day status of photos as found in sqllite duplicated : 1138 nothing_done : 1 ok_for_neural_classification : 307 uploaded : 7080 Info from dashboard total number of uploaded images : 7200 number of useful images : 7389 number of finished photos : 2189 (29.63% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 25 (0.34% of two criteria ok) number of finished batches : 275 (99.64% of total) number of finished batches for older algorithm : 0 (0.00% of total) number of started batches : 1 (0.36% of total) last update : 2025-04-30 06:24:52 **** analysis of day 2025/04/30/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! 0:00:00 apple pause between two photos 10 Find filename in sqlite. Info from logs total number of images : 8502 coverage for 10 seconds : 22:58:57 (95.76%) coverage for 20 seconds : 23:41:09 (98.69%) max time between two photos : 0:01:21 results of pre-diagnostic : light ok 8508, not duplicated 7610, two criteria ok 7610, nb forced upload 0 end of day status of photos as found in sqllite duplicated : 896 nothing_done : 7 ok_for_neural_classification : 543 uploaded : 7056 Info from dashboard total number of uploaded images : 7182 number of useful images : 7610 number of finished photos : 2019 (26.53% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 0 (0.00% of two criteria ok) number of finished batches : 256 (100.00% of total) number of finished batches for older algorithm : 0 (0.00% of total) number of started batches : 0 (0.00% of total) last update : 2025-05-01 06:01:29 **** analysis of day 2025/05/01/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! 0:00:00 apple pause between two photos 10 Find filename in sqlite. Info from logs total number of images : 8526 coverage for 10 seconds : 23:05:14 (96.20%) coverage for 20 seconds : 23:45:03 (98.96%) max time between two photos : 0:01:21 results of pre-diagnostic : light ok 8532, not duplicated 7610, two criteria ok 7610, nb forced upload 0 end of day status of photos as found in sqllite duplicated : 922 nothing_done : 7 ok_for_neural_classification : 523 uploaded : 7074 Info from dashboard total number of uploaded images : 7200 number of useful images : 7610 number of finished photos : 0 (0.00% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 6 (0.08% of two criteria ok) number of finished batches : 0 (0.00% of total) number of finished batches for older algorithm : 0 (0.00% of total) number of started batches : 3 (100.00% of total) last update : 2025-05-02 09:01:21 **** analysis of day 2025/05/02/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! 0:00:00 apple pause between two photos 10 Find filename in sqlite. Info from logs total number of images : 8508 coverage for 10 seconds : 23:01:46 (95.96%) coverage for 20 seconds : 23:42:10 (98.76%) max time between two photos : 0:01:21 results of pre-diagnostic : light ok 8526, not duplicated 7558, two criteria ok 7558, nb forced upload 0 end of day status of photos as found in sqllite duplicated : 963 nothing_done : 1 ok_for_neural_classification : 488 uploaded : 7056 Info from dashboard total number of uploaded images : 7182 number of useful images : 7558 number of finished photos : 1045 (13.83% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 6 (0.08% of two criteria ok) number of finished batches : 133 (97.79% of total) number of finished batches for older algorithm : 0 (0.00% of total) number of started batches : 3 (2.21% of total) last update : 2025-05-02 20:47:13 **** analysis for all days **** Info from logs total number of images : 59644 coverage for 10 seconds : 6 days, 17:32:26 (96.16%) coverage for 20 seconds : 6 days, 22:08:45 (98.90%) max time between two photos : 0:09:25 results of pre-diagnostic : light ok 59704, not duplicated 51331, two criteria ok 51331, nb forced upload 0 end of day status of photos as found in sqllite duplicated : 8349 nothing_done : 43 ok_for_neural_classification : 18510 uploaded : 32742 Info from dashboard total number of uploaded images : 33318 number of useful images : 51331 number of finished photos : 6029 (11.75% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 37 (0.07% of two criteria ok) number of finished batches : 763 (99.09% of total) number of finished batches for older algorithm : 0 (0.00% of total) number of started batches : 7 (0.91% of total) last update : 2025-05-02 20:47:13 You can launch datou with following url to update dashboard https://www.fotonower.com/api/v1/datou/current/set?mtr_portfolio_id=22483834,22578975,22589093&mtr_datou_id=4311 cvs resume : date,nb_photos,% time,nb ok,uploaded,to upload, % uploaded, nb useful, % completed photos, last_update, remark 2025/04/26,8519,96.13%,7474,0,7461,0.00%,0,0.00%,0000/00/00, 2025/04/27,8520,96.37%,6681,0,6665,0.00%,0,0.00%,0000/00/00, 2025/04/28,8543,96.57%,7009,4476,2523,63.95%,776,100.00%,2025/04/29, 2025/04/29,8526,96.11%,7389,7080,307,95.84%,2214,98.87%,2025/04/30, 2025/04/30,8502,95.76%,7610,7056,543,92.85%,2019,100.00%,2025/05/01, 2025/05/01,8526,96.20%,7610,7074,523,93.12%,6,0.00%,2025/05/02, 2025/05/02,8508,95.96%,7558,7056,488,93.53%,1051,99.43%,2025/05/02, coverage for this period for every 10 second 2025/04/26/ 0.9613421451637172 2025/04/27/ 0.963668560978715 2025/04/28/ 0.9656824731767729 2025/04/29/ 0.9610759383789165 2025/04/30/ 0.9576152501765067 2025/05/01/ 0.961978726605632 2025/05/02/ 0.9615620551163787 mean value for this period : 0.961846449942377 coverage for this period for every 20 second 2025/04/26/ 0.9888424634544382 2025/04/27/ 0.9890160765749604 2025/04/28/ 0.9916781444229679 2025/04/29/ 0.9891086702392389 2025/04/30/ 0.9869211449206589 2025/05/01/ 0.9896295096008055 2025/05/02/ 0.9889747401176932 mean value for this period : 0.9891672499043949 2.80user 1.12system 0:14.25elapsed 27%CPU (0avgtext+0avgdata 196824maxresident)k 280408inputs+96outputs (7major+104872minor)pagefaults 0swaps