python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=20084 --dashboard_places=dechet_Valcor_v2 --rootfolder_sla=/data_2/data_log/job/memo/dechet_Valcor_v2 -v --mtr_id=1055 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 20084, Date : 2025-03 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (5, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (5, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 132 month : 03 mtr_id : 1055 dashboard_places : dechet_Valcor_v2 date : 2025-03 year : 2025 raspi : 20084 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'dechet_Valcor_v2' and date like '%2025-03%') and created_at like '%2025-03%'))); nb_day : (5, 31) after unwanted_material_data nb_day : (5, 31) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%20084%' AND ms.result_str like '%2025/03%'ORDER BY ms.id desc LIMIT 0, 1000000; No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82943 seconds', 'coverage_times_pause': '0 days 85327 seconds', 'nb_photos_decision': 8508, 'nb_gray_level_ok': 8508, 'nb_dedup_ok': 7442, 'nb_two_criteria_ok': 7442, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1065, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 284, 'end_of_day_photos_uploaded': 7146, 'ratio_coverage': 0.9599995370316786}, 'dashboard_dict': {'nb_ptf_finished': 80, 'nb_images_finished': 390, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 390, 'last_update': '2025/03/23', 'portfolio_id': 21604540, 'last_run_id': 1689848, 'total_number_of_photos': 7562}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83640 seconds', 'coverage_times_pause': '0 days 85743 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 8166, 'nb_two_criteria_ok': 8166, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 390, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1103, 'end_of_day_photos_uploaded': 7050, 'ratio_coverage': 0.9680667600319448}, 'dashboard_dict': {'nb_ptf_finished': 214, 'nb_images_finished': 1602, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1602, 'last_update': '2025/03/22', 'portfolio_id': 21565481, 'last_run_id': 1688457, 'total_number_of_photos': 8297}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83232 seconds', 'coverage_times_pause': '0 days 85630 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7266, 'nb_two_criteria_ok': 7266, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1277, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 252, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9633444831537402}, 'dashboard_dict': {'nb_ptf_finished': 236, 'nb_images_finished': 2778, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2778, 'last_update': '2025/03/22', 'portfolio_id': 21478122, 'last_run_id': 1688652, 'total_number_of_photos': 7399}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83018 seconds', 'coverage_times_pause': '0 days 85630 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 7741, 'nb_two_criteria_ok': 7741, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 809, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 654, 'end_of_day_photos_uploaded': 7068, 'ratio_coverage': 0.9608676026342897}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/18', 'portfolio_id': 21472836, 'last_run_id': 1681931, 'total_number_of_photos': 7860}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83640 seconds', 'coverage_times_pause': '0 days 85743 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 8166, 'nb_two_criteria_ok': 8166, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 390, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1103, 'end_of_day_photos_uploaded': 7050, 'ratio_coverage': 0.9680667600319448}, 'dashboard_dict': {'nb_ptf_finished': 214, 'nb_images_finished': 1602, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1602, 'last_update': '2025/03/22', 'portfolio_id': 21565481, 'last_run_id': 1688457, 'total_number_of_photos': 7668}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7693, 'nb_two_criteria_ok': 7693, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 187, 'nb_images_finished': 1684, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1684, 'last_update': '2025/03/21', 'portfolio_id': 21528677, 'last_run_id': 1685350, 'total_number_of_photos': 7827}} No error ? {'log_dict': {'total_nb_images': 8534, 'max_time_between_images': '0 days 109 seconds', 'coverage_pause': '0 days 83609 seconds', 'coverage_times_pause': '0 days 85599 seconds', 'nb_photos_decision': 8552, 'nb_gray_level_ok': 8552, 'nb_dedup_ok': 7289, 'nb_two_criteria_ok': 7289, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1257, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 232, 'end_of_day_photos_uploaded': 7044, 'ratio_coverage': 0.9677079595828656}, 'dashboard_dict': {'nb_ptf_finished': 165, 'nb_images_finished': 1258, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1258, 'last_update': '2025/03/20', 'portfolio_id': 21507714, 'last_run_id': 1684345, 'total_number_of_photos': 7414}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83232 seconds', 'coverage_times_pause': '0 days 85630 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7266, 'nb_two_criteria_ok': 7266, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1277, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 252, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9633444831537402}, 'dashboard_dict': {'nb_ptf_finished': 236, 'nb_images_finished': 2778, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2778, 'last_update': '2025/03/21', 'portfolio_id': 21478122, 'last_run_id': 1685351, 'total_number_of_photos': 7399}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83045 seconds', 'coverage_times_pause': '0 days 85451 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7534, 'nb_two_criteria_ok': 7534, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 988, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 517, 'end_of_day_photos_uploaded': 7008, 'ratio_coverage': 0.9611801062512297}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 276, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 276, 'last_update': '2025/03/17', 'portfolio_id': 21461138, 'last_run_id': 1680584, 'total_number_of_photos': 7670}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83443 seconds', 'coverage_times_pause': '0 days 85632 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 8214, 'nb_two_criteria_ok': 8214, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 336, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 2261, 'end_of_day_photos_uploaded': 5934, 'ratio_coverage': 0.9657866410490862}, 'dashboard_dict': {'nb_ptf_finished': 105, 'nb_images_finished': 997, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 30, 'nb_images_started': 292, 'nb_selected_images': 1289, 'last_update': '2025/03/21', 'portfolio_id': 21549525, 'last_run_id': 1685176, 'total_number_of_photos': 7422}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7693, 'nb_two_criteria_ok': 7693, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 187, 'nb_images_finished': 1684, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1684, 'last_update': '2025/03/20', 'portfolio_id': 21528677, 'last_run_id': 1684280, 'total_number_of_photos': 7827}} No error ? {'log_dict': {'total_nb_images': 8534, 'max_time_between_images': '0 days 109 seconds', 'coverage_pause': '0 days 83609 seconds', 'coverage_times_pause': '0 days 85599 seconds', 'nb_photos_decision': 8552, 'nb_gray_level_ok': 8552, 'nb_dedup_ok': 7289, 'nb_two_criteria_ok': 7289, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1257, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 232, 'end_of_day_photos_uploaded': 7044, 'ratio_coverage': 0.9677079595828656}, 'dashboard_dict': {'nb_ptf_finished': 165, 'nb_images_finished': 1258, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1258, 'last_update': '2025/03/20', 'portfolio_id': 21507714, 'last_run_id': 1684345, 'total_number_of_photos': 7414}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83232 seconds', 'coverage_times_pause': '0 days 85630 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7266, 'nb_two_criteria_ok': 7266, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1277, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 252, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9633444831537402}, 'dashboard_dict': {'nb_ptf_finished': 236, 'nb_images_finished': 2778, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2778, 'last_update': '2025/03/20', 'portfolio_id': 21478122, 'last_run_id': 1684350, 'total_number_of_photos': 7399}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83018 seconds', 'coverage_times_pause': '0 days 85630 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 7741, 'nb_two_criteria_ok': 7741, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 809, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 654, 'end_of_day_photos_uploaded': 7068, 'ratio_coverage': 0.9608676026342897}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/18', 'portfolio_id': 21472836, 'last_run_id': 1681931, 'total_number_of_photos': 7860}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83045 seconds', 'coverage_times_pause': '0 days 85451 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7534, 'nb_two_criteria_ok': 7534, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 988, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 517, 'end_of_day_photos_uploaded': 7008, 'ratio_coverage': 0.9611801062512297}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 276, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 276, 'last_update': '2025/03/17', 'portfolio_id': 21461138, 'last_run_id': 1680584, 'total_number_of_photos': 7670}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83682 seconds', 'coverage_times_pause': '0 days 85535 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7893, 'nb_two_criteria_ok': 7893, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 645, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1274, 'end_of_day_photos_uploaded': 6606, 'ratio_coverage': 0.968552876769407}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1300, 'last_update': '2025/03/16', 'portfolio_id': 21406569, 'last_run_id': 1679947, 'total_number_of_photos': 8017}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7693, 'nb_two_criteria_ok': 7693, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 187, 'nb_images_finished': 1684, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1684, 'last_update': '2025/03/20', 'portfolio_id': 21528677, 'last_run_id': 1684280, 'total_number_of_photos': 7814}} No error ? {'log_dict': {'total_nb_images': 8534, 'max_time_between_images': '0 days 109 seconds', 'coverage_pause': '0 days 83609 seconds', 'coverage_times_pause': '0 days 85599 seconds', 'nb_photos_decision': 8552, 'nb_gray_level_ok': 8552, 'nb_dedup_ok': 7289, 'nb_two_criteria_ok': 7289, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1257, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 232, 'end_of_day_photos_uploaded': 7044, 'ratio_coverage': 0.9677079595828656}, 'dashboard_dict': {'nb_ptf_finished': 165, 'nb_images_finished': 1258, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1258, 'last_update': '2025/03/19', 'portfolio_id': 21507714, 'last_run_id': 1683055, 'total_number_of_photos': 7414}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83232 seconds', 'coverage_times_pause': '0 days 85630 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7266, 'nb_two_criteria_ok': 7266, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1277, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 252, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9633444831537402}, 'dashboard_dict': {'nb_ptf_finished': 236, 'nb_images_finished': 2778, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2778, 'last_update': '2025/03/19', 'portfolio_id': 21478122, 'last_run_id': 1683127, 'total_number_of_photos': 7399}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83018 seconds', 'coverage_times_pause': '0 days 85630 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 7741, 'nb_two_criteria_ok': 7741, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 809, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 654, 'end_of_day_photos_uploaded': 7068, 'ratio_coverage': 0.9608676026342897}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/18', 'portfolio_id': 21472836, 'last_run_id': 1681931, 'total_number_of_photos': 7860}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83045 seconds', 'coverage_times_pause': '0 days 85451 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7534, 'nb_two_criteria_ok': 7534, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 988, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 517, 'end_of_day_photos_uploaded': 7008, 'ratio_coverage': 0.9611801062512297}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 276, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 276, 'last_update': '2025/03/17', 'portfolio_id': 21461138, 'last_run_id': 1680584, 'total_number_of_photos': 7670}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83682 seconds', 'coverage_times_pause': '0 days 85535 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7893, 'nb_two_criteria_ok': 7893, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 645, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1274, 'end_of_day_photos_uploaded': 6606, 'ratio_coverage': 0.968552876769407}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1300, 'last_update': '2025/03/16', 'portfolio_id': 21406569, 'last_run_id': 1679947, 'total_number_of_photos': 8017}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83578 seconds', 'coverage_times_pause': '0 days 85564 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7733, 'nb_two_criteria_ok': 7733, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 809, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 696, 'end_of_day_photos_uploaded': 7020, 'ratio_coverage': 0.9673491591337863}, 'dashboard_dict': {'nb_ptf_finished': 204, 'nb_images_finished': 1463, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1463, 'last_update': '2025/03/16', 'portfolio_id': 21371910, 'last_run_id': 1679949, 'total_number_of_photos': 7861}} No error ? {'log_dict': {'total_nb_images': 8534, 'max_time_between_images': '0 days 109 seconds', 'coverage_pause': '0 days 83609 seconds', 'coverage_times_pause': '0 days 85599 seconds', 'nb_photos_decision': 8552, 'nb_gray_level_ok': 8552, 'nb_dedup_ok': 7289, 'nb_two_criteria_ok': 7289, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1257, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 232, 'end_of_day_photos_uploaded': 7044, 'ratio_coverage': 0.9677079595828656}, 'dashboard_dict': {'nb_ptf_finished': 165, 'nb_images_finished': 1258, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1258, 'last_update': '2025/03/19', 'portfolio_id': 21507714, 'last_run_id': 1683055, 'total_number_of_photos': 7408}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83232 seconds', 'coverage_times_pause': '0 days 85630 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7266, 'nb_two_criteria_ok': 7266, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1277, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 252, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9633444831537402}, 'dashboard_dict': {'nb_ptf_finished': 236, 'nb_images_finished': 2778, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2778, 'last_update': '2025/03/18', 'portfolio_id': 21478122, 'last_run_id': 1681878, 'total_number_of_photos': 7399}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83018 seconds', 'coverage_times_pause': '0 days 85630 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 7741, 'nb_two_criteria_ok': 7741, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 809, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 654, 'end_of_day_photos_uploaded': 7068, 'ratio_coverage': 0.9608676026342897}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/18', 'portfolio_id': 21472836, 'last_run_id': 1681931, 'total_number_of_photos': 7860}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83045 seconds', 'coverage_times_pause': '0 days 85451 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7534, 'nb_two_criteria_ok': 7534, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 988, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 517, 'end_of_day_photos_uploaded': 7008, 'ratio_coverage': 0.9611801062512297}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 276, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 276, 'last_update': '2025/03/17', 'portfolio_id': 21461138, 'last_run_id': 1680584, 'total_number_of_photos': 7670}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83682 seconds', 'coverage_times_pause': '0 days 85535 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7893, 'nb_two_criteria_ok': 7893, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 645, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1274, 'end_of_day_photos_uploaded': 6606, 'ratio_coverage': 0.968552876769407}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1300, 'last_update': '2025/03/16', 'portfolio_id': 21406569, 'last_run_id': 1679947, 'total_number_of_photos': 8017}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83578 seconds', 'coverage_times_pause': '0 days 85564 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7733, 'nb_two_criteria_ok': 7733, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 809, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 696, 'end_of_day_photos_uploaded': 7020, 'ratio_coverage': 0.9673491591337863}, 'dashboard_dict': {'nb_ptf_finished': 204, 'nb_images_finished': 1463, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1463, 'last_update': '2025/03/16', 'portfolio_id': 21371910, 'last_run_id': 1679949, 'total_number_of_photos': 7861}} No error ? {'log_dict': {'total_nb_images': 8515, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85400 seconds', 'nb_photos_decision': 8525, 'nb_gray_level_ok': 8525, 'nb_dedup_ok': 7701, 'nb_two_criteria_ok': 7701, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 822, 'end_of_day_photos_nothing_done': 8, 'end_of_day_photos_ok_for_neural_classification': 1258, 'end_of_day_photos_uploaded': 6426, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1965, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1965, 'last_update': '2025/03/13', 'portfolio_id': 21326843, 'last_run_id': 1672936, 'total_number_of_photos': 7906}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83232 seconds', 'coverage_times_pause': '0 days 85630 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7266, 'nb_two_criteria_ok': 7266, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1277, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 252, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9633444831537402}, 'dashboard_dict': {'nb_ptf_finished': 236, 'nb_images_finished': 2778, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2778, 'last_update': '2025/03/18', 'portfolio_id': 21478122, 'last_run_id': 1681878, 'total_number_of_photos': 7392}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83018 seconds', 'coverage_times_pause': '0 days 85630 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 7741, 'nb_two_criteria_ok': 7741, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 809, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 654, 'end_of_day_photos_uploaded': 7068, 'ratio_coverage': 0.9608676026342897}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/17', 'portfolio_id': 21472836, 'last_run_id': 1680250, 'total_number_of_photos': 7860}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83045 seconds', 'coverage_times_pause': '0 days 85451 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7534, 'nb_two_criteria_ok': 7534, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 988, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 517, 'end_of_day_photos_uploaded': 7008, 'ratio_coverage': 0.9611801062512297}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 276, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 276, 'last_update': '2025/03/17', 'portfolio_id': 21461138, 'last_run_id': 1680584, 'total_number_of_photos': 7670}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83682 seconds', 'coverage_times_pause': '0 days 85535 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7893, 'nb_two_criteria_ok': 7893, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 645, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1274, 'end_of_day_photos_uploaded': 6606, 'ratio_coverage': 0.968552876769407}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1300, 'last_update': '2025/03/16', 'portfolio_id': 21406569, 'last_run_id': 1679947, 'total_number_of_photos': 8017}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7733, 'nb_two_criteria_ok': 7733, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 204, 'nb_images_finished': 1463, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1463, 'last_update': '2025/03/16', 'portfolio_id': 21371910, 'last_run_id': 1679949, 'total_number_of_photos': 7861}} No error ? {'log_dict': {'total_nb_images': 8515, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85400 seconds', 'nb_photos_decision': 8525, 'nb_gray_level_ok': 8525, 'nb_dedup_ok': 7701, 'nb_two_criteria_ok': 7701, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 822, 'end_of_day_photos_nothing_done': 8, 'end_of_day_photos_ok_for_neural_classification': 1258, 'end_of_day_photos_uploaded': 6426, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1965, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1965, 'last_update': '2025/03/13', 'portfolio_id': 21326843, 'last_run_id': 1672936, 'total_number_of_photos': 7906}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83359 seconds', 'coverage_times_pause': '0 days 85565 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7324, 'nb_two_criteria_ok': 7324, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1213, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 310, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9648144075741617}, 'dashboard_dict': {'nb_ptf_finished': 115, 'nb_images_finished': 1065, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1065, 'last_update': '2025/03/13', 'portfolio_id': 21255643, 'last_run_id': 1673156, 'total_number_of_photos': 7455}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83018 seconds', 'coverage_times_pause': '0 days 85630 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 7741, 'nb_two_criteria_ok': 7741, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 809, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 654, 'end_of_day_photos_uploaded': 7068, 'ratio_coverage': 0.9608676026342897}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/17', 'portfolio_id': 21472836, 'last_run_id': 1680250, 'total_number_of_photos': 7854}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83045 seconds', 'coverage_times_pause': '0 days 85451 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7534, 'nb_two_criteria_ok': 7534, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 988, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 517, 'end_of_day_photos_uploaded': 7008, 'ratio_coverage': 0.9611801062512297}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 276, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 276, 'last_update': '2025/03/16', 'portfolio_id': 21461138, 'last_run_id': 1679923, 'total_number_of_photos': 7670}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83682 seconds', 'coverage_times_pause': '0 days 85535 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7893, 'nb_two_criteria_ok': 7893, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 645, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1274, 'end_of_day_photos_uploaded': 6606, 'ratio_coverage': 0.968552876769407}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1300, 'last_update': '2025/03/16', 'portfolio_id': 21406569, 'last_run_id': 1679947, 'total_number_of_photos': 8017}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83578 seconds', 'coverage_times_pause': '0 days 85564 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7733, 'nb_two_criteria_ok': 7733, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 809, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 696, 'end_of_day_photos_uploaded': 7020, 'ratio_coverage': 0.9673491591337863}, 'dashboard_dict': {'nb_ptf_finished': 204, 'nb_images_finished': 1463, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1463, 'last_update': '2025/03/16', 'portfolio_id': 21371910, 'last_run_id': 1679949, 'total_number_of_photos': 7861}} No error ? {'log_dict': {'total_nb_images': 8515, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85400 seconds', 'nb_photos_decision': 8525, 'nb_gray_level_ok': 8525, 'nb_dedup_ok': 7701, 'nb_two_criteria_ok': 7701, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 822, 'end_of_day_photos_nothing_done': 8, 'end_of_day_photos_ok_for_neural_classification': 1258, 'end_of_day_photos_uploaded': 6426, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1965, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1965, 'last_update': '2025/03/13', 'portfolio_id': 21326843, 'last_run_id': 1672936, 'total_number_of_photos': 7906}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7324, 'nb_two_criteria_ok': 7324, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 115, 'nb_images_finished': 1065, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1065, 'last_update': '2025/03/13', 'portfolio_id': 21255643, 'last_run_id': 1673156, 'total_number_of_photos': 7455}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83186 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7497, 'nb_two_criteria_ok': 7497, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1047, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 494, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9628120695841387}, 'dashboard_dict': {'nb_ptf_finished': 176, 'nb_images_finished': 999, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 2, 'nb_selected_images': 1001, 'last_update': '2025/03/12', 'portfolio_id': 21218632, 'last_run_id': 1669585, 'total_number_of_photos': 7622}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83045 seconds', 'coverage_times_pause': '0 days 85451 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7534, 'nb_two_criteria_ok': 7534, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 988, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 517, 'end_of_day_photos_uploaded': 7008, 'ratio_coverage': 0.9611801062512297}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 276, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 276, 'last_update': '2025/03/16', 'portfolio_id': 21461138, 'last_run_id': 1679923, 'total_number_of_photos': 7657}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83682 seconds', 'coverage_times_pause': '0 days 85535 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7893, 'nb_two_criteria_ok': 7893, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 645, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1274, 'end_of_day_photos_uploaded': 6606, 'ratio_coverage': 0.968552876769407}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1300, 'last_update': '2025/03/15', 'portfolio_id': 21406569, 'last_run_id': 1678845, 'total_number_of_photos': 8017}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83578 seconds', 'coverage_times_pause': '0 days 85564 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7733, 'nb_two_criteria_ok': 7733, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 809, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 696, 'end_of_day_photos_uploaded': 7020, 'ratio_coverage': 0.9673491591337863}, 'dashboard_dict': {'nb_ptf_finished': 204, 'nb_images_finished': 1463, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1463, 'last_update': '2025/03/14', 'portfolio_id': 21371910, 'last_run_id': 1675393, 'total_number_of_photos': 7861}} No error ? {'log_dict': {'total_nb_images': 8515, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85400 seconds', 'nb_photos_decision': 8525, 'nb_gray_level_ok': 8525, 'nb_dedup_ok': 7701, 'nb_two_criteria_ok': 7701, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 822, 'end_of_day_photos_nothing_done': 8, 'end_of_day_photos_ok_for_neural_classification': 1258, 'end_of_day_photos_uploaded': 6426, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1965, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1965, 'last_update': '2025/03/13', 'portfolio_id': 21326843, 'last_run_id': 1672936, 'total_number_of_photos': 7906}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7324, 'nb_two_criteria_ok': 7324, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 115, 'nb_images_finished': 1065, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1065, 'last_update': '2025/03/13', 'portfolio_id': 21255643, 'last_run_id': 1673156, 'total_number_of_photos': 7455}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83186 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7497, 'nb_two_criteria_ok': 7497, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1047, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 494, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9628120695841387}, 'dashboard_dict': {'nb_ptf_finished': 176, 'nb_images_finished': 999, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 2, 'nb_selected_images': 1001, 'last_update': '2025/03/12', 'portfolio_id': 21218632, 'last_run_id': 1669585, 'total_number_of_photos': 7622}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83241 seconds', 'coverage_times_pause': '0 days 85449 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7228, 'nb_two_criteria_ok': 7228, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 12, 'end_of_day_photos_duplicated': 1293, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 212, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9634486510260536}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 206, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 206, 'last_update': '2025/03/11', 'portfolio_id': 21198295, 'last_run_id': 1665447, 'total_number_of_photos': 7353}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83682 seconds', 'coverage_times_pause': '0 days 85535 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7893, 'nb_two_criteria_ok': 7893, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 645, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1274, 'end_of_day_photos_uploaded': 6606, 'ratio_coverage': 0.968552876769407}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1300, 'last_update': '2025/03/15', 'portfolio_id': 21406569, 'last_run_id': 1678845, 'total_number_of_photos': 8012}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83578 seconds', 'coverage_times_pause': '0 days 85564 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7733, 'nb_two_criteria_ok': 7733, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 809, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 696, 'end_of_day_photos_uploaded': 7020, 'ratio_coverage': 0.9673491591337863}, 'dashboard_dict': {'nb_ptf_finished': 204, 'nb_images_finished': 1463, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1463, 'last_update': '2025/03/14', 'portfolio_id': 21371910, 'last_run_id': 1675393, 'total_number_of_photos': 7861}} No error ? {'log_dict': {'total_nb_images': 8515, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85400 seconds', 'nb_photos_decision': 8525, 'nb_gray_level_ok': 8525, 'nb_dedup_ok': 7701, 'nb_two_criteria_ok': 7701, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 822, 'end_of_day_photos_nothing_done': 8, 'end_of_day_photos_ok_for_neural_classification': 1258, 'end_of_day_photos_uploaded': 6426, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1965, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1965, 'last_update': '2025/03/13', 'portfolio_id': 21326843, 'last_run_id': 1672936, 'total_number_of_photos': 7906}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83359 seconds', 'coverage_times_pause': '0 days 85565 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7324, 'nb_two_criteria_ok': 7324, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1213, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 310, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9648144075741617}, 'dashboard_dict': {'nb_ptf_finished': 115, 'nb_images_finished': 1065, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1065, 'last_update': '2025/03/13', 'portfolio_id': 21255643, 'last_run_id': 1673156, 'total_number_of_photos': 7455}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83186 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7497, 'nb_two_criteria_ok': 7497, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1047, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 494, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9628120695841387}, 'dashboard_dict': {'nb_ptf_finished': 176, 'nb_images_finished': 999, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 2, 'nb_selected_images': 1001, 'last_update': '2025/03/12', 'portfolio_id': 21218632, 'last_run_id': 1669585, 'total_number_of_photos': 7622}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83241 seconds', 'coverage_times_pause': '0 days 85449 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7228, 'nb_two_criteria_ok': 7228, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 12, 'end_of_day_photos_duplicated': 1293, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 212, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9634486510260536}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 206, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 206, 'last_update': '2025/03/11', 'portfolio_id': 21198295, 'last_run_id': 1665447, 'total_number_of_photos': 7353}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83396 seconds', 'coverage_times_pause': '0 days 85628 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 6882, 'nb_two_criteria_ok': 6882, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1668, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 6864, 'ratio_coverage': 0.9652426532714499}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 421, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 421, 'last_update': '2025/03/10', 'portfolio_id': 21167974, 'last_run_id': 1662481, 'total_number_of_photos': 6989}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83578 seconds', 'coverage_times_pause': '0 days 85564 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7733, 'nb_two_criteria_ok': 7733, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 809, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 696, 'end_of_day_photos_uploaded': 7020, 'ratio_coverage': 0.9673491591337863}, 'dashboard_dict': {'nb_ptf_finished': 204, 'nb_images_finished': 1463, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1463, 'last_update': '2025/03/14', 'portfolio_id': 21371910, 'last_run_id': 1675393, 'total_number_of_photos': 7854}} No error ? {'log_dict': {'total_nb_images': 8515, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85400 seconds', 'nb_photos_decision': 8525, 'nb_gray_level_ok': 8525, 'nb_dedup_ok': 7701, 'nb_two_criteria_ok': 7701, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 822, 'end_of_day_photos_nothing_done': 8, 'end_of_day_photos_ok_for_neural_classification': 1258, 'end_of_day_photos_uploaded': 6426, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1965, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1965, 'last_update': '2025/03/13', 'portfolio_id': 21326843, 'last_run_id': 1672936, 'total_number_of_photos': 7906}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83359 seconds', 'coverage_times_pause': '0 days 85565 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7324, 'nb_two_criteria_ok': 7324, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1213, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 310, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9648144075741617}, 'dashboard_dict': {'nb_ptf_finished': 115, 'nb_images_finished': 1065, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1065, 'last_update': '2025/03/13', 'portfolio_id': 21255643, 'last_run_id': 1673156, 'total_number_of_photos': 7455}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83186 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7497, 'nb_two_criteria_ok': 7497, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1047, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 494, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9628120695841387}, 'dashboard_dict': {'nb_ptf_finished': 176, 'nb_images_finished': 999, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 2, 'nb_selected_images': 1001, 'last_update': '2025/03/12', 'portfolio_id': 21218632, 'last_run_id': 1669585, 'total_number_of_photos': 7622}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83241 seconds', 'coverage_times_pause': '0 days 85449 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7228, 'nb_two_criteria_ok': 7228, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 12, 'end_of_day_photos_duplicated': 1293, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 212, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9634486510260536}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 206, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 206, 'last_update': '2025/03/11', 'portfolio_id': 21198295, 'last_run_id': 1665447, 'total_number_of_photos': 7353}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83396 seconds', 'coverage_times_pause': '0 days 85628 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 6882, 'nb_two_criteria_ok': 6882, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1668, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 6864, 'ratio_coverage': 0.9652426532714499}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 421, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 421, 'last_update': '2025/03/10', 'portfolio_id': 21167974, 'last_run_id': 1662481, 'total_number_of_photos': 6989}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83678 seconds', 'coverage_times_pause': '0 days 85690 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7456, 'nb_two_criteria_ok': 7456, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1086, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 425, 'end_of_day_photos_uploaded': 7020, 'ratio_coverage': 0.9685065799372677}, 'dashboard_dict': {'nb_ptf_finished': 76, 'nb_images_finished': 457, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 457, 'last_update': '2025/03/09', 'portfolio_id': 21133882, 'last_run_id': 1660787, 'total_number_of_photos': 7590}} No error ? {'log_dict': {'total_nb_images': 8515, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85400 seconds', 'nb_photos_decision': 8525, 'nb_gray_level_ok': 8525, 'nb_dedup_ok': 7701, 'nb_two_criteria_ok': 7701, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 822, 'end_of_day_photos_nothing_done': 8, 'end_of_day_photos_ok_for_neural_classification': 1258, 'end_of_day_photos_uploaded': 6426, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 189, 'nb_images_finished': 1965, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1965, 'last_update': '2025/03/13', 'portfolio_id': 21326843, 'last_run_id': 1672574, 'total_number_of_photos': 7894}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83359 seconds', 'coverage_times_pause': '0 days 85565 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7324, 'nb_two_criteria_ok': 7324, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1213, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 310, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9648144075741617}, 'dashboard_dict': {'nb_ptf_finished': 115, 'nb_images_finished': 1065, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1065, 'last_update': '2025/03/12', 'portfolio_id': 21255643, 'last_run_id': 1669223, 'total_number_of_photos': 7455}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83186 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7497, 'nb_two_criteria_ok': 7497, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1047, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 494, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9628120695841387}, 'dashboard_dict': {'nb_ptf_finished': 176, 'nb_images_finished': 999, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 2, 'nb_selected_images': 1001, 'last_update': '2025/03/12', 'portfolio_id': 21218632, 'last_run_id': 1669585, 'total_number_of_photos': 7622}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83241 seconds', 'coverage_times_pause': '0 days 85449 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7228, 'nb_two_criteria_ok': 7228, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 12, 'end_of_day_photos_duplicated': 1293, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 212, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9634486510260536}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 206, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 206, 'last_update': '2025/03/11', 'portfolio_id': 21198295, 'last_run_id': 1665447, 'total_number_of_photos': 7353}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 6882, 'nb_two_criteria_ok': 6882, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 421, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 421, 'last_update': '2025/03/10', 'portfolio_id': 21167974, 'last_run_id': 1662481, 'total_number_of_photos': 6989}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83678 seconds', 'coverage_times_pause': '0 days 85690 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7456, 'nb_two_criteria_ok': 7456, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1086, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 425, 'end_of_day_photos_uploaded': 7020, 'ratio_coverage': 0.9685065799372677}, 'dashboard_dict': {'nb_ptf_finished': 76, 'nb_images_finished': 457, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 457, 'last_update': '2025/03/09', 'portfolio_id': 21133882, 'last_run_id': 1660787, 'total_number_of_photos': 7590}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83446 seconds', 'coverage_times_pause': '0 days 85326 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7404, 'nb_two_criteria_ok': 7404, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1110, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1367, 'end_of_day_photos_uploaded': 6024, 'ratio_coverage': 0.9658213636731907}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 354, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 42, 'nb_images_started': 241, 'nb_selected_images': 595, 'last_update': '2025/03/09', 'portfolio_id': 21097211, 'last_run_id': 1658107, 'total_number_of_photos': 7516}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83359 seconds', 'coverage_times_pause': '0 days 85565 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7324, 'nb_two_criteria_ok': 7324, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1213, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 310, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9648144075741617}, 'dashboard_dict': {'nb_ptf_finished': 115, 'nb_images_finished': 1065, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1065, 'last_update': '2025/03/12', 'portfolio_id': 21255643, 'last_run_id': 1669223, 'total_number_of_photos': 7444}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83186 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7497, 'nb_two_criteria_ok': 7497, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1047, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 494, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9628120695841387}, 'dashboard_dict': {'nb_ptf_finished': 61, 'nb_images_finished': 293, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 116, 'nb_images_started': 708, 'nb_selected_images': 1001, 'last_update': '2025/03/11', 'portfolio_id': 21218632, 'last_run_id': 1665466, 'total_number_of_photos': 7622}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83241 seconds', 'coverage_times_pause': '0 days 85449 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7228, 'nb_two_criteria_ok': 7228, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 12, 'end_of_day_photos_duplicated': 1293, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 212, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9634486510260536}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 206, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 206, 'last_update': '2025/03/11', 'portfolio_id': 21198295, 'last_run_id': 1665447, 'total_number_of_photos': 7353}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83396 seconds', 'coverage_times_pause': '0 days 85628 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 6882, 'nb_two_criteria_ok': 6882, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1668, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 6864, 'ratio_coverage': 0.9652426532714499}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 421, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 421, 'last_update': '2025/03/10', 'portfolio_id': 21167974, 'last_run_id': 1662481, 'total_number_of_photos': 6989}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83678 seconds', 'coverage_times_pause': '0 days 85690 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7456, 'nb_two_criteria_ok': 7456, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1086, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 425, 'end_of_day_photos_uploaded': 7020, 'ratio_coverage': 0.9685065799372677}, 'dashboard_dict': {'nb_ptf_finished': 76, 'nb_images_finished': 457, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 457, 'last_update': '2025/03/09', 'portfolio_id': 21133882, 'last_run_id': 1660787, 'total_number_of_photos': 7590}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83446 seconds', 'coverage_times_pause': '0 days 85326 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7404, 'nb_two_criteria_ok': 7404, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1110, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1367, 'end_of_day_photos_uploaded': 6024, 'ratio_coverage': 0.9658213636731907}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 354, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 42, 'nb_images_started': 241, 'nb_selected_images': 595, 'last_update': '2025/03/09', 'portfolio_id': 21097211, 'last_run_id': 1658107, 'total_number_of_photos': 7516}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83599 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7083, 'nb_two_criteria_ok': 7083, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1457, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 48, 'end_of_day_photos_uploaded': 7026, 'ratio_coverage': 0.9675922175025173}, 'dashboard_dict': {'nb_ptf_finished': 84, 'nb_images_finished': 787, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 9, 'nb_selected_images': 796, 'last_update': '2025/03/09', 'portfolio_id': 21041872, 'last_run_id': 1658113, 'total_number_of_photos': 7213}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83186 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7497, 'nb_two_criteria_ok': 7497, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1047, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 494, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9628120695841387}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 251, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 122, 'nb_images_started': 750, 'nb_selected_images': 1001, 'last_update': '2025/03/11', 'portfolio_id': 21218632, 'last_run_id': 1664611, 'total_number_of_photos': 7616}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83241 seconds', 'coverage_times_pause': '0 days 85449 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7228, 'nb_two_criteria_ok': 7228, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 12, 'end_of_day_photos_duplicated': 1293, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 212, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9634486510260536}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 206, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 206, 'last_update': '2025/03/10', 'portfolio_id': 21198295, 'last_run_id': 1662235, 'total_number_of_photos': 7353}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83396 seconds', 'coverage_times_pause': '0 days 85628 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 6882, 'nb_two_criteria_ok': 6882, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1668, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 6864, 'ratio_coverage': 0.9652426532714499}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 421, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 421, 'last_update': '2025/03/10', 'portfolio_id': 21167974, 'last_run_id': 1662481, 'total_number_of_photos': 6989}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83678 seconds', 'coverage_times_pause': '0 days 85690 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7456, 'nb_two_criteria_ok': 7456, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1086, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 425, 'end_of_day_photos_uploaded': 7020, 'ratio_coverage': 0.9685065799372677}, 'dashboard_dict': {'nb_ptf_finished': 76, 'nb_images_finished': 457, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 457, 'last_update': '2025/03/09', 'portfolio_id': 21133882, 'last_run_id': 1660787, 'total_number_of_photos': 7590}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83446 seconds', 'coverage_times_pause': '0 days 85326 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7404, 'nb_two_criteria_ok': 7404, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1110, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1367, 'end_of_day_photos_uploaded': 6024, 'ratio_coverage': 0.9658213636731907}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 354, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 42, 'nb_images_started': 241, 'nb_selected_images': 595, 'last_update': '2025/03/09', 'portfolio_id': 21097211, 'last_run_id': 1658107, 'total_number_of_photos': 7516}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83599 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7083, 'nb_two_criteria_ok': 7083, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1457, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 48, 'end_of_day_photos_uploaded': 7026, 'ratio_coverage': 0.9675922175025173}, 'dashboard_dict': {'nb_ptf_finished': 84, 'nb_images_finished': 787, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 9, 'nb_selected_images': 796, 'last_update': '2025/03/09', 'portfolio_id': 21041872, 'last_run_id': 1658113, 'total_number_of_photos': 7213}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83115 seconds', 'coverage_times_pause': '0 days 85569 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7269, 'nb_two_criteria_ok': 7269, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1272, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 209, 'end_of_day_photos_uploaded': 7050, 'ratio_coverage': 0.9619903008136669}, 'dashboard_dict': {'nb_ptf_finished': 81, 'nb_images_finished': 815, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 70, 'nb_ptf_started': 3, 'nb_images_started': 20, 'nb_selected_images': 905, 'last_update': '2025/03/09', 'portfolio_id': 20997635, 'last_run_id': 1651777, 'total_number_of_photos': 7396}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83241 seconds', 'coverage_times_pause': '0 days 85449 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7228, 'nb_two_criteria_ok': 7228, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 12, 'end_of_day_photos_duplicated': 1293, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 212, 'end_of_day_photos_uploaded': 7002, 'ratio_coverage': 0.9634486510260536}, 'dashboard_dict': {'nb_ptf_finished': 21, 'nb_images_finished': 206, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 206, 'last_update': '2025/03/10', 'portfolio_id': 21198295, 'last_run_id': 1662235, 'total_number_of_photos': 7346}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83396 seconds', 'coverage_times_pause': '0 days 85628 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 6882, 'nb_two_criteria_ok': 6882, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1668, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 6864, 'ratio_coverage': 0.9652426532714499}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 421, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 421, 'last_update': '2025/03/09', 'portfolio_id': 21167974, 'last_run_id': 1660599, 'total_number_of_photos': 6989}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83678 seconds', 'coverage_times_pause': '0 days 85690 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7456, 'nb_two_criteria_ok': 7456, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1086, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 425, 'end_of_day_photos_uploaded': 7020, 'ratio_coverage': 0.9685065799372677}, 'dashboard_dict': {'nb_ptf_finished': 76, 'nb_images_finished': 457, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 457, 'last_update': '2025/03/09', 'portfolio_id': 21133882, 'last_run_id': 1660787, 'total_number_of_photos': 7590}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83446 seconds', 'coverage_times_pause': '0 days 85326 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7404, 'nb_two_criteria_ok': 7404, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1110, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1367, 'end_of_day_photos_uploaded': 6024, 'ratio_coverage': 0.9658213636731907}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 354, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 42, 'nb_images_started': 241, 'nb_selected_images': 595, 'last_update': '2025/03/09', 'portfolio_id': 21097211, 'last_run_id': 1658107, 'total_number_of_photos': 7516}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83599 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7083, 'nb_two_criteria_ok': 7083, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1457, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 48, 'end_of_day_photos_uploaded': 7026, 'ratio_coverage': 0.9675922175025173}, 'dashboard_dict': {'nb_ptf_finished': 84, 'nb_images_finished': 787, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 9, 'nb_selected_images': 796, 'last_update': '2025/03/09', 'portfolio_id': 21041872, 'last_run_id': 1658113, 'total_number_of_photos': 7213}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83115 seconds', 'coverage_times_pause': '0 days 85569 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7269, 'nb_two_criteria_ok': 7269, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1272, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 209, 'end_of_day_photos_uploaded': 7050, 'ratio_coverage': 0.9619903008136669}, 'dashboard_dict': {'nb_ptf_finished': 81, 'nb_images_finished': 815, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 70, 'nb_ptf_started': 3, 'nb_images_started': 20, 'nb_selected_images': 905, 'last_update': '2025/03/09', 'portfolio_id': 20997635, 'last_run_id': 1651777, 'total_number_of_photos': 7396}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83740 seconds', 'coverage_times_pause': '0 days 85683 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6886, 'nb_two_criteria_ok': 6886, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1668, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 12, 'end_of_day_photos_uploaded': 6857, 'ratio_coverage': 0.9692241808354264}, 'dashboard_dict': {'nb_ptf_finished': 125, 'nb_images_finished': 840, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 840, 'last_update': '2025/03/05', 'portfolio_id': 20959707, 'last_run_id': 1648158, 'total_number_of_photos': 7014}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83396 seconds', 'coverage_times_pause': '0 days 85628 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 6882, 'nb_two_criteria_ok': 6882, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1668, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 6864, 'ratio_coverage': 0.9652426532714499}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 421, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 421, 'last_update': '2025/03/09', 'portfolio_id': 21167974, 'last_run_id': 1660599, 'total_number_of_photos': 6987}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83678 seconds', 'coverage_times_pause': '0 days 85690 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7456, 'nb_two_criteria_ok': 7456, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1086, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 425, 'end_of_day_photos_uploaded': 7020, 'ratio_coverage': 0.9685065799372677}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 353, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 104, 'nb_selected_images': 457, 'last_update': '2025/03/08', 'portfolio_id': 21133882, 'last_run_id': 1657819, 'total_number_of_photos': 7590}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83446 seconds', 'coverage_times_pause': '0 days 85326 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7404, 'nb_two_criteria_ok': 7404, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1110, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1367, 'end_of_day_photos_uploaded': 6024, 'ratio_coverage': 0.9658213636731907}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 354, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 42, 'nb_images_started': 241, 'nb_selected_images': 595, 'last_update': '2025/03/09', 'portfolio_id': 21097211, 'last_run_id': 1658107, 'total_number_of_photos': 7516}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83599 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7083, 'nb_two_criteria_ok': 7083, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1457, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 48, 'end_of_day_photos_uploaded': 7026, 'ratio_coverage': 0.9675922175025173}, 'dashboard_dict': {'nb_ptf_finished': 84, 'nb_images_finished': 787, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 9, 'nb_selected_images': 796, 'last_update': '2025/03/09', 'portfolio_id': 21041872, 'last_run_id': 1658113, 'total_number_of_photos': 7213}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83115 seconds', 'coverage_times_pause': '0 days 85569 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7269, 'nb_two_criteria_ok': 7269, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1272, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 209, 'end_of_day_photos_uploaded': 7050, 'ratio_coverage': 0.9619903008136669}, 'dashboard_dict': {'nb_ptf_finished': 81, 'nb_images_finished': 815, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 70, 'nb_ptf_started': 3, 'nb_images_started': 20, 'nb_selected_images': 905, 'last_update': '2025/03/09', 'portfolio_id': 20997635, 'last_run_id': 1651777, 'total_number_of_photos': 7396}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83740 seconds', 'coverage_times_pause': '0 days 85683 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6886, 'nb_two_criteria_ok': 6886, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1668, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 12, 'end_of_day_photos_uploaded': 6857, 'ratio_coverage': 0.9692241808354264}, 'dashboard_dict': {'nb_ptf_finished': 125, 'nb_images_finished': 840, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 840, 'last_update': '2025/03/05', 'portfolio_id': 20959707, 'last_run_id': 1648158, 'total_number_of_photos': 7014}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83447 seconds', 'coverage_times_pause': '0 days 85749 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6500, 'nb_two_criteria_ok': 6500, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2052, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 6486, 'ratio_coverage': 0.9658329378812255}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 333, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 333, 'last_update': '2025/03/04', 'portfolio_id': 20954804, 'last_run_id': 1644679, 'total_number_of_photos': 6599}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83678 seconds', 'coverage_times_pause': '0 days 85690 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7456, 'nb_two_criteria_ok': 7456, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1086, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 425, 'end_of_day_photos_uploaded': 7020, 'ratio_coverage': 0.9685065799372677}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 353, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 104, 'nb_selected_images': 457, 'last_update': '2025/03/08', 'portfolio_id': 21133882, 'last_run_id': 1657819, 'total_number_of_photos': 7577}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83446 seconds', 'coverage_times_pause': '0 days 85326 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7404, 'nb_two_criteria_ok': 7404, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1110, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1367, 'end_of_day_photos_uploaded': 6024, 'ratio_coverage': 0.9658213636731907}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 242, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 54, 'nb_images_started': 353, 'nb_selected_images': 595, 'last_update': '2025/03/07', 'portfolio_id': 21097211, 'last_run_id': 1654218, 'total_number_of_photos': 7516}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83599 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7083, 'nb_two_criteria_ok': 7083, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1457, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 48, 'end_of_day_photos_uploaded': 7026, 'ratio_coverage': 0.9675922175025173}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 149, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 58, 'nb_images_started': 647, 'nb_selected_images': 796, 'last_update': '2025/03/07', 'portfolio_id': 21041872, 'last_run_id': 1651379, 'total_number_of_photos': 7213}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83115 seconds', 'coverage_times_pause': '0 days 85569 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7269, 'nb_two_criteria_ok': 7269, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1272, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 209, 'end_of_day_photos_uploaded': 7050, 'ratio_coverage': 0.9619903008136669}, 'dashboard_dict': {'nb_ptf_finished': 81, 'nb_images_finished': 815, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 70, 'nb_ptf_started': 3, 'nb_images_started': 20, 'nb_selected_images': 905, 'last_update': '2025/03/07', 'portfolio_id': 20997635, 'last_run_id': 1651777, 'total_number_of_photos': 7396}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6886, 'nb_two_criteria_ok': 6886, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 125, 'nb_images_finished': 840, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 840, 'last_update': '2025/03/05', 'portfolio_id': 20959707, 'last_run_id': 1648158, 'total_number_of_photos': 7014}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83447 seconds', 'coverage_times_pause': '0 days 85749 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6500, 'nb_two_criteria_ok': 6500, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2052, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 6486, 'ratio_coverage': 0.9658329378812255}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 333, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 333, 'last_update': '2025/03/04', 'portfolio_id': 20954804, 'last_run_id': 1644679, 'total_number_of_photos': 6599}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85325 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 6459, 'nb_two_criteria_ok': 6459, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2058, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 12, 'end_of_day_photos_uploaded': 6437, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 417, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 417, 'last_update': '2025/03/03', 'portfolio_id': 20945665, 'last_run_id': 1641858, 'total_number_of_photos': 6560}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83446 seconds', 'coverage_times_pause': '0 days 85326 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7404, 'nb_two_criteria_ok': 7404, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1110, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 1367, 'end_of_day_photos_uploaded': 6024, 'ratio_coverage': 0.9658213636731907}, 'dashboard_dict': {'nb_ptf_finished': 26, 'nb_images_finished': 242, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 54, 'nb_images_started': 353, 'nb_selected_images': 595, 'last_update': '2025/03/07', 'portfolio_id': 21097211, 'last_run_id': 1654218, 'total_number_of_photos': 7511}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83599 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7083, 'nb_two_criteria_ok': 7083, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1457, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 48, 'end_of_day_photos_uploaded': 7026, 'ratio_coverage': 0.9675922175025173}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 149, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 58, 'nb_images_started': 647, 'nb_selected_images': 796, 'last_update': '2025/03/07', 'portfolio_id': 21041872, 'last_run_id': 1651379, 'total_number_of_photos': 7213}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83115 seconds', 'coverage_times_pause': '0 days 85569 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7269, 'nb_two_criteria_ok': 7269, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1272, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 209, 'end_of_day_photos_uploaded': 7050, 'ratio_coverage': 0.9619903008136669}, 'dashboard_dict': {'nb_ptf_finished': 81, 'nb_images_finished': 815, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 70, 'nb_ptf_started': 3, 'nb_images_started': 20, 'nb_selected_images': 905, 'last_update': '2025/03/06', 'portfolio_id': 20997635, 'last_run_id': 1651777, 'total_number_of_photos': 7396}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83740 seconds', 'coverage_times_pause': '0 days 85683 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6886, 'nb_two_criteria_ok': 6886, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1668, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 12, 'end_of_day_photos_uploaded': 6857, 'ratio_coverage': 0.9692241808354264}, 'dashboard_dict': {'nb_ptf_finished': 125, 'nb_images_finished': 840, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 840, 'last_update': '2025/03/05', 'portfolio_id': 20959707, 'last_run_id': 1648158, 'total_number_of_photos': 7014}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83447 seconds', 'coverage_times_pause': '0 days 85749 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6500, 'nb_two_criteria_ok': 6500, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2052, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 6486, 'ratio_coverage': 0.9658329378812255}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 333, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 333, 'last_update': '2025/03/04', 'portfolio_id': 20954804, 'last_run_id': 1644679, 'total_number_of_photos': 6599}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85325 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 6459, 'nb_two_criteria_ok': 6459, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2058, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 12, 'end_of_day_photos_uploaded': 6437, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 417, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 417, 'last_update': '2025/03/03', 'portfolio_id': 20945665, 'last_run_id': 1641858, 'total_number_of_photos': 6560}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83599 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7083, 'nb_two_criteria_ok': 7083, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1457, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 48, 'end_of_day_photos_uploaded': 7026, 'ratio_coverage': 0.9675922175025173}, 'dashboard_dict': {'nb_ptf_finished': 28, 'nb_images_finished': 149, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 58, 'nb_images_started': 647, 'nb_selected_images': 796, 'last_update': '2025/03/06', 'portfolio_id': 21041872, 'last_run_id': 1651379, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83115 seconds', 'coverage_times_pause': '0 days 85569 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7269, 'nb_two_criteria_ok': 7269, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1272, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 209, 'end_of_day_photos_uploaded': 7050, 'ratio_coverage': 0.9619903008136669}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 418, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 35, 'nb_images_started': 487, 'nb_selected_images': 905, 'last_update': '2025/03/06', 'portfolio_id': 20997635, 'last_run_id': 1647786, 'total_number_of_photos': 7396}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83740 seconds', 'coverage_times_pause': '0 days 85683 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6886, 'nb_two_criteria_ok': 6886, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1668, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 12, 'end_of_day_photos_uploaded': 6857, 'ratio_coverage': 0.9692241808354264}, 'dashboard_dict': {'nb_ptf_finished': 125, 'nb_images_finished': 840, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 840, 'last_update': '2025/03/05', 'portfolio_id': 20959707, 'last_run_id': 1648158, 'total_number_of_photos': 7014}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83447 seconds', 'coverage_times_pause': '0 days 85749 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6500, 'nb_two_criteria_ok': 6500, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2052, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 6486, 'ratio_coverage': 0.9658329378812255}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 333, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 333, 'last_update': '2025/03/04', 'portfolio_id': 20954804, 'last_run_id': 1644679, 'total_number_of_photos': 6599}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85325 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 6459, 'nb_two_criteria_ok': 6459, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2058, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 12, 'end_of_day_photos_uploaded': 6437, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 417, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 417, 'last_update': '2025/03/03', 'portfolio_id': 20945665, 'last_run_id': 1641858, 'total_number_of_photos': 6560}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83115 seconds', 'coverage_times_pause': '0 days 85569 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7269, 'nb_two_criteria_ok': 7269, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1272, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 209, 'end_of_day_photos_uploaded': 7050, 'ratio_coverage': 0.9619903008136669}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 418, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 35, 'nb_images_started': 487, 'nb_selected_images': 905, 'last_update': '2025/03/05', 'portfolio_id': 20997635, 'last_run_id': 1647786, 'total_number_of_photos': 7391}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83740 seconds', 'coverage_times_pause': '0 days 85683 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6886, 'nb_two_criteria_ok': 6886, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1668, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 12, 'end_of_day_photos_uploaded': 6857, 'ratio_coverage': 0.9692241808354264}, 'dashboard_dict': {'nb_ptf_finished': 118, 'nb_images_finished': 802, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 38, 'nb_selected_images': 840, 'last_update': '2025/03/04', 'portfolio_id': 20959707, 'last_run_id': 1644422, 'total_number_of_photos': 7014}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83447 seconds', 'coverage_times_pause': '0 days 85749 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6500, 'nb_two_criteria_ok': 6500, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2052, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 6486, 'ratio_coverage': 0.9658329378812255}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 333, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 333, 'last_update': '2025/03/04', 'portfolio_id': 20954804, 'last_run_id': 1644679, 'total_number_of_photos': 6599}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85325 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 6459, 'nb_two_criteria_ok': 6459, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2058, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 12, 'end_of_day_photos_uploaded': 6437, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 417, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 417, 'last_update': '2025/03/03', 'portfolio_id': 20945665, 'last_run_id': 1641858, 'total_number_of_photos': 6560}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83740 seconds', 'coverage_times_pause': '0 days 85683 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6886, 'nb_two_criteria_ok': 6886, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1668, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 12, 'end_of_day_photos_uploaded': 6857, 'ratio_coverage': 0.9692241808354264}, 'dashboard_dict': {'nb_ptf_finished': 118, 'nb_images_finished': 802, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 38, 'nb_selected_images': 840, 'last_update': '2025/03/04', 'portfolio_id': 20959707, 'last_run_id': 1644422, 'total_number_of_photos': 7001}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83447 seconds', 'coverage_times_pause': '0 days 85749 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6500, 'nb_two_criteria_ok': 6500, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2052, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 6486, 'ratio_coverage': 0.9658329378812255}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 333, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 333, 'last_update': '2025/03/03', 'portfolio_id': 20954804, 'last_run_id': 1641591, 'total_number_of_photos': 6599}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85325 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 6459, 'nb_two_criteria_ok': 6459, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2058, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 12, 'end_of_day_photos_uploaded': 6437, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 417, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 417, 'last_update': '2025/03/03', 'portfolio_id': 20945665, 'last_run_id': 1641858, 'total_number_of_photos': 6560}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83447 seconds', 'coverage_times_pause': '0 days 85749 seconds', 'nb_photos_decision': 8556, 'nb_gray_level_ok': 8556, 'nb_dedup_ok': 6500, 'nb_two_criteria_ok': 6500, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2052, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 6486, 'ratio_coverage': 0.9658329378812255}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 333, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 333, 'last_update': '2025/03/03', 'portfolio_id': 20954804, 'last_run_id': 1641591, 'total_number_of_photos': 6586}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85325 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 6459, 'nb_two_criteria_ok': 6459, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2058, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 12, 'end_of_day_photos_uploaded': 6437, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 417, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 417, 'last_update': '2025/03/02', 'portfolio_id': 20945665, 'last_run_id': 1641248, 'total_number_of_photos': 6560}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83222 seconds', 'coverage_times_pause': '0 days 85325 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 6459, 'nb_two_criteria_ok': 6459, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 2058, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 12, 'end_of_day_photos_uploaded': 6437, 'ratio_coverage': 0.9632287410733921}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 417, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 417, 'last_update': '2025/03/02', 'portfolio_id': 20945665, 'last_run_id': 1641248, 'total_number_of_photos': 6554}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Found day : 2025-03-22 00:00:00 Found day : 2025-03-21 00:00:00 Found day : 2025-03-17 00:00:00 Found day : 2025-03-16 00:00:00 Found day : 2025-03-19 00:00:00 Found day : 2025-03-18 00:00:00 Found day : 2025-03-15 00:00:00 Found day : 2025-03-20 00:00:00 Found day : 2025-03-14 00:00:00 Found day : 2025-03-13 00:00:00 Found day : 2025-03-12 00:00:00 Found day : 2025-03-11 00:00:00 Found day : 2025-03-10 00:00:00 Found day : 2025-03-09 00:00:00 Found day : 2025-03-08 00:00:00 Found day : 2025-03-07 00:00:00 Found day : 2025-03-06 00:00:00 Found day : 2025-03-05 00:00:00 Found day : 2025-03-04 00:00:00 Found day : 2025-03-03 00:00:00 Found day : 2025-03-02 00:00:00 Found day : 2025-03-01 00:00:00 Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-03-23 00:00:00,2025-03-24 00:00:00,2025-03-25 00:00:00,2025-03-26 00:00:00,2025-03-27 00:00:00,2025-03-28 00:00:00,2025-03-29 00:00:00,2025-03-30 00:00:00,2025-03-31 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and ded.dashboard_place_id = 132 and month(ded.date) = 03 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______truck' and ded.dashboard_place_id = 132 and month(ded.date) = 03 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 132 and mp.name like '%032025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-03-01 : dt_date_just_month_year : 2025-03-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "dechet_Valcor_v2" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-03-01" AND ded.date <= "2025-03-31" apple3 {'test': {'mat': 'test', 'pht': 0, 'datou_carac_id': 370, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 538914404}, 'truck': {'mat': 'truck', 'pht': 4230, 'datou_carac_id': 4234, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'refus'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (1641858,1644679,1648158,1651777,1658113,1658107,1660787,1662481,1665447,1669585,1673156,1672936,1679949,1679947,1680584,1681931,1689903,1684345,1685350,1688657,1689902,1689848) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id AND ptp.type IN (0,4230) group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.06188918859422815, 'nb_photo': 315842, 'list_port_cont': '20948574,20948630,20948791,20948838,20948910,20948966,20949015,20949409,20949439,20949973,20950004,20950193,20950218,20950281,20950305,20950361,20950496,20950526,20950567,20950618,20950672,20950710,20950973,20951043,20951196,20951247,20951288,20951319,20951367,20951400,20951433,20951490,20951517,20951562,20951633,20951708,20951748,20951789,20951873,20951907,20951946,20951989,20952155,20952230,20952299,20952346,20952380,20952511,20952544,20952629,20952671,20952717,20952742,20952790,20952831,20952947,20952975,20953012,20953055,20953128,20953172,20953212,20953242,20953276,20953320,20953371,20953393,20953479,20953651,20953695,20953842,20953909,20953956,20953989,20954039,20954087,20954135,20954294,20954358,20954410,20954444,20954482,20954634,20954674,20954709,20954749,20957715,20957765,20957797,20957833,20957870,20957925,20957953,20957980,20958152,20958179,20958217,20958252,20958310,20958337,20958526,20958564,20958606,20958656,20958686,20958723,20958754,20958799,20958842,20958877,20958995,20959031,20959061,2095916', 'assoc_port': '20948539:20948630,20948540:20948574,20948718:20948910,20948719:20948966,20948720:20949015,20948721:20948791,20948722:20948838,20949315:20949439,20949316:20949409,20949932:20954482,20949933:20953956,20949934:20951433,20949935:20951490,20949936:20951517,20949937:20951562,20949938:20951633,20949939:20954709,20949940:20951708,20949941:20950004,20949942:20951789,20949943:20949973,20950047:20951907,20950048:20951946,20950049:20951989,20950050:20950193,20950051:20950281,20950052:20950218,20950260:20950361,20950261:20950305,20950391:20952230,20950392:20952346,20950393:20954749,20950394:20954358,20950395:20950526,20950396:20950567,20950397:20950618,20950398:20950496,20950604:20950973,20950605:20952511,20950606:20950672,20950607:20950710,20950608:20953842,20950901:20952717,20950902:20952790,20950903:20952831,20950904:20952947,20950905:20952975,20950906:20953012,20950907:20953055,20950908:20953128,20950909:20953212,20950910:20953242,20950911:20953276,20950912:20953320,20950913:20953371,20950914:20953393,20950915:2095347', 'assoc_mat': '20948539:autre:4230:20948630,20948540:autre:4230:20948574,20948718:autre:4230:20948910,20948719:autre:4230:20948966,20948720:autre:4230:20949015,20948721:autre:4230:20948791,20948722:autre:4230:20948838,20949315:autre:4230:20949439,20949316:autre:4230:20949409,20949932:autre:4230:20954482,20949933:autre:4230:20953956,20949934:autre:4230:20951433,20949935:autre:4230:20951490,20949936:autre:4230:20951517,20949937:autre:4230:20951562,20949938:autre:4230:20951633,20949939:autre:4230:20954709,20949940:autre:4230:20951708,20949941:autre:4230:20950004,20949942:autre:4230:20951789,20949943:autre:4230:20949973,20950047:autre:4230:20951907,20950048:autre:4230:20951946,20950049:autre:4230:20951989,20950050:autre:4230:20950193,20950051:autre:4230:20950281,20950052:autre:4230:20950218,20950260:autre:4230:20950361,20950261:autre:4230:20950305,20950391:autre:4230:20952230,20950392:autre:4230:20952346,20950393:autre:4230:20954749,20950394:autre:4230:20954358,20950395:autre:4230:20950526,20950396:autre:4230:20950567,20950397:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.032777200571265354, 'nb_photo': 333800, 'list_port_cont': '20948563,20948628,20948790,20948836,20948901,20948955,20949014,20949405,20949445,20949971,20950014,20950190,20950230,20950278,20950309,20950363,20950491,20950541,20950572,20950621,20950670,20950705,20950966,20951056,20951205,20951249,20951287,20951327,20951368,20951414,20951444,20951488,20951530,20951569,20951637,20951721,20951751,20951793,20951878,20951921,20951941,20951992,20952165,20952228,20952303,20952338,20952392,20952518,20952560,20952619,20952666,20952706,20952749,20952798,20952835,20952948,20952981,20953020,20953060,20953136,20953175,20953206,20953245,20953279,20953331,20953366,20953401,20953481,20953642,20953689,20953836,20953921,20953962,20954004,20954038,20954095,20954136,20954298,20954369,20954409,20954453,20954495,20954646,20954687,20954712,20954763,20957729,20957760,20957795,20957837,20957881,20957924,20957955,20957988,20958145,20958187,20958225,20958261,20958309,20958341,20958537,20958577,20958615,20958651,20958680,20958728,20958766,20958805,20958843,20958874,20958987,20959034,20959058,2095917', 'assoc_port': '20948539:20948628,20948540:20948563,20948718:20948901,20948719:20948955,20948720:20949014,20948721:20948790,20948722:20948836,20949315:20949445,20949316:20949405,20949932:20954495,20949933:20953962,20949934:20951444,20949935:20951488,20949936:20951530,20949937:20951569,20949938:20951637,20949939:20954712,20949940:20951721,20949941:20950014,20949942:20951793,20949943:20949971,20950047:20951921,20950048:20951941,20950049:20951992,20950050:20950190,20950051:20950278,20950052:20950230,20950260:20950363,20950261:20950309,20950391:20952228,20950392:20952338,20950393:20954763,20950394:20954369,20950395:20950541,20950396:20950572,20950397:20950621,20950398:20950491,20950604:20950966,20950605:20952518,20950606:20950670,20950607:20950705,20950608:20953836,20950901:20952706,20950902:20952798,20950903:20952835,20950904:20952948,20950905:20952981,20950906:20953020,20950907:20953060,20950908:20953136,20950909:20953206,20950910:20953245,20950911:20953279,20950912:20953331,20950913:20953366,20950914:20953401,20950915:2095348', 'assoc_mat': '20948539:carton:4230:20948628,20948540:carton:4230:20948563,20948718:carton:4230:20948901,20948719:carton:4230:20948955,20948720:carton:4230:20949014,20948721:carton:4230:20948790,20948722:carton:4230:20948836,20949315:carton:4230:20949445,20949316:carton:4230:20949405,20949932:carton:4230:20954495,20949933:carton:4230:20953962,20949934:carton:4230:20951444,20949935:carton:4230:20951488,20949936:carton:4230:20951530,20949937:carton:4230:20951569,20949938:carton:4230:20951637,20949939:carton:4230:20954712,20949940:carton:4230:20951721,20949941:carton:4230:20950014,20949942:carton:4230:20951793,20949943:carton:4230:20949971,20950047:carton:4230:20951921,20950048:carton:4230:20951941,20950049:carton:4230:20951992,20950050:carton:4230:20950190,20950051:carton:4230:20950278,20950052:carton:4230:20950230,20950260:carton:4230:20950363,20950261:carton:4230:20950309,20950391:carton:4230:20952228,20950392:carton:4230:20952338,20950393:carton:4230:20954763,20950394:carton:4230:20954369,20950395:carton:4230:20950541,2095'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.009360726606855146, 'nb_photo': 10666, 'list_port_cont': '20948562,20948640,20948792,20948839,20948967,20949002,20950186,20950356,20950497,20950539,20950627,20950671,20950959,20951040,20951209,20951289,20951326,20951358,20951409,20951435,20951485,20951526,20951760,20951866,20951909,20951945,20951987,20952162,20952314,20952348,20952391,20952516,20952559,20952627,20952670,20952738,20952789,20952819,20952937,20952974,20953010,20953165,20953202,20953250,20953285,20953329,20953356,20953407,20953472,20953640,20953693,20953837,20953917,20953959,20954005,20954124,20954302,20954367,20954399,20954441,20954651,20954675,20957794,20957835,20958231,20958265,20958296,20958348,20958530,20958677,20958731,20958768,20958798,20958827,20958875,20958996,20959033,20959277,20959331,20959527,20959791,20959827,20959873,20959909,20960158,20960193,20960236,20976250,20976466,20976736,20976771,20977002,20978223,20980826,20981065,20981302,20982624,20982721,20982946,20983307,20983431,20984671,20985418,20985908,20986122,20986323,20986420,20986509,20986605,20986787,20987095,20987335,20987501,2098780', 'assoc_port': '20948539:20948640,20948540:20948562,20948719:20948967,20948720:20949002,20948721:20948792,20948722:20948839,20949933:20953959,20949934:20951435,20949935:20951485,20949936:20951526,20950047:20951909,20950048:20951945,20950049:20951987,20950050:20950186,20950260:20950356,20950392:20952348,20950394:20954367,20950395:20950539,20950397:20950627,20950398:20950497,20950604:20950959,20950605:20952516,20950606:20950671,20950608:20953837,20950902:20952789,20950903:20952819,20950904:20952937,20950905:20952974,20950906:20953010,20950909:20953202,20950910:20953250,20950911:20953285,20950912:20953329,20950913:20953356,20950914:20953407,20950915:20953472,20950916:20954675,20950917:20953917,20950918:20954651,20950919:20954441,20950920:20954399,20950921:20954302,20950923:20954124,20950924:20953640,20950926:20953693,20950927:20951040,20950928:20954005,20951089:20953165,20951090:20952670,20951091:20952738,20951092:20952391,20951093:20952627,20951094:20952559,20951095:20952162,20951096:20952314,20951097:20951326,20951098:2095176', 'assoc_mat': '20948539:metal:4230:20948640,20948540:metal:4230:20948562,20948719:metal:4230:20948967,20948720:metal:4230:20949002,20948721:metal:4230:20948792,20948722:metal:4230:20948839,20949933:metal:4230:20953959,20949934:metal:4230:20951435,20949935:metal:4230:20951485,20949936:metal:4230:20951526,20950047:metal:4230:20951909,20950048:metal:4230:20951945,20950049:metal:4230:20951987,20950050:metal:4230:20950186,20950260:metal:4230:20950356,20950392:metal:4230:20952348,20950394:metal:4230:20954367,20950395:metal:4230:20950539,20950397:metal:4230:20950627,20950398:metal:4230:20950497,20950604:metal:4230:20950959,20950605:metal:4230:20952516,20950606:metal:4230:20950671,20950608:metal:4230:20953837,20950902:metal:4230:20952789,20950903:metal:4230:20952819,20950904:metal:4230:20952937,20950905:metal:4230:20952974,20950906:metal:4230:20953010,20950909:metal:4230:20953202,20950910:metal:4230:20953250,20950911:metal:4230:20953285,20950912:metal:4230:20953329,20950913:metal:4230:20953356,20950914:metal:4230:20953407,20950915:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.10981529340151892, 'nb_photo': 863272, 'list_port_cont': '20948566,20948626,20948784,20948833,20948903,20948964,20949013,20949403,20949448,20949972,20950009,20950189,20950231,20950272,20950318,20950349,20950495,20950532,20950580,20950630,20950673,20950713,20950968,20951046,20951208,20951244,20951290,20951333,20951366,20951411,20951449,20951491,20951525,20951574,20951640,20951713,20951763,20951796,20951882,20951920,20951954,20951994,20952160,20952231,20952315,20952351,20952383,20952520,20952549,20952633,20952677,20952716,20952755,20952792,20952834,20952944,20952983,20953023,20953063,20953125,20953173,20953210,20953249,20953290,20953318,20953367,20953410,20953485,20953649,20953688,20953835,20953924,20953958,20953997,20954036,20954098,20954128,20954299,20954372,20954415,20954458,20954494,20954649,20954677,20954718,20954760,20957727,20957767,20957803,20957840,20957874,20957919,20957958,20957992,20958151,20958185,20958230,20958266,20958298,20958345,20958542,20958576,20958605,20958652,20958682,20958733,20958765,20958794,20958832,20958882,20958993,20959021,20959068,2095917', 'assoc_port': '20948539:20948626,20948540:20948566,20948718:20948903,20948719:20948964,20948720:20949013,20948721:20948784,20948722:20948833,20949315:20949448,20949316:20949403,20949932:20954494,20949933:20953958,20949934:20951449,20949935:20951491,20949936:20951525,20949937:20951574,20949938:20951640,20949939:20954718,20949940:20951713,20949941:20950009,20949942:20951796,20949943:20949972,20950047:20951920,20950048:20951954,20950049:20951994,20950050:20950189,20950051:20950272,20950052:20950231,20950260:20950349,20950261:20950318,20950391:20952231,20950392:20952351,20950393:20954760,20950394:20954372,20950395:20950532,20950396:20950580,20950397:20950630,20950398:20950495,20950604:20950968,20950605:20952520,20950606:20950673,20950607:20950713,20950608:20953835,20950901:20952716,20950902:20952792,20950903:20952834,20950904:20952944,20950905:20952983,20950906:20953023,20950907:20953063,20950908:20953125,20950909:20953210,20950910:20953249,20950911:20953290,20950912:20953318,20950913:20953367,20950914:20953410,20950915:2095348', 'assoc_mat': '20948539:papier:4230:20948626,20948540:papier:4230:20948566,20948718:papier:4230:20948903,20948719:papier:4230:20948964,20948720:papier:4230:20949013,20948721:papier:4230:20948784,20948722:papier:4230:20948833,20949315:papier:4230:20949448,20949316:papier:4230:20949403,20949932:papier:4230:20954494,20949933:papier:4230:20953958,20949934:papier:4230:20951449,20949935:papier:4230:20951491,20949936:papier:4230:20951525,20949937:papier:4230:20951574,20949938:papier:4230:20951640,20949939:papier:4230:20954718,20949940:papier:4230:20951713,20949941:papier:4230:20950009,20949942:papier:4230:20951796,20949943:papier:4230:20949972,20950047:papier:4230:20951920,20950048:papier:4230:20951954,20950049:papier:4230:20951994,20950050:papier:4230:20950189,20950051:papier:4230:20950272,20950052:papier:4230:20950231,20950260:papier:4230:20950349,20950261:papier:4230:20950318,20950391:papier:4230:20952231,20950392:papier:4230:20952351,20950393:papier:4230:20954760,20950394:papier:4230:20954372,20950395:papier:4230:20950532,2095'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0016788964626927175, 'nb_photo': 4635, 'list_port_cont': '20948793,20949398,20949447,20951051,20951283,20951336,20951880,20952159,20952395,20952558,20952628,20952669,20952719,20952751,20952795,20952941,20952979,20953013,20953056,20953139,20953168,20953207,20953252,20953286,20953326,20953360,20953405,20953478,20953646,20953923,20954003,20954040,20954132,20954291,20954407,20954454,20954640,20954684,20958691,20958878,20958988,20959028,20959069,20959181,20959243,20959329,20959491,20960206,20976779,20978237,20981064,20983578,20985912,20986137,20986321,20986425,20986515,20986612,20987086,20987337,20987802,20987838,20993161,20993245,20993380,20993866,20994359,20994501,20995575,21000813,21006333,21007995,21008338,21008467,21008813,21016454,21020057,21020310,21020479,21020527,21020763,21021862,21021997,21022069,21022335,21022534,21022654,21022825,21022858,21022921,21023207,21023493,21023635,21023916,21024013,21024371,21025136,21025328,21025615,21026541,21026980,21027140,21059932,21061701,21063663,21064233,21065419,21069260,21071368,21074302,21074984,21075811,21076223,2108263', 'assoc_port': '20948721:20948793,20949315:20949447,20949316:20949398,20950901:20952719,20950902:20952795,20950904:20952941,20950905:20952979,20950906:20953013,20950907:20953056,20950908:20953139,20950909:20953207,20950910:20953252,20950911:20953286,20950912:20953326,20950913:20953360,20950914:20953405,20950915:20953478,20950916:20954684,20950917:20953923,20950918:20954640,20950919:20954454,20950920:20954407,20950921:20954291,20950922:20954040,20950923:20954132,20950924:20953646,20950927:20951051,20950928:20954003,20951089:20953168,20951090:20952669,20951091:20952751,20951092:20952395,20951093:20952628,20951094:20952558,20951095:20952159,20951097:20951336,20951099:20951880,20951101:20951283,20957604:20958691,20957607:20958878,20957608:20958988,20957609:20959028,20957610:20959069,20957611:20959181,20957612:20959329,20957613:20959243,20957616:20959491,20957628:20960206,20975749:21006333,20975751:20986137,20975753:20985912,20975755:20986515,20975757:20986321,20975760:20986425,20975762:20986612,20975768:20987086,20976681:2098733', 'assoc_mat': '20948721:pehd:4230:20948793,20949315:pehd:4230:20949447,20949316:pehd:4230:20949398,20950901:pehd:4230:20952719,20950902:pehd:4230:20952795,20950904:pehd:4230:20952941,20950905:pehd:4230:20952979,20950906:pehd:4230:20953013,20950907:pehd:4230:20953056,20950908:pehd:4230:20953139,20950909:pehd:4230:20953207,20950910:pehd:4230:20953252,20950911:pehd:4230:20953286,20950912:pehd:4230:20953326,20950913:pehd:4230:20953360,20950914:pehd:4230:20953405,20950915:pehd:4230:20953478,20950916:pehd:4230:20954684,20950917:pehd:4230:20953923,20950918:pehd:4230:20954640,20950919:pehd:4230:20954454,20950920:pehd:4230:20954407,20950921:pehd:4230:20954291,20950922:pehd:4230:20954040,20950923:pehd:4230:20954132,20950924:pehd:4230:20953646,20950927:pehd:4230:20951051,20950928:pehd:4230:20954003,20951089:pehd:4230:20953168,20951090:pehd:4230:20952669,20951091:pehd:4230:20952751,20951092:pehd:4230:20952395,20951093:pehd:4230:20952628,20951094:pehd:4230:20952558,20951095:pehd:4230:20952159,20951097:pehd:4230:20951336,20951099:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.008147825726366098, 'nb_photo': 111084, 'list_port_cont': '20948572,20948639,20948798,20948830,20948911,20948965,20949010,20949400,20949437,20949967,20949999,20950194,20950225,20950282,20950312,20950352,20950489,20950538,20950578,20950632,20950659,20950716,20950972,20951057,20951207,20951253,20951285,20951334,20951374,20951412,20951441,20951486,20951528,20951641,20951719,20951800,20951883,20951917,20951952,20952161,20952234,20952309,20952350,20952387,20952517,20952557,20952625,20952674,20952710,20952753,20952797,20952833,20952942,20952980,20953019,20953058,20953134,20953170,20953203,20953244,20953288,20953330,20953364,20953408,20953484,20953645,20953685,20953848,20953918,20953966,20954001,20954034,20954099,20954134,20954293,20954365,20954412,20954445,20954487,20954647,20954688,20954717,20954758,20957721,20957766,20957796,20957838,20957882,20957923,20957954,20957995,20958146,20958191,20958218,20958257,20958307,20958351,20958541,20958578,20958608,20958650,20958694,20958730,20958758,20958802,20958837,20958884,20958985,20959029,20959071,20959176,20959211,20959244,2095929', 'assoc_port': '20948539:20948639,20948540:20948572,20948718:20948911,20948719:20948965,20948720:20949010,20948721:20948798,20948722:20948830,20949315:20949437,20949316:20949400,20949932:20954487,20949933:20953966,20949934:20951441,20949935:20951486,20949936:20951528,20949938:20951641,20949939:20954717,20949940:20951719,20949941:20949999,20949942:20951800,20949943:20949967,20950047:20951917,20950048:20951952,20950050:20950194,20950051:20950282,20950052:20950225,20950260:20950352,20950261:20950312,20950391:20952234,20950392:20952350,20950393:20954758,20950394:20954365,20950395:20950538,20950396:20950578,20950397:20950632,20950398:20950489,20950604:20950972,20950605:20952517,20950606:20950659,20950607:20950716,20950608:20953848,20950901:20952710,20950902:20952797,20950903:20952833,20950904:20952942,20950905:20952980,20950906:20953019,20950907:20953058,20950908:20953134,20950909:20953203,20950910:20953244,20950911:20953288,20950912:20953330,20950913:20953364,20950914:20953408,20950915:20953484,20950916:20954688,20950917:2095391', 'assoc_mat': '20948539:pet_clair:4230:20948639,20948540:pet_clair:4230:20948572,20948718:pet_clair:4230:20948911,20948719:pet_clair:4230:20948965,20948720:pet_clair:4230:20949010,20948721:pet_clair:4230:20948798,20948722:pet_clair:4230:20948830,20949315:pet_clair:4230:20949437,20949316:pet_clair:4230:20949400,20949932:pet_clair:4230:20954487,20949933:pet_clair:4230:20953966,20949934:pet_clair:4230:20951441,20949935:pet_clair:4230:20951486,20949936:pet_clair:4230:20951528,20949938:pet_clair:4230:20951641,20949939:pet_clair:4230:20954717,20949940:pet_clair:4230:20951719,20949941:pet_clair:4230:20949999,20949942:pet_clair:4230:20951800,20949943:pet_clair:4230:20949967,20950047:pet_clair:4230:20951917,20950048:pet_clair:4230:20951952,20950050:pet_clair:4230:20950194,20950051:pet_clair:4230:20950282,20950052:pet_clair:4230:20950225,20950260:pet_clair:4230:20950352,20950261:pet_clair:4230:20950312,20950391:pet_clair:4230:20952234,20950392:pet_clair:4230:20952350,20950393:pet_clair:4230:20954758,20950394:pet_clair:4230:20954365,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0020363831593979533, 'nb_photo': 2469, 'list_port_cont': '20948800,20948960,20949011,20950976,20951403,20951951,20952389,20952548,20952672,20952750,20952939,20953171,20953291,20953476,20953647,20953920,20954042,20954137,20954414,20954457,20954644,20958803,20958876,20959025,20959398,20959834,20960050,20960207,20976257,20976474,20978226,20986514,20986800,20987338,20989354,20993670,20995695,20997322,20997838,20998615,21016459,21019514,21020531,21022342,21022828,21025137,21025614,21027237,21059939,21072681,21073910,21074307,21075805,21076230,21076982,21080425,21082598,21084327,21103663,21113935,21115015,21115950,21116268,21116541,21116696,21116731,21116760,21116952,21118796,21128949,21129524,21130051,21131337,21131438,21135199,21135405,21135874,21136454,21138270,21145852,21146213,21146417,21146560,21146793,21149490,21149809,21150207,21151642,21153976,21154789,21155161,21155270,21158750,21159344,21159652,21160033,21160391,21169342,21169666,21169720,21169922,21170523,21171322,21172090,21173066,21174665,21175250,21181984,21183552,21183619,21183693,21184258,21184395,2118479', 'assoc_port': '20948719:20948960,20948720:20949011,20948721:20948800,20950048:20951951,20950604:20950976,20950904:20952939,20950911:20953291,20950915:20953476,20950917:20953920,20950918:20954644,20950919:20954457,20950920:20954414,20950922:20954042,20950923:20954137,20950924:20953647,20951089:20953171,20951090:20952672,20951091:20952750,20951092:20952389,20951094:20952548,20951315:20951403,20957607:20958876,20957609:20959025,20957614:20959398,20957621:20959834,20957628:20960207,20957632:20960050,20957640:20958803,20975755:20986514,20975764:20986800,20975770:20976474,20975772:20976257,20976681:20987338,20976689:20978226,20982854:20995695,20985872:20997322,20986832:20997838,20987948:20998615,20988887:20993670,20988898:20989354,21007625:21020531,21008152:21022342,21008156:21022828,21008163:21074307,21008690:21025137,21008692:21025614,21012337:21059939,21013627:21016459,21017649:21019514,21021540:21073910,21022101:21072681,21023140:21027237,21064401:21103663,21074796:21113935,21074804:21115015,21075276:21115950,21075279:2111626', 'assoc_mat': '20948719:pet_fonce:4230:20948960,20948720:pet_fonce:4230:20949011,20948721:pet_fonce:4230:20948800,20950048:pet_fonce:4230:20951951,20950604:pet_fonce:4230:20950976,20950904:pet_fonce:4230:20952939,20950911:pet_fonce:4230:20953291,20950915:pet_fonce:4230:20953476,20950917:pet_fonce:4230:20953920,20950918:pet_fonce:4230:20954644,20950919:pet_fonce:4230:20954457,20950920:pet_fonce:4230:20954414,20950922:pet_fonce:4230:20954042,20950923:pet_fonce:4230:20954137,20950924:pet_fonce:4230:20953647,20951089:pet_fonce:4230:20953171,20951090:pet_fonce:4230:20952672,20951091:pet_fonce:4230:20952750,20951092:pet_fonce:4230:20952389,20951094:pet_fonce:4230:20952548,20951315:pet_fonce:4230:20951403,20957607:pet_fonce:4230:20958876,20957609:pet_fonce:4230:20959025,20957614:pet_fonce:4230:20959398,20957621:pet_fonce:4230:20959834,20957628:pet_fonce:4230:20960207,20957632:pet_fonce:4230:20960050,20957640:pet_fonce:4230:20958803,20975755:pet_fonce:4230:20986514,20975764:pet_fonce:4230:20986800,20975770:pet_fonce:4230:20976474,2'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(1641858,1644679,1648158,1651777,1658113,1658107,1660787,1662481,1665447,1669585,1673156,1672936,1679949,1679947,1680584,1681931,1689903,1684345,1685350,1688657,1689902,1689848)); after get_hostname_from_raspi hasthag : truck hasthag that could be used but not yet : _______refus SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______truck' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1055) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=132 and date >='2025-03-01' and date <= '2025-03-31') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((20314,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('truck', 20314),), 'material_dict': {'truck': 20314}, 'coverage_data': (('2025/03/22/', 0.96), ('2025/03/21/', 0.968067), ('2025/03/17/', 0.963344), ('2025/03/16/', 0.960868), ('2025/03/19/', 0.0), ('2025/03/18/', 0.967708), ('2025/03/15/', 0.96118), ('2025/03/20/', 0.965787), ('2025/03/14/', 0.968553), ('2025/03/13/', 0.967349), ('2025/03/12/', 0.963229), ('2025/03/11/', 0.964814), ('2025/03/10/', 0.962812), ('2025/03/09/', 0.963449), ('2025/03/08/', 0.965243), ('2025/03/07/', 0.968507), ('2025/03/06/', 0.965821), ('2025/03/05/', 0.967592), ('2025/03/04/', 0.96199), ('2025/03/03/', 0.969224), ('2025/03/02/', 0.965833), ('2025/03/01/', 0.963229)), 'impurety_average_data': ((datetime.date(2025, 3, 1), 0.22615668021737417, 415), (datetime.date(2025, 3, 2), 0.20289624018224373, 333), (datetime.date(2025, 3, 3), 0.24400958811822127, 770), (datetime.date(2025, 3, 4), 0.2442778658402637, 905), (datetime.date(2025, 3, 5), 0.23130958806032326, 788), (datetime.date(2025, 3, 6), 0.21812154893316538, 571), (datetime.date(2025, 3, 7), 0.24743006747913976, 450), (datetime.date(2025, 3, 8), 0.2310184375826634, 419), (datetime.date(2025, 3, 9), 0.24857972222748087, 206), (datetime.date(2025, 3, 10), 0.2003477764112011, 981), (datetime.date(2025, 3, 11), 0.2107162723160182, 1009), (datetime.date(2025, 3, 12), 0.19359399154314946, 1947), (datetime.date(2025, 3, 13), 0.19456655746628557, 1442), (datetime.date(2025, 3, 14), 0.2094613343033306, 1221), (datetime.date(2025, 3, 15), 0.2081203156923626, 276), (datetime.date(2025, 3, 17), 0.21374270724902483, 2752), (datetime.date(2025, 3, 18), 0.2140324630355527, 1195), (datetime.date(2025, 3, 19), 0.19408859436698742, 1537), (datetime.date(2025, 3, 20), 0.2272414693447885, 1208), (datetime.date(2025, 3, 21), 0.22725363207873797, 1499), (datetime.date(2025, 3, 22), 0.220904272540805, 390)), 'impurety_average_data_per_hashtag': {'truck': ((datetime.date(2025, 3, 1), 0.22615668021737417, 415), (datetime.date(2025, 3, 2), 0.20289624018224373, 333), (datetime.date(2025, 3, 3), 0.24400958811822127, 770), (datetime.date(2025, 3, 4), 0.2442778658402637, 905), (datetime.date(2025, 3, 5), 0.23130958806032326, 788), (datetime.date(2025, 3, 6), 0.21812154893316538, 571), (datetime.date(2025, 3, 7), 0.24743006747913976, 450), (datetime.date(2025, 3, 8), 0.2310184375826634, 419), (datetime.date(2025, 3, 9), 0.24857972222748087, 206), (datetime.date(2025, 3, 10), 0.2003477764112011, 981), (datetime.date(2025, 3, 11), 0.2107162723160182, 1009), (datetime.date(2025, 3, 12), 0.19359399154314946, 1947), (datetime.date(2025, 3, 13), 0.19456655746628557, 1442), (datetime.date(2025, 3, 14), 0.2094613343033306, 1221), (datetime.date(2025, 3, 15), 0.2081203156923626, 276), (datetime.date(2025, 3, 17), 0.21374270724902483, 2752), (datetime.date(2025, 3, 18), 0.2140324630355527, 1195), (datetime.date(2025, 3, 19), 0.19408859436698742, 1537), (datetime.date(2025, 3, 20), 0.2272414693447885, 1208), (datetime.date(2025, 3, 21), 0.22725363207873797, 1499), (datetime.date(2025, 3, 22), 0.220904272540805, 390))}, 'quality_array': [['-7.332591499420884', '01032025'], ['-7.527965001672397', '02032025'], ['-7.288773172531967', '03032025'], ['-7.2924351424164895', '04032025'], ['-7.542579563960059', '05032025'], ['-7.180283153449513', '06032025'], ['-7.665679012029117', '07032025'], ['-7.737731242657355', '08032025'], ['-7.603772649441217', '09032025'], ['-7.537159161841352', '10032025'], ['-7.529210941165527', '11032025'], ['-7.826957160517425', '12032025'], ['-7.826175733135817', '13032025'], ['-7.509666204407232', '14032025'], ['-7.361026477905734', '15032025'], ['-7.236109524665252', '17032025'], ['-7.4837862184070545', '18032025'], ['-7.467920025033016', '19032025'], ['-7.662978557379137', '20032025'], ['-7.587500734411645', '21032025'], ['-7.526178051003406', '22032025']], 'number_of_batch': ((2635,),), 'datou_id_sts': 4311, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.06188918859422815, 'nb_photo': 315842, 'list_port_cont': '20948574,20948630,20948791,20948838,20948910,20948966,20949015,20949409,20949439,20949973,20950004,20950193,20950218,20950281,20950305,20950361,20950496,20950526,20950567,20950618,20950672,20950710,20950973,20951043,20951196,20951247,20951288,20951319,20951367,20951400,20951433,20951490,20951517,20951562,20951633,20951708,20951748,20951789,20951873,20951907,20951946,20951989,20952155,20952230,20952299,20952346,20952380,20952511,20952544,20952629,20952671,20952717,20952742,20952790,20952831,20952947,20952975,20953012,20953055,20953128,20953172,20953212,20953242,20953276,20953320,20953371,20953393,20953479,20953651,20953695,20953842,20953909,20953956,20953989,20954039,20954087,20954135,20954294,20954358,20954410,20954444,20954482,20954634,20954674,20954709,20954749,20957715,20957765,20957797,20957833,20957870,20957925,20957953,20957980,20958152,20958179,20958217,20958252,20958310,20958337,20958526,20958564,20958606,20958656,20958686,20958723,20958754,20958799,20958842,20958877,20958995,20959031,20959061,2095916', 'assoc_port': '20948539:20948630,20948540:20948574,20948718:20948910,20948719:20948966,20948720:20949015,20948721:20948791,20948722:20948838,20949315:20949439,20949316:20949409,20949932:20954482,20949933:20953956,20949934:20951433,20949935:20951490,20949936:20951517,20949937:20951562,20949938:20951633,20949939:20954709,20949940:20951708,20949941:20950004,20949942:20951789,20949943:20949973,20950047:20951907,20950048:20951946,20950049:20951989,20950050:20950193,20950051:20950281,20950052:20950218,20950260:20950361,20950261:20950305,20950391:20952230,20950392:20952346,20950393:20954749,20950394:20954358,20950395:20950526,20950396:20950567,20950397:20950618,20950398:20950496,20950604:20950973,20950605:20952511,20950606:20950672,20950607:20950710,20950608:20953842,20950901:20952717,20950902:20952790,20950903:20952831,20950904:20952947,20950905:20952975,20950906:20953012,20950907:20953055,20950908:20953128,20950909:20953212,20950910:20953242,20950911:20953276,20950912:20953320,20950913:20953371,20950914:20953393,20950915:2095347', 'assoc_mat': '20948539:autre:4230:20948630,20948540:autre:4230:20948574,20948718:autre:4230:20948910,20948719:autre:4230:20948966,20948720:autre:4230:20949015,20948721:autre:4230:20948791,20948722:autre:4230:20948838,20949315:autre:4230:20949439,20949316:autre:4230:20949409,20949932:autre:4230:20954482,20949933:autre:4230:20953956,20949934:autre:4230:20951433,20949935:autre:4230:20951490,20949936:autre:4230:20951517,20949937:autre:4230:20951562,20949938:autre:4230:20951633,20949939:autre:4230:20954709,20949940:autre:4230:20951708,20949941:autre:4230:20950004,20949942:autre:4230:20951789,20949943:autre:4230:20949973,20950047:autre:4230:20951907,20950048:autre:4230:20951946,20950049:autre:4230:20951989,20950050:autre:4230:20950193,20950051:autre:4230:20950281,20950052:autre:4230:20950218,20950260:autre:4230:20950361,20950261:autre:4230:20950305,20950391:autre:4230:20952230,20950392:autre:4230:20952346,20950393:autre:4230:20954749,20950394:autre:4230:20954358,20950395:autre:4230:20950526,20950396:autre:4230:20950567,20950397:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.032777200571265354, 'nb_photo': 333800, 'list_port_cont': '20948563,20948628,20948790,20948836,20948901,20948955,20949014,20949405,20949445,20949971,20950014,20950190,20950230,20950278,20950309,20950363,20950491,20950541,20950572,20950621,20950670,20950705,20950966,20951056,20951205,20951249,20951287,20951327,20951368,20951414,20951444,20951488,20951530,20951569,20951637,20951721,20951751,20951793,20951878,20951921,20951941,20951992,20952165,20952228,20952303,20952338,20952392,20952518,20952560,20952619,20952666,20952706,20952749,20952798,20952835,20952948,20952981,20953020,20953060,20953136,20953175,20953206,20953245,20953279,20953331,20953366,20953401,20953481,20953642,20953689,20953836,20953921,20953962,20954004,20954038,20954095,20954136,20954298,20954369,20954409,20954453,20954495,20954646,20954687,20954712,20954763,20957729,20957760,20957795,20957837,20957881,20957924,20957955,20957988,20958145,20958187,20958225,20958261,20958309,20958341,20958537,20958577,20958615,20958651,20958680,20958728,20958766,20958805,20958843,20958874,20958987,20959034,20959058,2095917', 'assoc_port': '20948539:20948628,20948540:20948563,20948718:20948901,20948719:20948955,20948720:20949014,20948721:20948790,20948722:20948836,20949315:20949445,20949316:20949405,20949932:20954495,20949933:20953962,20949934:20951444,20949935:20951488,20949936:20951530,20949937:20951569,20949938:20951637,20949939:20954712,20949940:20951721,20949941:20950014,20949942:20951793,20949943:20949971,20950047:20951921,20950048:20951941,20950049:20951992,20950050:20950190,20950051:20950278,20950052:20950230,20950260:20950363,20950261:20950309,20950391:20952228,20950392:20952338,20950393:20954763,20950394:20954369,20950395:20950541,20950396:20950572,20950397:20950621,20950398:20950491,20950604:20950966,20950605:20952518,20950606:20950670,20950607:20950705,20950608:20953836,20950901:20952706,20950902:20952798,20950903:20952835,20950904:20952948,20950905:20952981,20950906:20953020,20950907:20953060,20950908:20953136,20950909:20953206,20950910:20953245,20950911:20953279,20950912:20953331,20950913:20953366,20950914:20953401,20950915:2095348', 'assoc_mat': '20948539:carton:4230:20948628,20948540:carton:4230:20948563,20948718:carton:4230:20948901,20948719:carton:4230:20948955,20948720:carton:4230:20949014,20948721:carton:4230:20948790,20948722:carton:4230:20948836,20949315:carton:4230:20949445,20949316:carton:4230:20949405,20949932:carton:4230:20954495,20949933:carton:4230:20953962,20949934:carton:4230:20951444,20949935:carton:4230:20951488,20949936:carton:4230:20951530,20949937:carton:4230:20951569,20949938:carton:4230:20951637,20949939:carton:4230:20954712,20949940:carton:4230:20951721,20949941:carton:4230:20950014,20949942:carton:4230:20951793,20949943:carton:4230:20949971,20950047:carton:4230:20951921,20950048:carton:4230:20951941,20950049:carton:4230:20951992,20950050:carton:4230:20950190,20950051:carton:4230:20950278,20950052:carton:4230:20950230,20950260:carton:4230:20950363,20950261:carton:4230:20950309,20950391:carton:4230:20952228,20950392:carton:4230:20952338,20950393:carton:4230:20954763,20950394:carton:4230:20954369,20950395:carton:4230:20950541,2095'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.009360726606855146, 'nb_photo': 10666, 'list_port_cont': '20948562,20948640,20948792,20948839,20948967,20949002,20950186,20950356,20950497,20950539,20950627,20950671,20950959,20951040,20951209,20951289,20951326,20951358,20951409,20951435,20951485,20951526,20951760,20951866,20951909,20951945,20951987,20952162,20952314,20952348,20952391,20952516,20952559,20952627,20952670,20952738,20952789,20952819,20952937,20952974,20953010,20953165,20953202,20953250,20953285,20953329,20953356,20953407,20953472,20953640,20953693,20953837,20953917,20953959,20954005,20954124,20954302,20954367,20954399,20954441,20954651,20954675,20957794,20957835,20958231,20958265,20958296,20958348,20958530,20958677,20958731,20958768,20958798,20958827,20958875,20958996,20959033,20959277,20959331,20959527,20959791,20959827,20959873,20959909,20960158,20960193,20960236,20976250,20976466,20976736,20976771,20977002,20978223,20980826,20981065,20981302,20982624,20982721,20982946,20983307,20983431,20984671,20985418,20985908,20986122,20986323,20986420,20986509,20986605,20986787,20987095,20987335,20987501,2098780', 'assoc_port': '20948539:20948640,20948540:20948562,20948719:20948967,20948720:20949002,20948721:20948792,20948722:20948839,20949933:20953959,20949934:20951435,20949935:20951485,20949936:20951526,20950047:20951909,20950048:20951945,20950049:20951987,20950050:20950186,20950260:20950356,20950392:20952348,20950394:20954367,20950395:20950539,20950397:20950627,20950398:20950497,20950604:20950959,20950605:20952516,20950606:20950671,20950608:20953837,20950902:20952789,20950903:20952819,20950904:20952937,20950905:20952974,20950906:20953010,20950909:20953202,20950910:20953250,20950911:20953285,20950912:20953329,20950913:20953356,20950914:20953407,20950915:20953472,20950916:20954675,20950917:20953917,20950918:20954651,20950919:20954441,20950920:20954399,20950921:20954302,20950923:20954124,20950924:20953640,20950926:20953693,20950927:20951040,20950928:20954005,20951089:20953165,20951090:20952670,20951091:20952738,20951092:20952391,20951093:20952627,20951094:20952559,20951095:20952162,20951096:20952314,20951097:20951326,20951098:2095176', 'assoc_mat': '20948539:metal:4230:20948640,20948540:metal:4230:20948562,20948719:metal:4230:20948967,20948720:metal:4230:20949002,20948721:metal:4230:20948792,20948722:metal:4230:20948839,20949933:metal:4230:20953959,20949934:metal:4230:20951435,20949935:metal:4230:20951485,20949936:metal:4230:20951526,20950047:metal:4230:20951909,20950048:metal:4230:20951945,20950049:metal:4230:20951987,20950050:metal:4230:20950186,20950260:metal:4230:20950356,20950392:metal:4230:20952348,20950394:metal:4230:20954367,20950395:metal:4230:20950539,20950397:metal:4230:20950627,20950398:metal:4230:20950497,20950604:metal:4230:20950959,20950605:metal:4230:20952516,20950606:metal:4230:20950671,20950608:metal:4230:20953837,20950902:metal:4230:20952789,20950903:metal:4230:20952819,20950904:metal:4230:20952937,20950905:metal:4230:20952974,20950906:metal:4230:20953010,20950909:metal:4230:20953202,20950910:metal:4230:20953250,20950911:metal:4230:20953285,20950912:metal:4230:20953329,20950913:metal:4230:20953356,20950914:metal:4230:20953407,20950915:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.10981529340151892, 'nb_photo': 863272, 'list_port_cont': '20948566,20948626,20948784,20948833,20948903,20948964,20949013,20949403,20949448,20949972,20950009,20950189,20950231,20950272,20950318,20950349,20950495,20950532,20950580,20950630,20950673,20950713,20950968,20951046,20951208,20951244,20951290,20951333,20951366,20951411,20951449,20951491,20951525,20951574,20951640,20951713,20951763,20951796,20951882,20951920,20951954,20951994,20952160,20952231,20952315,20952351,20952383,20952520,20952549,20952633,20952677,20952716,20952755,20952792,20952834,20952944,20952983,20953023,20953063,20953125,20953173,20953210,20953249,20953290,20953318,20953367,20953410,20953485,20953649,20953688,20953835,20953924,20953958,20953997,20954036,20954098,20954128,20954299,20954372,20954415,20954458,20954494,20954649,20954677,20954718,20954760,20957727,20957767,20957803,20957840,20957874,20957919,20957958,20957992,20958151,20958185,20958230,20958266,20958298,20958345,20958542,20958576,20958605,20958652,20958682,20958733,20958765,20958794,20958832,20958882,20958993,20959021,20959068,2095917', 'assoc_port': '20948539:20948626,20948540:20948566,20948718:20948903,20948719:20948964,20948720:20949013,20948721:20948784,20948722:20948833,20949315:20949448,20949316:20949403,20949932:20954494,20949933:20953958,20949934:20951449,20949935:20951491,20949936:20951525,20949937:20951574,20949938:20951640,20949939:20954718,20949940:20951713,20949941:20950009,20949942:20951796,20949943:20949972,20950047:20951920,20950048:20951954,20950049:20951994,20950050:20950189,20950051:20950272,20950052:20950231,20950260:20950349,20950261:20950318,20950391:20952231,20950392:20952351,20950393:20954760,20950394:20954372,20950395:20950532,20950396:20950580,20950397:20950630,20950398:20950495,20950604:20950968,20950605:20952520,20950606:20950673,20950607:20950713,20950608:20953835,20950901:20952716,20950902:20952792,20950903:20952834,20950904:20952944,20950905:20952983,20950906:20953023,20950907:20953063,20950908:20953125,20950909:20953210,20950910:20953249,20950911:20953290,20950912:20953318,20950913:20953367,20950914:20953410,20950915:2095348', 'assoc_mat': '20948539:papier:4230:20948626,20948540:papier:4230:20948566,20948718:papier:4230:20948903,20948719:papier:4230:20948964,20948720:papier:4230:20949013,20948721:papier:4230:20948784,20948722:papier:4230:20948833,20949315:papier:4230:20949448,20949316:papier:4230:20949403,20949932:papier:4230:20954494,20949933:papier:4230:20953958,20949934:papier:4230:20951449,20949935:papier:4230:20951491,20949936:papier:4230:20951525,20949937:papier:4230:20951574,20949938:papier:4230:20951640,20949939:papier:4230:20954718,20949940:papier:4230:20951713,20949941:papier:4230:20950009,20949942:papier:4230:20951796,20949943:papier:4230:20949972,20950047:papier:4230:20951920,20950048:papier:4230:20951954,20950049:papier:4230:20951994,20950050:papier:4230:20950189,20950051:papier:4230:20950272,20950052:papier:4230:20950231,20950260:papier:4230:20950349,20950261:papier:4230:20950318,20950391:papier:4230:20952231,20950392:papier:4230:20952351,20950393:papier:4230:20954760,20950394:papier:4230:20954372,20950395:papier:4230:20950532,2095'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0016788964626927175, 'nb_photo': 4635, 'list_port_cont': '20948793,20949398,20949447,20951051,20951283,20951336,20951880,20952159,20952395,20952558,20952628,20952669,20952719,20952751,20952795,20952941,20952979,20953013,20953056,20953139,20953168,20953207,20953252,20953286,20953326,20953360,20953405,20953478,20953646,20953923,20954003,20954040,20954132,20954291,20954407,20954454,20954640,20954684,20958691,20958878,20958988,20959028,20959069,20959181,20959243,20959329,20959491,20960206,20976779,20978237,20981064,20983578,20985912,20986137,20986321,20986425,20986515,20986612,20987086,20987337,20987802,20987838,20993161,20993245,20993380,20993866,20994359,20994501,20995575,21000813,21006333,21007995,21008338,21008467,21008813,21016454,21020057,21020310,21020479,21020527,21020763,21021862,21021997,21022069,21022335,21022534,21022654,21022825,21022858,21022921,21023207,21023493,21023635,21023916,21024013,21024371,21025136,21025328,21025615,21026541,21026980,21027140,21059932,21061701,21063663,21064233,21065419,21069260,21071368,21074302,21074984,21075811,21076223,2108263', 'assoc_port': '20948721:20948793,20949315:20949447,20949316:20949398,20950901:20952719,20950902:20952795,20950904:20952941,20950905:20952979,20950906:20953013,20950907:20953056,20950908:20953139,20950909:20953207,20950910:20953252,20950911:20953286,20950912:20953326,20950913:20953360,20950914:20953405,20950915:20953478,20950916:20954684,20950917:20953923,20950918:20954640,20950919:20954454,20950920:20954407,20950921:20954291,20950922:20954040,20950923:20954132,20950924:20953646,20950927:20951051,20950928:20954003,20951089:20953168,20951090:20952669,20951091:20952751,20951092:20952395,20951093:20952628,20951094:20952558,20951095:20952159,20951097:20951336,20951099:20951880,20951101:20951283,20957604:20958691,20957607:20958878,20957608:20958988,20957609:20959028,20957610:20959069,20957611:20959181,20957612:20959329,20957613:20959243,20957616:20959491,20957628:20960206,20975749:21006333,20975751:20986137,20975753:20985912,20975755:20986515,20975757:20986321,20975760:20986425,20975762:20986612,20975768:20987086,20976681:2098733', 'assoc_mat': '20948721:pehd:4230:20948793,20949315:pehd:4230:20949447,20949316:pehd:4230:20949398,20950901:pehd:4230:20952719,20950902:pehd:4230:20952795,20950904:pehd:4230:20952941,20950905:pehd:4230:20952979,20950906:pehd:4230:20953013,20950907:pehd:4230:20953056,20950908:pehd:4230:20953139,20950909:pehd:4230:20953207,20950910:pehd:4230:20953252,20950911:pehd:4230:20953286,20950912:pehd:4230:20953326,20950913:pehd:4230:20953360,20950914:pehd:4230:20953405,20950915:pehd:4230:20953478,20950916:pehd:4230:20954684,20950917:pehd:4230:20953923,20950918:pehd:4230:20954640,20950919:pehd:4230:20954454,20950920:pehd:4230:20954407,20950921:pehd:4230:20954291,20950922:pehd:4230:20954040,20950923:pehd:4230:20954132,20950924:pehd:4230:20953646,20950927:pehd:4230:20951051,20950928:pehd:4230:20954003,20951089:pehd:4230:20953168,20951090:pehd:4230:20952669,20951091:pehd:4230:20952751,20951092:pehd:4230:20952395,20951093:pehd:4230:20952628,20951094:pehd:4230:20952558,20951095:pehd:4230:20952159,20951097:pehd:4230:20951336,20951099:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.008147825726366098, 'nb_photo': 111084, 'list_port_cont': '20948572,20948639,20948798,20948830,20948911,20948965,20949010,20949400,20949437,20949967,20949999,20950194,20950225,20950282,20950312,20950352,20950489,20950538,20950578,20950632,20950659,20950716,20950972,20951057,20951207,20951253,20951285,20951334,20951374,20951412,20951441,20951486,20951528,20951641,20951719,20951800,20951883,20951917,20951952,20952161,20952234,20952309,20952350,20952387,20952517,20952557,20952625,20952674,20952710,20952753,20952797,20952833,20952942,20952980,20953019,20953058,20953134,20953170,20953203,20953244,20953288,20953330,20953364,20953408,20953484,20953645,20953685,20953848,20953918,20953966,20954001,20954034,20954099,20954134,20954293,20954365,20954412,20954445,20954487,20954647,20954688,20954717,20954758,20957721,20957766,20957796,20957838,20957882,20957923,20957954,20957995,20958146,20958191,20958218,20958257,20958307,20958351,20958541,20958578,20958608,20958650,20958694,20958730,20958758,20958802,20958837,20958884,20958985,20959029,20959071,20959176,20959211,20959244,2095929', 'assoc_port': '20948539:20948639,20948540:20948572,20948718:20948911,20948719:20948965,20948720:20949010,20948721:20948798,20948722:20948830,20949315:20949437,20949316:20949400,20949932:20954487,20949933:20953966,20949934:20951441,20949935:20951486,20949936:20951528,20949938:20951641,20949939:20954717,20949940:20951719,20949941:20949999,20949942:20951800,20949943:20949967,20950047:20951917,20950048:20951952,20950050:20950194,20950051:20950282,20950052:20950225,20950260:20950352,20950261:20950312,20950391:20952234,20950392:20952350,20950393:20954758,20950394:20954365,20950395:20950538,20950396:20950578,20950397:20950632,20950398:20950489,20950604:20950972,20950605:20952517,20950606:20950659,20950607:20950716,20950608:20953848,20950901:20952710,20950902:20952797,20950903:20952833,20950904:20952942,20950905:20952980,20950906:20953019,20950907:20953058,20950908:20953134,20950909:20953203,20950910:20953244,20950911:20953288,20950912:20953330,20950913:20953364,20950914:20953408,20950915:20953484,20950916:20954688,20950917:2095391', 'assoc_mat': '20948539:pet_clair:4230:20948639,20948540:pet_clair:4230:20948572,20948718:pet_clair:4230:20948911,20948719:pet_clair:4230:20948965,20948720:pet_clair:4230:20949010,20948721:pet_clair:4230:20948798,20948722:pet_clair:4230:20948830,20949315:pet_clair:4230:20949437,20949316:pet_clair:4230:20949400,20949932:pet_clair:4230:20954487,20949933:pet_clair:4230:20953966,20949934:pet_clair:4230:20951441,20949935:pet_clair:4230:20951486,20949936:pet_clair:4230:20951528,20949938:pet_clair:4230:20951641,20949939:pet_clair:4230:20954717,20949940:pet_clair:4230:20951719,20949941:pet_clair:4230:20949999,20949942:pet_clair:4230:20951800,20949943:pet_clair:4230:20949967,20950047:pet_clair:4230:20951917,20950048:pet_clair:4230:20951952,20950050:pet_clair:4230:20950194,20950051:pet_clair:4230:20950282,20950052:pet_clair:4230:20950225,20950260:pet_clair:4230:20950352,20950261:pet_clair:4230:20950312,20950391:pet_clair:4230:20952234,20950392:pet_clair:4230:20952350,20950393:pet_clair:4230:20954758,20950394:pet_clair:4230:20954365,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0020363831593979533, 'nb_photo': 2469, 'list_port_cont': '20948800,20948960,20949011,20950976,20951403,20951951,20952389,20952548,20952672,20952750,20952939,20953171,20953291,20953476,20953647,20953920,20954042,20954137,20954414,20954457,20954644,20958803,20958876,20959025,20959398,20959834,20960050,20960207,20976257,20976474,20978226,20986514,20986800,20987338,20989354,20993670,20995695,20997322,20997838,20998615,21016459,21019514,21020531,21022342,21022828,21025137,21025614,21027237,21059939,21072681,21073910,21074307,21075805,21076230,21076982,21080425,21082598,21084327,21103663,21113935,21115015,21115950,21116268,21116541,21116696,21116731,21116760,21116952,21118796,21128949,21129524,21130051,21131337,21131438,21135199,21135405,21135874,21136454,21138270,21145852,21146213,21146417,21146560,21146793,21149490,21149809,21150207,21151642,21153976,21154789,21155161,21155270,21158750,21159344,21159652,21160033,21160391,21169342,21169666,21169720,21169922,21170523,21171322,21172090,21173066,21174665,21175250,21181984,21183552,21183619,21183693,21184258,21184395,2118479', 'assoc_port': '20948719:20948960,20948720:20949011,20948721:20948800,20950048:20951951,20950604:20950976,20950904:20952939,20950911:20953291,20950915:20953476,20950917:20953920,20950918:20954644,20950919:20954457,20950920:20954414,20950922:20954042,20950923:20954137,20950924:20953647,20951089:20953171,20951090:20952672,20951091:20952750,20951092:20952389,20951094:20952548,20951315:20951403,20957607:20958876,20957609:20959025,20957614:20959398,20957621:20959834,20957628:20960207,20957632:20960050,20957640:20958803,20975755:20986514,20975764:20986800,20975770:20976474,20975772:20976257,20976681:20987338,20976689:20978226,20982854:20995695,20985872:20997322,20986832:20997838,20987948:20998615,20988887:20993670,20988898:20989354,21007625:21020531,21008152:21022342,21008156:21022828,21008163:21074307,21008690:21025137,21008692:21025614,21012337:21059939,21013627:21016459,21017649:21019514,21021540:21073910,21022101:21072681,21023140:21027237,21064401:21103663,21074796:21113935,21074804:21115015,21075276:21115950,21075279:2111626', 'assoc_mat': '20948719:pet_fonce:4230:20948960,20948720:pet_fonce:4230:20949011,20948721:pet_fonce:4230:20948800,20950048:pet_fonce:4230:20951951,20950604:pet_fonce:4230:20950976,20950904:pet_fonce:4230:20952939,20950911:pet_fonce:4230:20953291,20950915:pet_fonce:4230:20953476,20950917:pet_fonce:4230:20953920,20950918:pet_fonce:4230:20954644,20950919:pet_fonce:4230:20954457,20950920:pet_fonce:4230:20954414,20950922:pet_fonce:4230:20954042,20950923:pet_fonce:4230:20954137,20950924:pet_fonce:4230:20953647,20951089:pet_fonce:4230:20953171,20951090:pet_fonce:4230:20952672,20951091:pet_fonce:4230:20952750,20951092:pet_fonce:4230:20952389,20951094:pet_fonce:4230:20952548,20951315:pet_fonce:4230:20951403,20957607:pet_fonce:4230:20958876,20957609:pet_fonce:4230:20959025,20957614:pet_fonce:4230:20959398,20957621:pet_fonce:4230:20959834,20957628:pet_fonce:4230:20960207,20957632:pet_fonce:4230:20960050,20957640:pet_fonce:4230:20958803,20975755:pet_fonce:4230:20986514,20975764:pet_fonce:4230:20986800,20975770:pet_fonce:4230:20976474,2'}), 'main_stat': {'nb_photos': 20314}}, 'hostname': (('raspi-84',),), 'impurety_average_per_hashtag': []} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((20314,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('truck', 20314),), 'material_dict': {'truck': 20314}, 'coverage_data': (('2025/03/22/', 0.96), ('2025/03/21/', 0.968067), ('2025/03/17/', 0.963344), ('2025/03/16/', 0.960868), ('2025/03/19/', 0.0), ('2025/03/18/', 0.967708), ('2025/03/15/', 0.96118), ('2025/03/20/', 0.965787), ('2025/03/14/', 0.968553), ('2025/03/13/', 0.967349), ('2025/03/12/', 0.963229), ('2025/03/11/', 0.964814), ('2025/03/10/', 0.962812), ('2025/03/09/', 0.963449), ('2025/03/08/', 0.965243), ('2025/03/07/', 0.968507), ('2025/03/06/', 0.965821), ('2025/03/05/', 0.967592), ('2025/03/04/', 0.96199), ('2025/03/03/', 0.969224), ('2025/03/02/', 0.965833), ('2025/03/01/', 0.963229)), 'impurety_average_data': ((datetime.date(2025, 3, 1), 0.22615668021737417, 415), (datetime.date(2025, 3, 2), 0.20289624018224373, 333), (datetime.date(2025, 3, 3), 0.24400958811822127, 770), (datetime.date(2025, 3, 4), 0.2442778658402637, 905), (datetime.date(2025, 3, 5), 0.23130958806032326, 788), (datetime.date(2025, 3, 6), 0.21812154893316538, 571), (datetime.date(2025, 3, 7), 0.24743006747913976, 450), (datetime.date(2025, 3, 8), 0.2310184375826634, 419), (datetime.date(2025, 3, 9), 0.24857972222748087, 206), (datetime.date(2025, 3, 10), 0.2003477764112011, 981), (datetime.date(2025, 3, 11), 0.2107162723160182, 1009), (datetime.date(2025, 3, 12), 0.19359399154314946, 1947), (datetime.date(2025, 3, 13), 0.19456655746628557, 1442), (datetime.date(2025, 3, 14), 0.2094613343033306, 1221), (datetime.date(2025, 3, 15), 0.2081203156923626, 276), (datetime.date(2025, 3, 17), 0.21374270724902483, 2752), (datetime.date(2025, 3, 18), 0.2140324630355527, 1195), (datetime.date(2025, 3, 19), 0.19408859436698742, 1537), (datetime.date(2025, 3, 20), 0.2272414693447885, 1208), (datetime.date(2025, 3, 21), 0.22725363207873797, 1499), (datetime.date(2025, 3, 22), 0.220904272540805, 390)), 'impurety_average_data_per_hashtag': {'truck': ((datetime.date(2025, 3, 1), 0.22615668021737417, 415), (datetime.date(2025, 3, 2), 0.20289624018224373, 333), (datetime.date(2025, 3, 3), 0.24400958811822127, 770), (datetime.date(2025, 3, 4), 0.2442778658402637, 905), (datetime.date(2025, 3, 5), 0.23130958806032326, 788), (datetime.date(2025, 3, 6), 0.21812154893316538, 571), (datetime.date(2025, 3, 7), 0.24743006747913976, 450), (datetime.date(2025, 3, 8), 0.2310184375826634, 419), (datetime.date(2025, 3, 9), 0.24857972222748087, 206), (datetime.date(2025, 3, 10), 0.2003477764112011, 981), (datetime.date(2025, 3, 11), 0.2107162723160182, 1009), (datetime.date(2025, 3, 12), 0.19359399154314946, 1947), (datetime.date(2025, 3, 13), 0.19456655746628557, 1442), (datetime.date(2025, 3, 14), 0.2094613343033306, 1221), (datetime.date(2025, 3, 15), 0.2081203156923626, 276), (datetime.date(2025, 3, 17), 0.21374270724902483, 2752), (datetime.date(2025, 3, 18), 0.2140324630355527, 1195), (datetime.date(2025, 3, 19), 0.19408859436698742, 1537), (datetime.date(2025, 3, 20), 0.2272414693447885, 1208), (datetime.date(2025, 3, 21), 0.22725363207873797, 1499), (datetime.date(2025, 3, 22), 0.220904272540805, 390))}, 'quality_array': [['-7.332591499420884', '01032025'], ['-7.527965001672397', '02032025'], ['-7.288773172531967', '03032025'], ['-7.2924351424164895', '04032025'], ['-7.542579563960059', '05032025'], ['-7.180283153449513', '06032025'], ['-7.665679012029117', '07032025'], ['-7.737731242657355', '08032025'], ['-7.603772649441217', '09032025'], ['-7.537159161841352', '10032025'], ['-7.529210941165527', '11032025'], ['-7.826957160517425', '12032025'], ['-7.826175733135817', '13032025'], ['-7.509666204407232', '14032025'], ['-7.361026477905734', '15032025'], ['-7.236109524665252', '17032025'], ['-7.4837862184070545', '18032025'], ['-7.467920025033016', '19032025'], ['-7.662978557379137', '20032025'], ['-7.587500734411645', '21032025'], ['-7.526178051003406', '22032025']], 'number_of_batch': ((2635,),), 'datou_id_sts': 4311, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.06188918859422815, 'nb_photo': 315842, 'list_port_cont': '20948574,20948630,20948791,20948838,20948910,20948966,20949015,20949409,20949439,20949973,20950004,20950193,20950218,20950281,20950305,20950361,20950496,20950526,20950567,20950618,20950672,20950710,20950973,20951043,20951196,20951247,20951288,20951319,20951367,20951400,20951433,20951490,20951517,20951562,20951633,20951708,20951748,20951789,20951873,20951907,20951946,20951989,20952155,20952230,20952299,20952346,20952380,20952511,20952544,20952629,20952671,20952717,20952742,20952790,20952831,20952947,20952975,20953012,20953055,20953128,20953172,20953212,20953242,20953276,20953320,20953371,20953393,20953479,20953651,20953695,20953842,20953909,20953956,20953989,20954039,20954087,20954135,20954294,20954358,20954410,20954444,20954482,20954634,20954674,20954709,20954749,20957715,20957765,20957797,20957833,20957870,20957925,20957953,20957980,20958152,20958179,20958217,20958252,20958310,20958337,20958526,20958564,20958606,20958656,20958686,20958723,20958754,20958799,20958842,20958877,20958995,20959031,20959061,2095916', 'assoc_port': '20948539:20948630,20948540:20948574,20948718:20948910,20948719:20948966,20948720:20949015,20948721:20948791,20948722:20948838,20949315:20949439,20949316:20949409,20949932:20954482,20949933:20953956,20949934:20951433,20949935:20951490,20949936:20951517,20949937:20951562,20949938:20951633,20949939:20954709,20949940:20951708,20949941:20950004,20949942:20951789,20949943:20949973,20950047:20951907,20950048:20951946,20950049:20951989,20950050:20950193,20950051:20950281,20950052:20950218,20950260:20950361,20950261:20950305,20950391:20952230,20950392:20952346,20950393:20954749,20950394:20954358,20950395:20950526,20950396:20950567,20950397:20950618,20950398:20950496,20950604:20950973,20950605:20952511,20950606:20950672,20950607:20950710,20950608:20953842,20950901:20952717,20950902:20952790,20950903:20952831,20950904:20952947,20950905:20952975,20950906:20953012,20950907:20953055,20950908:20953128,20950909:20953212,20950910:20953242,20950911:20953276,20950912:20953320,20950913:20953371,20950914:20953393,20950915:2095347', 'assoc_mat': '20948539:autre:4230:20948630,20948540:autre:4230:20948574,20948718:autre:4230:20948910,20948719:autre:4230:20948966,20948720:autre:4230:20949015,20948721:autre:4230:20948791,20948722:autre:4230:20948838,20949315:autre:4230:20949439,20949316:autre:4230:20949409,20949932:autre:4230:20954482,20949933:autre:4230:20953956,20949934:autre:4230:20951433,20949935:autre:4230:20951490,20949936:autre:4230:20951517,20949937:autre:4230:20951562,20949938:autre:4230:20951633,20949939:autre:4230:20954709,20949940:autre:4230:20951708,20949941:autre:4230:20950004,20949942:autre:4230:20951789,20949943:autre:4230:20949973,20950047:autre:4230:20951907,20950048:autre:4230:20951946,20950049:autre:4230:20951989,20950050:autre:4230:20950193,20950051:autre:4230:20950281,20950052:autre:4230:20950218,20950260:autre:4230:20950361,20950261:autre:4230:20950305,20950391:autre:4230:20952230,20950392:autre:4230:20952346,20950393:autre:4230:20954749,20950394:autre:4230:20954358,20950395:autre:4230:20950526,20950396:autre:4230:20950567,20950397:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.032777200571265354, 'nb_photo': 333800, 'list_port_cont': '20948563,20948628,20948790,20948836,20948901,20948955,20949014,20949405,20949445,20949971,20950014,20950190,20950230,20950278,20950309,20950363,20950491,20950541,20950572,20950621,20950670,20950705,20950966,20951056,20951205,20951249,20951287,20951327,20951368,20951414,20951444,20951488,20951530,20951569,20951637,20951721,20951751,20951793,20951878,20951921,20951941,20951992,20952165,20952228,20952303,20952338,20952392,20952518,20952560,20952619,20952666,20952706,20952749,20952798,20952835,20952948,20952981,20953020,20953060,20953136,20953175,20953206,20953245,20953279,20953331,20953366,20953401,20953481,20953642,20953689,20953836,20953921,20953962,20954004,20954038,20954095,20954136,20954298,20954369,20954409,20954453,20954495,20954646,20954687,20954712,20954763,20957729,20957760,20957795,20957837,20957881,20957924,20957955,20957988,20958145,20958187,20958225,20958261,20958309,20958341,20958537,20958577,20958615,20958651,20958680,20958728,20958766,20958805,20958843,20958874,20958987,20959034,20959058,2095917', 'assoc_port': '20948539:20948628,20948540:20948563,20948718:20948901,20948719:20948955,20948720:20949014,20948721:20948790,20948722:20948836,20949315:20949445,20949316:20949405,20949932:20954495,20949933:20953962,20949934:20951444,20949935:20951488,20949936:20951530,20949937:20951569,20949938:20951637,20949939:20954712,20949940:20951721,20949941:20950014,20949942:20951793,20949943:20949971,20950047:20951921,20950048:20951941,20950049:20951992,20950050:20950190,20950051:20950278,20950052:20950230,20950260:20950363,20950261:20950309,20950391:20952228,20950392:20952338,20950393:20954763,20950394:20954369,20950395:20950541,20950396:20950572,20950397:20950621,20950398:20950491,20950604:20950966,20950605:20952518,20950606:20950670,20950607:20950705,20950608:20953836,20950901:20952706,20950902:20952798,20950903:20952835,20950904:20952948,20950905:20952981,20950906:20953020,20950907:20953060,20950908:20953136,20950909:20953206,20950910:20953245,20950911:20953279,20950912:20953331,20950913:20953366,20950914:20953401,20950915:2095348', 'assoc_mat': '20948539:carton:4230:20948628,20948540:carton:4230:20948563,20948718:carton:4230:20948901,20948719:carton:4230:20948955,20948720:carton:4230:20949014,20948721:carton:4230:20948790,20948722:carton:4230:20948836,20949315:carton:4230:20949445,20949316:carton:4230:20949405,20949932:carton:4230:20954495,20949933:carton:4230:20953962,20949934:carton:4230:20951444,20949935:carton:4230:20951488,20949936:carton:4230:20951530,20949937:carton:4230:20951569,20949938:carton:4230:20951637,20949939:carton:4230:20954712,20949940:carton:4230:20951721,20949941:carton:4230:20950014,20949942:carton:4230:20951793,20949943:carton:4230:20949971,20950047:carton:4230:20951921,20950048:carton:4230:20951941,20950049:carton:4230:20951992,20950050:carton:4230:20950190,20950051:carton:4230:20950278,20950052:carton:4230:20950230,20950260:carton:4230:20950363,20950261:carton:4230:20950309,20950391:carton:4230:20952228,20950392:carton:4230:20952338,20950393:carton:4230:20954763,20950394:carton:4230:20954369,20950395:carton:4230:20950541,2095'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.009360726606855146, 'nb_photo': 10666, 'list_port_cont': '20948562,20948640,20948792,20948839,20948967,20949002,20950186,20950356,20950497,20950539,20950627,20950671,20950959,20951040,20951209,20951289,20951326,20951358,20951409,20951435,20951485,20951526,20951760,20951866,20951909,20951945,20951987,20952162,20952314,20952348,20952391,20952516,20952559,20952627,20952670,20952738,20952789,20952819,20952937,20952974,20953010,20953165,20953202,20953250,20953285,20953329,20953356,20953407,20953472,20953640,20953693,20953837,20953917,20953959,20954005,20954124,20954302,20954367,20954399,20954441,20954651,20954675,20957794,20957835,20958231,20958265,20958296,20958348,20958530,20958677,20958731,20958768,20958798,20958827,20958875,20958996,20959033,20959277,20959331,20959527,20959791,20959827,20959873,20959909,20960158,20960193,20960236,20976250,20976466,20976736,20976771,20977002,20978223,20980826,20981065,20981302,20982624,20982721,20982946,20983307,20983431,20984671,20985418,20985908,20986122,20986323,20986420,20986509,20986605,20986787,20987095,20987335,20987501,2098780', 'assoc_port': '20948539:20948640,20948540:20948562,20948719:20948967,20948720:20949002,20948721:20948792,20948722:20948839,20949933:20953959,20949934:20951435,20949935:20951485,20949936:20951526,20950047:20951909,20950048:20951945,20950049:20951987,20950050:20950186,20950260:20950356,20950392:20952348,20950394:20954367,20950395:20950539,20950397:20950627,20950398:20950497,20950604:20950959,20950605:20952516,20950606:20950671,20950608:20953837,20950902:20952789,20950903:20952819,20950904:20952937,20950905:20952974,20950906:20953010,20950909:20953202,20950910:20953250,20950911:20953285,20950912:20953329,20950913:20953356,20950914:20953407,20950915:20953472,20950916:20954675,20950917:20953917,20950918:20954651,20950919:20954441,20950920:20954399,20950921:20954302,20950923:20954124,20950924:20953640,20950926:20953693,20950927:20951040,20950928:20954005,20951089:20953165,20951090:20952670,20951091:20952738,20951092:20952391,20951093:20952627,20951094:20952559,20951095:20952162,20951096:20952314,20951097:20951326,20951098:2095176', 'assoc_mat': '20948539:metal:4230:20948640,20948540:metal:4230:20948562,20948719:metal:4230:20948967,20948720:metal:4230:20949002,20948721:metal:4230:20948792,20948722:metal:4230:20948839,20949933:metal:4230:20953959,20949934:metal:4230:20951435,20949935:metal:4230:20951485,20949936:metal:4230:20951526,20950047:metal:4230:20951909,20950048:metal:4230:20951945,20950049:metal:4230:20951987,20950050:metal:4230:20950186,20950260:metal:4230:20950356,20950392:metal:4230:20952348,20950394:metal:4230:20954367,20950395:metal:4230:20950539,20950397:metal:4230:20950627,20950398:metal:4230:20950497,20950604:metal:4230:20950959,20950605:metal:4230:20952516,20950606:metal:4230:20950671,20950608:metal:4230:20953837,20950902:metal:4230:20952789,20950903:metal:4230:20952819,20950904:metal:4230:20952937,20950905:metal:4230:20952974,20950906:metal:4230:20953010,20950909:metal:4230:20953202,20950910:metal:4230:20953250,20950911:metal:4230:20953285,20950912:metal:4230:20953329,20950913:metal:4230:20953356,20950914:metal:4230:20953407,20950915:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.10981529340151892, 'nb_photo': 863272, 'list_port_cont': '20948566,20948626,20948784,20948833,20948903,20948964,20949013,20949403,20949448,20949972,20950009,20950189,20950231,20950272,20950318,20950349,20950495,20950532,20950580,20950630,20950673,20950713,20950968,20951046,20951208,20951244,20951290,20951333,20951366,20951411,20951449,20951491,20951525,20951574,20951640,20951713,20951763,20951796,20951882,20951920,20951954,20951994,20952160,20952231,20952315,20952351,20952383,20952520,20952549,20952633,20952677,20952716,20952755,20952792,20952834,20952944,20952983,20953023,20953063,20953125,20953173,20953210,20953249,20953290,20953318,20953367,20953410,20953485,20953649,20953688,20953835,20953924,20953958,20953997,20954036,20954098,20954128,20954299,20954372,20954415,20954458,20954494,20954649,20954677,20954718,20954760,20957727,20957767,20957803,20957840,20957874,20957919,20957958,20957992,20958151,20958185,20958230,20958266,20958298,20958345,20958542,20958576,20958605,20958652,20958682,20958733,20958765,20958794,20958832,20958882,20958993,20959021,20959068,2095917', 'assoc_port': '20948539:20948626,20948540:20948566,20948718:20948903,20948719:20948964,20948720:20949013,20948721:20948784,20948722:20948833,20949315:20949448,20949316:20949403,20949932:20954494,20949933:20953958,20949934:20951449,20949935:20951491,20949936:20951525,20949937:20951574,20949938:20951640,20949939:20954718,20949940:20951713,20949941:20950009,20949942:20951796,20949943:20949972,20950047:20951920,20950048:20951954,20950049:20951994,20950050:20950189,20950051:20950272,20950052:20950231,20950260:20950349,20950261:20950318,20950391:20952231,20950392:20952351,20950393:20954760,20950394:20954372,20950395:20950532,20950396:20950580,20950397:20950630,20950398:20950495,20950604:20950968,20950605:20952520,20950606:20950673,20950607:20950713,20950608:20953835,20950901:20952716,20950902:20952792,20950903:20952834,20950904:20952944,20950905:20952983,20950906:20953023,20950907:20953063,20950908:20953125,20950909:20953210,20950910:20953249,20950911:20953290,20950912:20953318,20950913:20953367,20950914:20953410,20950915:2095348', 'assoc_mat': '20948539:papier:4230:20948626,20948540:papier:4230:20948566,20948718:papier:4230:20948903,20948719:papier:4230:20948964,20948720:papier:4230:20949013,20948721:papier:4230:20948784,20948722:papier:4230:20948833,20949315:papier:4230:20949448,20949316:papier:4230:20949403,20949932:papier:4230:20954494,20949933:papier:4230:20953958,20949934:papier:4230:20951449,20949935:papier:4230:20951491,20949936:papier:4230:20951525,20949937:papier:4230:20951574,20949938:papier:4230:20951640,20949939:papier:4230:20954718,20949940:papier:4230:20951713,20949941:papier:4230:20950009,20949942:papier:4230:20951796,20949943:papier:4230:20949972,20950047:papier:4230:20951920,20950048:papier:4230:20951954,20950049:papier:4230:20951994,20950050:papier:4230:20950189,20950051:papier:4230:20950272,20950052:papier:4230:20950231,20950260:papier:4230:20950349,20950261:papier:4230:20950318,20950391:papier:4230:20952231,20950392:papier:4230:20952351,20950393:papier:4230:20954760,20950394:papier:4230:20954372,20950395:papier:4230:20950532,2095'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0016788964626927175, 'nb_photo': 4635, 'list_port_cont': '20948793,20949398,20949447,20951051,20951283,20951336,20951880,20952159,20952395,20952558,20952628,20952669,20952719,20952751,20952795,20952941,20952979,20953013,20953056,20953139,20953168,20953207,20953252,20953286,20953326,20953360,20953405,20953478,20953646,20953923,20954003,20954040,20954132,20954291,20954407,20954454,20954640,20954684,20958691,20958878,20958988,20959028,20959069,20959181,20959243,20959329,20959491,20960206,20976779,20978237,20981064,20983578,20985912,20986137,20986321,20986425,20986515,20986612,20987086,20987337,20987802,20987838,20993161,20993245,20993380,20993866,20994359,20994501,20995575,21000813,21006333,21007995,21008338,21008467,21008813,21016454,21020057,21020310,21020479,21020527,21020763,21021862,21021997,21022069,21022335,21022534,21022654,21022825,21022858,21022921,21023207,21023493,21023635,21023916,21024013,21024371,21025136,21025328,21025615,21026541,21026980,21027140,21059932,21061701,21063663,21064233,21065419,21069260,21071368,21074302,21074984,21075811,21076223,2108263', 'assoc_port': '20948721:20948793,20949315:20949447,20949316:20949398,20950901:20952719,20950902:20952795,20950904:20952941,20950905:20952979,20950906:20953013,20950907:20953056,20950908:20953139,20950909:20953207,20950910:20953252,20950911:20953286,20950912:20953326,20950913:20953360,20950914:20953405,20950915:20953478,20950916:20954684,20950917:20953923,20950918:20954640,20950919:20954454,20950920:20954407,20950921:20954291,20950922:20954040,20950923:20954132,20950924:20953646,20950927:20951051,20950928:20954003,20951089:20953168,20951090:20952669,20951091:20952751,20951092:20952395,20951093:20952628,20951094:20952558,20951095:20952159,20951097:20951336,20951099:20951880,20951101:20951283,20957604:20958691,20957607:20958878,20957608:20958988,20957609:20959028,20957610:20959069,20957611:20959181,20957612:20959329,20957613:20959243,20957616:20959491,20957628:20960206,20975749:21006333,20975751:20986137,20975753:20985912,20975755:20986515,20975757:20986321,20975760:20986425,20975762:20986612,20975768:20987086,20976681:2098733', 'assoc_mat': '20948721:pehd:4230:20948793,20949315:pehd:4230:20949447,20949316:pehd:4230:20949398,20950901:pehd:4230:20952719,20950902:pehd:4230:20952795,20950904:pehd:4230:20952941,20950905:pehd:4230:20952979,20950906:pehd:4230:20953013,20950907:pehd:4230:20953056,20950908:pehd:4230:20953139,20950909:pehd:4230:20953207,20950910:pehd:4230:20953252,20950911:pehd:4230:20953286,20950912:pehd:4230:20953326,20950913:pehd:4230:20953360,20950914:pehd:4230:20953405,20950915:pehd:4230:20953478,20950916:pehd:4230:20954684,20950917:pehd:4230:20953923,20950918:pehd:4230:20954640,20950919:pehd:4230:20954454,20950920:pehd:4230:20954407,20950921:pehd:4230:20954291,20950922:pehd:4230:20954040,20950923:pehd:4230:20954132,20950924:pehd:4230:20953646,20950927:pehd:4230:20951051,20950928:pehd:4230:20954003,20951089:pehd:4230:20953168,20951090:pehd:4230:20952669,20951091:pehd:4230:20952751,20951092:pehd:4230:20952395,20951093:pehd:4230:20952628,20951094:pehd:4230:20952558,20951095:pehd:4230:20952159,20951097:pehd:4230:20951336,20951099:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.008147825726366098, 'nb_photo': 111084, 'list_port_cont': '20948572,20948639,20948798,20948830,20948911,20948965,20949010,20949400,20949437,20949967,20949999,20950194,20950225,20950282,20950312,20950352,20950489,20950538,20950578,20950632,20950659,20950716,20950972,20951057,20951207,20951253,20951285,20951334,20951374,20951412,20951441,20951486,20951528,20951641,20951719,20951800,20951883,20951917,20951952,20952161,20952234,20952309,20952350,20952387,20952517,20952557,20952625,20952674,20952710,20952753,20952797,20952833,20952942,20952980,20953019,20953058,20953134,20953170,20953203,20953244,20953288,20953330,20953364,20953408,20953484,20953645,20953685,20953848,20953918,20953966,20954001,20954034,20954099,20954134,20954293,20954365,20954412,20954445,20954487,20954647,20954688,20954717,20954758,20957721,20957766,20957796,20957838,20957882,20957923,20957954,20957995,20958146,20958191,20958218,20958257,20958307,20958351,20958541,20958578,20958608,20958650,20958694,20958730,20958758,20958802,20958837,20958884,20958985,20959029,20959071,20959176,20959211,20959244,2095929', 'assoc_port': '20948539:20948639,20948540:20948572,20948718:20948911,20948719:20948965,20948720:20949010,20948721:20948798,20948722:20948830,20949315:20949437,20949316:20949400,20949932:20954487,20949933:20953966,20949934:20951441,20949935:20951486,20949936:20951528,20949938:20951641,20949939:20954717,20949940:20951719,20949941:20949999,20949942:20951800,20949943:20949967,20950047:20951917,20950048:20951952,20950050:20950194,20950051:20950282,20950052:20950225,20950260:20950352,20950261:20950312,20950391:20952234,20950392:20952350,20950393:20954758,20950394:20954365,20950395:20950538,20950396:20950578,20950397:20950632,20950398:20950489,20950604:20950972,20950605:20952517,20950606:20950659,20950607:20950716,20950608:20953848,20950901:20952710,20950902:20952797,20950903:20952833,20950904:20952942,20950905:20952980,20950906:20953019,20950907:20953058,20950908:20953134,20950909:20953203,20950910:20953244,20950911:20953288,20950912:20953330,20950913:20953364,20950914:20953408,20950915:20953484,20950916:20954688,20950917:2095391', 'assoc_mat': '20948539:pet_clair:4230:20948639,20948540:pet_clair:4230:20948572,20948718:pet_clair:4230:20948911,20948719:pet_clair:4230:20948965,20948720:pet_clair:4230:20949010,20948721:pet_clair:4230:20948798,20948722:pet_clair:4230:20948830,20949315:pet_clair:4230:20949437,20949316:pet_clair:4230:20949400,20949932:pet_clair:4230:20954487,20949933:pet_clair:4230:20953966,20949934:pet_clair:4230:20951441,20949935:pet_clair:4230:20951486,20949936:pet_clair:4230:20951528,20949938:pet_clair:4230:20951641,20949939:pet_clair:4230:20954717,20949940:pet_clair:4230:20951719,20949941:pet_clair:4230:20949999,20949942:pet_clair:4230:20951800,20949943:pet_clair:4230:20949967,20950047:pet_clair:4230:20951917,20950048:pet_clair:4230:20951952,20950050:pet_clair:4230:20950194,20950051:pet_clair:4230:20950282,20950052:pet_clair:4230:20950225,20950260:pet_clair:4230:20950352,20950261:pet_clair:4230:20950312,20950391:pet_clair:4230:20952234,20950392:pet_clair:4230:20952350,20950393:pet_clair:4230:20954758,20950394:pet_clair:4230:20954365,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0020363831593979533, 'nb_photo': 2469, 'list_port_cont': '20948800,20948960,20949011,20950976,20951403,20951951,20952389,20952548,20952672,20952750,20952939,20953171,20953291,20953476,20953647,20953920,20954042,20954137,20954414,20954457,20954644,20958803,20958876,20959025,20959398,20959834,20960050,20960207,20976257,20976474,20978226,20986514,20986800,20987338,20989354,20993670,20995695,20997322,20997838,20998615,21016459,21019514,21020531,21022342,21022828,21025137,21025614,21027237,21059939,21072681,21073910,21074307,21075805,21076230,21076982,21080425,21082598,21084327,21103663,21113935,21115015,21115950,21116268,21116541,21116696,21116731,21116760,21116952,21118796,21128949,21129524,21130051,21131337,21131438,21135199,21135405,21135874,21136454,21138270,21145852,21146213,21146417,21146560,21146793,21149490,21149809,21150207,21151642,21153976,21154789,21155161,21155270,21158750,21159344,21159652,21160033,21160391,21169342,21169666,21169720,21169922,21170523,21171322,21172090,21173066,21174665,21175250,21181984,21183552,21183619,21183693,21184258,21184395,2118479', 'assoc_port': '20948719:20948960,20948720:20949011,20948721:20948800,20950048:20951951,20950604:20950976,20950904:20952939,20950911:20953291,20950915:20953476,20950917:20953920,20950918:20954644,20950919:20954457,20950920:20954414,20950922:20954042,20950923:20954137,20950924:20953647,20951089:20953171,20951090:20952672,20951091:20952750,20951092:20952389,20951094:20952548,20951315:20951403,20957607:20958876,20957609:20959025,20957614:20959398,20957621:20959834,20957628:20960207,20957632:20960050,20957640:20958803,20975755:20986514,20975764:20986800,20975770:20976474,20975772:20976257,20976681:20987338,20976689:20978226,20982854:20995695,20985872:20997322,20986832:20997838,20987948:20998615,20988887:20993670,20988898:20989354,21007625:21020531,21008152:21022342,21008156:21022828,21008163:21074307,21008690:21025137,21008692:21025614,21012337:21059939,21013627:21016459,21017649:21019514,21021540:21073910,21022101:21072681,21023140:21027237,21064401:21103663,21074796:21113935,21074804:21115015,21075276:21115950,21075279:2111626', 'assoc_mat': '20948719:pet_fonce:4230:20948960,20948720:pet_fonce:4230:20949011,20948721:pet_fonce:4230:20948800,20950048:pet_fonce:4230:20951951,20950604:pet_fonce:4230:20950976,20950904:pet_fonce:4230:20952939,20950911:pet_fonce:4230:20953291,20950915:pet_fonce:4230:20953476,20950917:pet_fonce:4230:20953920,20950918:pet_fonce:4230:20954644,20950919:pet_fonce:4230:20954457,20950920:pet_fonce:4230:20954414,20950922:pet_fonce:4230:20954042,20950923:pet_fonce:4230:20954137,20950924:pet_fonce:4230:20953647,20951089:pet_fonce:4230:20953171,20951090:pet_fonce:4230:20952672,20951091:pet_fonce:4230:20952750,20951092:pet_fonce:4230:20952389,20951094:pet_fonce:4230:20952548,20951315:pet_fonce:4230:20951403,20957607:pet_fonce:4230:20958876,20957609:pet_fonce:4230:20959025,20957614:pet_fonce:4230:20959398,20957621:pet_fonce:4230:20959834,20957628:pet_fonce:4230:20960207,20957632:pet_fonce:4230:20960050,20957640:pet_fonce:4230:20958803,20975755:pet_fonce:4230:20986514,20975764:pet_fonce:4230:20986800,20975770:pet_fonce:4230:20976474,2'}), 'main_stat': {'nb_photos': 20314}}, 'hostname': (('raspi-84',),), 'impurety_average_per_hashtag': []} filepath : /data_2/data_log/job/memo/dechet_Valcor_v2/sla_mensuel_dechet_Valcor_v2_mois_03_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'truck': {'autre': ['autre', '6.19%', 315842], 'carton': ['carton', '3.28%', 333800], 'metal': ['metal', '0.94%', 10666], 'papier': ['papier', '10.98%', 863272], 'pehd': ['pehd', '0.17%', 4635], 'pet_clair': ['pet_clair', '0.81%', 111084], 'pet_fonce': ['pet_fonce', '0.2%', 2469]}} before organize_and_plot_coverage_data Warning a wrong coverage has been found : 0.0 before organize_and_plot_impurety_average_data before organize_and_plot_quality_photo_data finish generating filepath : /data_2/data_log/job/memo/dechet_Valcor_v2/sla_mensuel_dechet_Valcor_v2_mois_03_annee_2025.pdf le fichier se trouve ici : /data_2/data_log/job/memo/dechet_Valcor_v2 3.08user 2.43system 0:29.40elapsed 18%CPU (0avgtext+0avgdata 195016maxresident)k 21848inputs+624outputs (109major+74863minor)pagefaults 0swaps