python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=20084 --dashboard_places=dechet_Valcor_v2 --rootfolder_sla=/data_4/data_log/job/memo/dechet_Valcor_v2 -v --mtr_id=1055 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 20084, Date : 2025-10 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (2, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (2, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 132 month : 10 mtr_id : 1055 dashboard_places : dechet_Valcor_v2 date : 2025-10 year : 2025 raspi : 20084 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'dechet_Valcor_v2' and date like '%2025-10%') and created_at like '%2025-10%'))); nb_day : (2, 31) after unwanted_material_data nb_day : (2, 31) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%20084%' AND ms.result_str like '%2025/10%'ORDER BY ms.id desc LIMIT 0, 1000000; No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1959, 'nb_two_criteria_ok': 1959, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 161, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 305, 'end_of_day_photos_uploaded': 1650, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/10/18', 'portfolio_id': 27899314, 'last_run_id': 2476265, 'total_number_of_photos': 2547}} No error ? {'log_dict': {'total_nb_images': 2122, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21220 seconds', 'coverage_times_pause': '0 days 42440 seconds', 'nb_photos_decision': 2123, 'nb_gray_level_ok': 2123, 'nb_dedup_ok': 1970, 'nb_two_criteria_ok': 1970, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 153, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1965, 'ratio_coverage': 0.24560469449877892}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 136, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 27, 'nb_images_started': 261, 'nb_selected_images': 397, 'last_update': '2025/10/18', 'portfolio_id': 27870487, 'last_run_id': 2475575, 'total_number_of_photos': 1997}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1926, 'nb_two_criteria_ok': 1926, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 194, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1923, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 9, 'nb_images_finished': 34, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 22, 'nb_images_started': 177, 'nb_selected_images': 211, 'last_update': '2025/10/18', 'portfolio_id': 27856690, 'last_run_id': 2475571, 'total_number_of_photos': 1929}} No error ? {'log_dict': {'total_nb_images': 2123, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21230 seconds', 'coverage_times_pause': '0 days 42460 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 1881, 'nb_two_criteria_ok': 1881, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 243, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1876, 'ratio_coverage': 0.24572043657912707}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 284, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 284, 'last_update': '2025/10/17', 'portfolio_id': 27820944, 'last_run_id': 2470195, 'total_number_of_photos': 1881}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1950, 'nb_two_criteria_ok': 1950, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 170, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1946, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 60, 'nb_images_finished': 380, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 380, 'last_update': '2025/10/15', 'portfolio_id': 27779905, 'last_run_id': 2460335, 'total_number_of_photos': 1948}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2117, 'nb_gray_level_ok': 2117, 'nb_dedup_ok': 1919, 'nb_two_criteria_ok': 1919, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 198, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1916, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2025/10/14', 'portfolio_id': 27747557, 'last_run_id': 2452591, 'total_number_of_photos': 1921}} No error ? {'log_dict': {'total_nb_images': 2124, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21240 seconds', 'coverage_times_pause': '0 days 42480 seconds', 'nb_photos_decision': 2127, 'nb_gray_level_ok': 2127, 'nb_dedup_ok': 1846, 'nb_two_criteria_ok': 1846, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 281, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1840, 'ratio_coverage': 0.2458361786594752}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 176, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 176, 'last_update': '2025/10/13', 'portfolio_id': 27740977, 'last_run_id': 2443085, 'total_number_of_photos': 1844}} No error ? {'log_dict': {'total_nb_images': 2122, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21220 seconds', 'coverage_times_pause': '0 days 42440 seconds', 'nb_photos_decision': 2123, 'nb_gray_level_ok': 2123, 'nb_dedup_ok': 1970, 'nb_two_criteria_ok': 1970, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 153, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1965, 'ratio_coverage': 0.24560469449877892}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 117, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 19, 'nb_selected_images': 136, 'last_update': '2025/10/17', 'portfolio_id': 27870487, 'last_run_id': 2471373, 'total_number_of_photos': 1993}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1926, 'nb_two_criteria_ok': 1926, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 194, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1923, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 15, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 23, 'nb_selected_images': 38, 'last_update': '2025/10/17', 'portfolio_id': 27856690, 'last_run_id': 2469057, 'total_number_of_photos': 1929}} No error ? {'log_dict': {'total_nb_images': 2123, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21230 seconds', 'coverage_times_pause': '0 days 42460 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 1881, 'nb_two_criteria_ok': 1881, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 243, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1876, 'ratio_coverage': 0.24572043657912707}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 284, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 284, 'last_update': '2025/10/17', 'portfolio_id': 27820944, 'last_run_id': 2470195, 'total_number_of_photos': 1881}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1950, 'nb_two_criteria_ok': 1950, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 170, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1946, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 60, 'nb_images_finished': 380, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 380, 'last_update': '2025/10/15', 'portfolio_id': 27779905, 'last_run_id': 2460335, 'total_number_of_photos': 1948}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2117, 'nb_gray_level_ok': 2117, 'nb_dedup_ok': 1919, 'nb_two_criteria_ok': 1919, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 198, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1916, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2025/10/14', 'portfolio_id': 27747557, 'last_run_id': 2452591, 'total_number_of_photos': 1921}} No error ? {'log_dict': {'total_nb_images': 2124, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21240 seconds', 'coverage_times_pause': '0 days 42480 seconds', 'nb_photos_decision': 2127, 'nb_gray_level_ok': 2127, 'nb_dedup_ok': 1846, 'nb_two_criteria_ok': 1846, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 281, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1840, 'ratio_coverage': 0.2458361786594752}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 176, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 176, 'last_update': '2025/10/13', 'portfolio_id': 27740977, 'last_run_id': 2443085, 'total_number_of_photos': 1844}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1809, 'nb_two_criteria_ok': 1809, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 310, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1804, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 332, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 332, 'last_update': '2025/10/12', 'portfolio_id': 27722258, 'last_run_id': 2442295, 'total_number_of_photos': 1810}} No error ? {'log_dict': {'total_nb_images': 2123, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21230 seconds', 'coverage_times_pause': '0 days 42460 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 1881, 'nb_two_criteria_ok': 1881, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 243, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1876, 'ratio_coverage': 0.24572043657912707}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 284, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 284, 'last_update': '2025/10/15', 'portfolio_id': 27820944, 'last_run_id': 2464527, 'total_number_of_photos': 1881}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1950, 'nb_two_criteria_ok': 1950, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 170, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1946, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 60, 'nb_images_finished': 380, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 380, 'last_update': '2025/10/15', 'portfolio_id': 27779905, 'last_run_id': 2460335, 'total_number_of_photos': 1948}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2117, 'nb_gray_level_ok': 2117, 'nb_dedup_ok': 1919, 'nb_two_criteria_ok': 1919, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 198, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1916, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2025/10/14', 'portfolio_id': 27747557, 'last_run_id': 2452591, 'total_number_of_photos': 1921}} No error ? {'log_dict': {'total_nb_images': 2124, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21240 seconds', 'coverage_times_pause': '0 days 42480 seconds', 'nb_photos_decision': 2127, 'nb_gray_level_ok': 2127, 'nb_dedup_ok': 1846, 'nb_two_criteria_ok': 1846, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 281, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1840, 'ratio_coverage': 0.2458361786594752}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 176, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 176, 'last_update': '2025/10/13', 'portfolio_id': 27740977, 'last_run_id': 2443085, 'total_number_of_photos': 1844}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1809, 'nb_two_criteria_ok': 1809, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 310, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1804, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 332, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 332, 'last_update': '2025/10/12', 'portfolio_id': 27722258, 'last_run_id': 2442295, 'total_number_of_photos': 1810}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1829, 'nb_two_criteria_ok': 1829, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 292, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1824, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 27, 'nb_images_finished': 182, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 182, 'last_update': '2025/10/11', 'portfolio_id': 27673418, 'last_run_id': 2438807, 'total_number_of_photos': 1828}} No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1937, 'nb_two_criteria_ok': 1937, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 182, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1934, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 396, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 396, 'last_update': '2025/10/15', 'portfolio_id': 27621800, 'last_run_id': 2460911, 'total_number_of_photos': 1940}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1950, 'nb_two_criteria_ok': 1950, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 170, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1946, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 60, 'nb_images_finished': 380, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 380, 'last_update': '2025/10/15', 'portfolio_id': 27779905, 'last_run_id': 2458889, 'total_number_of_photos': 1948}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2117, 'nb_gray_level_ok': 2117, 'nb_dedup_ok': 1919, 'nb_two_criteria_ok': 1919, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 198, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1916, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2025/10/14', 'portfolio_id': 27747557, 'last_run_id': 2452591, 'total_number_of_photos': 1921}} No error ? {'log_dict': {'total_nb_images': 2124, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21240 seconds', 'coverage_times_pause': '0 days 42480 seconds', 'nb_photos_decision': 2127, 'nb_gray_level_ok': 2127, 'nb_dedup_ok': 1846, 'nb_two_criteria_ok': 1846, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 281, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1840, 'ratio_coverage': 0.2458361786594752}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 176, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 176, 'last_update': '2025/10/13', 'portfolio_id': 27740977, 'last_run_id': 2443085, 'total_number_of_photos': 1844}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1809, 'nb_two_criteria_ok': 1809, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 310, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1804, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 332, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 332, 'last_update': '2025/10/12', 'portfolio_id': 27722258, 'last_run_id': 2442295, 'total_number_of_photos': 1810}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1829, 'nb_two_criteria_ok': 1829, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 292, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1824, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 27, 'nb_images_finished': 182, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 182, 'last_update': '2025/10/11', 'portfolio_id': 27673418, 'last_run_id': 2438807, 'total_number_of_photos': 1828}} No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1937, 'nb_two_criteria_ok': 1937, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 182, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1934, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 396, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 396, 'last_update': '2025/10/14', 'portfolio_id': 27621800, 'last_run_id': 2453591, 'total_number_of_photos': 1940}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1995, 'nb_two_criteria_ok': 1995, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 126, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1990, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 77, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 304, 'nb_selected_images': 381, 'last_update': '2025/10/09', 'portfolio_id': 27572927, 'last_run_id': 2423417, 'total_number_of_photos': 1995}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2117, 'nb_gray_level_ok': 2117, 'nb_dedup_ok': 1919, 'nb_two_criteria_ok': 1919, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 198, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1916, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2025/10/14', 'portfolio_id': 27747557, 'last_run_id': 2451747, 'total_number_of_photos': 1921}} No error ? {'log_dict': {'total_nb_images': 2124, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21240 seconds', 'coverage_times_pause': '0 days 42480 seconds', 'nb_photos_decision': 2127, 'nb_gray_level_ok': 2127, 'nb_dedup_ok': 1846, 'nb_two_criteria_ok': 1846, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 281, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1840, 'ratio_coverage': 0.2458361786594752}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 176, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 176, 'last_update': '2025/10/13', 'portfolio_id': 27740977, 'last_run_id': 2443085, 'total_number_of_photos': 1844}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1809, 'nb_two_criteria_ok': 1809, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 310, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1804, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 332, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 332, 'last_update': '2025/10/12', 'portfolio_id': 27722258, 'last_run_id': 2442295, 'total_number_of_photos': 1810}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1829, 'nb_two_criteria_ok': 1829, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 292, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1824, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 27, 'nb_images_finished': 182, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 182, 'last_update': '2025/10/11', 'portfolio_id': 27673418, 'last_run_id': 2438807, 'total_number_of_photos': 1828}} No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1937, 'nb_two_criteria_ok': 1937, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 182, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1934, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/10/13', 'portfolio_id': 27617194, 'last_run_id': 2444941, 'total_number_of_photos': 1218}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1995, 'nb_two_criteria_ok': 1995, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 126, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1990, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 77, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 304, 'nb_selected_images': 381, 'last_update': '2025/10/09', 'portfolio_id': 27572927, 'last_run_id': 2423417, 'total_number_of_photos': 1995}} No error ? {'log_dict': {'total_nb_images': 2123, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21230 seconds', 'coverage_times_pause': '0 days 42460 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 2010, 'nb_two_criteria_ok': 2010, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 115, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2004, 'ratio_coverage': 0.24572043657912707}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 9, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 72, 'nb_images_started': 396, 'nb_selected_images': 405, 'last_update': '2025/10/10', 'portfolio_id': 27546740, 'last_run_id': 2422741, 'total_number_of_photos': 2009}} No error ? {'log_dict': {'total_nb_images': 2124, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21240 seconds', 'coverage_times_pause': '0 days 42480 seconds', 'nb_photos_decision': 2127, 'nb_gray_level_ok': 2127, 'nb_dedup_ok': 1846, 'nb_two_criteria_ok': 1846, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 281, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1840, 'ratio_coverage': 0.2458361786594752}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 176, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 176, 'last_update': '2025/10/13', 'portfolio_id': 27740977, 'last_run_id': 2443085, 'total_number_of_photos': 1844}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1809, 'nb_two_criteria_ok': 1809, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 310, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1804, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 332, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 332, 'last_update': '2025/10/12', 'portfolio_id': 27722258, 'last_run_id': 2442295, 'total_number_of_photos': 1810}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1829, 'nb_two_criteria_ok': 1829, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 292, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1824, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 27, 'nb_images_finished': 182, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 182, 'last_update': '2025/10/11', 'portfolio_id': 27673418, 'last_run_id': 2438807, 'total_number_of_photos': 1828}} No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1937, 'nb_two_criteria_ok': 1937, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 182, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1934, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 396, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 396, 'last_update': '2025/10/10', 'portfolio_id': 27621800, 'last_run_id': 2431341, 'total_number_of_photos': 1940}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1995, 'nb_two_criteria_ok': 1995, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 126, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1990, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 77, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 304, 'nb_selected_images': 381, 'last_update': '2025/10/09', 'portfolio_id': 27572927, 'last_run_id': 2423417, 'total_number_of_photos': 1995}} No error ? {'log_dict': {'total_nb_images': 2123, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21230 seconds', 'coverage_times_pause': '0 days 42460 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 2010, 'nb_two_criteria_ok': 2010, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 115, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2004, 'ratio_coverage': 0.24572043657912707}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 9, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 72, 'nb_images_started': 396, 'nb_selected_images': 405, 'last_update': '2025/10/10', 'portfolio_id': 27546740, 'last_run_id': 2422741, 'total_number_of_photos': 2009}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1991, 'nb_two_criteria_ok': 1991, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 129, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1984, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 66, 'nb_images_started': 497, 'nb_selected_images': 497, 'last_update': '2025/10/10', 'portfolio_id': 27529907, 'last_run_id': 2423219, 'total_number_of_photos': 1990}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1809, 'nb_two_criteria_ok': 1809, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 310, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1804, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 332, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 332, 'last_update': '2025/10/12', 'portfolio_id': 27722258, 'last_run_id': 2442295, 'total_number_of_photos': 1810}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1829, 'nb_two_criteria_ok': 1829, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 292, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1824, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 27, 'nb_images_finished': 182, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 182, 'last_update': '2025/10/11', 'portfolio_id': 27673418, 'last_run_id': 2438807, 'total_number_of_photos': 1828}} No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1937, 'nb_two_criteria_ok': 1937, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 182, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1934, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 396, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 396, 'last_update': '2025/10/10', 'portfolio_id': 27621800, 'last_run_id': 2431341, 'total_number_of_photos': 1940}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1995, 'nb_two_criteria_ok': 1995, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 126, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1990, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 77, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 304, 'nb_selected_images': 381, 'last_update': '2025/10/09', 'portfolio_id': 27572927, 'last_run_id': 2423417, 'total_number_of_photos': 1995}} No error ? {'log_dict': {'total_nb_images': 2123, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21230 seconds', 'coverage_times_pause': '0 days 42460 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 2010, 'nb_two_criteria_ok': 2010, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 115, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2004, 'ratio_coverage': 0.24572043657912707}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 9, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 72, 'nb_images_started': 396, 'nb_selected_images': 405, 'last_update': '2025/10/10', 'portfolio_id': 27546740, 'last_run_id': 2422741, 'total_number_of_photos': 2009}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1991, 'nb_two_criteria_ok': 1991, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 129, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1984, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 66, 'nb_images_started': 497, 'nb_selected_images': 497, 'last_update': '2025/10/10', 'portfolio_id': 27529907, 'last_run_id': 2423219, 'total_number_of_photos': 1990}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1956, 'nb_two_criteria_ok': 1956, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 163, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1953, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 43, 'nb_images_started': 219, 'nb_selected_images': 219, 'last_update': '2025/10/10', 'portfolio_id': 27555534, 'last_run_id': 2422527, 'total_number_of_photos': 1957}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1829, 'nb_two_criteria_ok': 1829, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 292, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1824, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 27, 'nb_images_finished': 182, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 182, 'last_update': '2025/10/11', 'portfolio_id': 27673418, 'last_run_id': 2438003, 'total_number_of_photos': 1828}} No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1937, 'nb_two_criteria_ok': 1937, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 182, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1934, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 396, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 396, 'last_update': '2025/10/10', 'portfolio_id': 27621800, 'last_run_id': 2431341, 'total_number_of_photos': 1940}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1995, 'nb_two_criteria_ok': 1995, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 126, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1990, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 77, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 304, 'nb_selected_images': 381, 'last_update': '2025/10/09', 'portfolio_id': 27572927, 'last_run_id': 2423417, 'total_number_of_photos': 1995}} No error ? {'log_dict': {'total_nb_images': 2123, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21230 seconds', 'coverage_times_pause': '0 days 42460 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 2010, 'nb_two_criteria_ok': 2010, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 115, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2004, 'ratio_coverage': 0.24572043657912707}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 9, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 72, 'nb_images_started': 396, 'nb_selected_images': 405, 'last_update': '2025/10/10', 'portfolio_id': 27546740, 'last_run_id': 2422741, 'total_number_of_photos': 2009}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1991, 'nb_two_criteria_ok': 1991, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 129, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1984, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 66, 'nb_images_started': 497, 'nb_selected_images': 497, 'last_update': '2025/10/10', 'portfolio_id': 27529907, 'last_run_id': 2423219, 'total_number_of_photos': 1990}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1956, 'nb_two_criteria_ok': 1956, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 43, 'nb_images_started': 219, 'nb_selected_images': 219, 'last_update': '2025/10/10', 'portfolio_id': 27555534, 'last_run_id': 2422527, 'total_number_of_photos': 1957}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1921, 'nb_two_criteria_ok': 1921, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 201, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1919, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 37, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2025/10/10', 'portfolio_id': 27536137, 'last_run_id': 2422995, 'total_number_of_photos': 1922}} No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1937, 'nb_two_criteria_ok': 1937, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 182, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1934, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 396, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 396, 'last_update': '2025/10/10', 'portfolio_id': 27621800, 'last_run_id': 2429643, 'total_number_of_photos': 1940}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1995, 'nb_two_criteria_ok': 1995, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 126, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1990, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 77, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 304, 'nb_selected_images': 381, 'last_update': '2025/10/09', 'portfolio_id': 27572927, 'last_run_id': 2423417, 'total_number_of_photos': 1995}} No error ? {'log_dict': {'total_nb_images': 2123, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21230 seconds', 'coverage_times_pause': '0 days 42460 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 2010, 'nb_two_criteria_ok': 2010, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 115, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2004, 'ratio_coverage': 0.24572043657912707}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 9, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 72, 'nb_images_started': 396, 'nb_selected_images': 405, 'last_update': '2025/10/10', 'portfolio_id': 27546740, 'last_run_id': 2422741, 'total_number_of_photos': 2009}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1991, 'nb_two_criteria_ok': 1991, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 129, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1984, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 66, 'nb_images_started': 497, 'nb_selected_images': 497, 'last_update': '2025/10/09', 'portfolio_id': 27529907, 'last_run_id': 2423219, 'total_number_of_photos': 1990}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1956, 'nb_two_criteria_ok': 1956, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 163, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1953, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 43, 'nb_images_started': 219, 'nb_selected_images': 219, 'last_update': '2025/10/10', 'portfolio_id': 27555534, 'last_run_id': 2422527, 'total_number_of_photos': 1957}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1921, 'nb_two_criteria_ok': 1921, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 201, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1919, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 37, 'nb_images_started': 127, 'nb_selected_images': 127, 'last_update': '2025/10/09', 'portfolio_id': 27536137, 'last_run_id': 2422995, 'total_number_of_photos': 1922}} No error ? {'log_dict': {'total_nb_images': 2125, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21250 seconds', 'coverage_times_pause': '0 days 42500 seconds', 'nb_photos_decision': 2126, 'nb_gray_level_ok': 2126, 'nb_dedup_ok': 1983, 'nb_two_criteria_ok': 1983, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 143, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.2459519207398234}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 401, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 3, 'nb_images_started': 27, 'nb_selected_images': 428, 'last_update': '2025/10/03', 'portfolio_id': 27468922, 'last_run_id': 2398139, 'total_number_of_photos': 1315}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1995, 'nb_two_criteria_ok': 1995, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 126, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1990, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 77, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 77, 'last_update': '2025/10/08', 'portfolio_id': 27572927, 'last_run_id': 2416775, 'total_number_of_photos': 1995}} No error ? {'log_dict': {'total_nb_images': 2123, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21230 seconds', 'coverage_times_pause': '0 days 42460 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 2010, 'nb_two_criteria_ok': 2010, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 115, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2004, 'ratio_coverage': 0.24572043657912707}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 9, 'nb_selected_images': 9, 'last_update': '2025/10/08', 'portfolio_id': 27546740, 'last_run_id': 2415325, 'total_number_of_photos': 2009}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1991, 'nb_two_criteria_ok': 1991, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 129, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1984, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/10/08', 'portfolio_id': 27529907, 'last_run_id': 2415327, 'total_number_of_photos': 1990}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1956, 'nb_two_criteria_ok': 1956, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 163, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1953, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/10/08', 'portfolio_id': 27555534, 'last_run_id': 2415385, 'total_number_of_photos': 1957}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1921, 'nb_two_criteria_ok': 1921, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 201, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1919, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/10/08', 'portfolio_id': 27536137, 'last_run_id': 2415383, 'total_number_of_photos': 1922}} No error ? {'log_dict': {'total_nb_images': 2125, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21250 seconds', 'coverage_times_pause': '0 days 42500 seconds', 'nb_photos_decision': 2126, 'nb_gray_level_ok': 2126, 'nb_dedup_ok': 1983, 'nb_two_criteria_ok': 1983, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 143, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.2459519207398234}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 401, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 3, 'nb_images_started': 27, 'nb_selected_images': 428, 'last_update': '2025/10/03', 'portfolio_id': 27468922, 'last_run_id': 2398139, 'total_number_of_photos': 1315}} No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1994, 'nb_two_criteria_ok': 1994, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 128, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1987, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 105, 'nb_images_finished': 448, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 448, 'last_update': '2025/10/03', 'portfolio_id': 27431371, 'last_run_id': 2396411, 'total_number_of_photos': 1992}} No error ? {'log_dict': {'total_nb_images': 2123, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21230 seconds', 'coverage_times_pause': '0 days 42460 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 2010, 'nb_two_criteria_ok': 2010, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 115, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2004, 'ratio_coverage': 0.24572043657912707}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/10/08', 'portfolio_id': 27546740, 'last_run_id': 2413727, 'total_number_of_photos': 2004}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1991, 'nb_two_criteria_ok': 1991, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 129, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1984, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/10/07', 'portfolio_id': 27529907, 'last_run_id': 2409883, 'total_number_of_photos': 1984}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1956, 'nb_two_criteria_ok': 1956, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 163, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1953, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1921, 'nb_two_criteria_ok': 1921, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 201, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1919, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 2125, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21250 seconds', 'coverage_times_pause': '0 days 42500 seconds', 'nb_photos_decision': 437, 'nb_gray_level_ok': 437, 'nb_dedup_ok': 402, 'nb_two_criteria_ok': 402, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 143, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.2459519207398234}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 401, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 3, 'nb_images_started': 27, 'nb_selected_images': 428, 'last_update': '2025/10/03', 'portfolio_id': 27468922, 'last_run_id': 2398139, 'total_number_of_photos': 1315}} No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1994, 'nb_two_criteria_ok': 1994, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 128, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1987, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 105, 'nb_images_finished': 448, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 448, 'last_update': '2025/10/03', 'portfolio_id': 27431371, 'last_run_id': 2396411, 'total_number_of_photos': 1992}} No error ? {'log_dict': {'total_nb_images': 2115, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21150 seconds', 'coverage_times_pause': '0 days 42300 seconds', 'nb_photos_decision': 2117, 'nb_gray_level_ok': 2117, 'nb_dedup_ok': 1981, 'nb_two_criteria_ok': 1981, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 135, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1976, 'ratio_coverage': 0.24479449993634186}, 'dashboard_dict': {'nb_ptf_finished': 79, 'nb_images_finished': 450, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2025/10/02', 'portfolio_id': 27382819, 'last_run_id': 2386891, 'total_number_of_photos': 1982}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2120, 'nb_gray_level_ok': 2120, 'nb_dedup_ok': 1991, 'nb_two_criteria_ok': 1991, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 129, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1984, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/10/06', 'portfolio_id': 27529907, 'last_run_id': 2408253, 'total_number_of_photos': 1984}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1956, 'nb_two_criteria_ok': 1956, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 163, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1953, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1921, 'nb_two_criteria_ok': 1921, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 201, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1919, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 2125, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21250 seconds', 'coverage_times_pause': '0 days 42500 seconds', 'nb_photos_decision': 2126, 'nb_gray_level_ok': 2126, 'nb_dedup_ok': 1983, 'nb_two_criteria_ok': 1983, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 143, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.2459519207398234}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 401, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 3, 'nb_images_started': 27, 'nb_selected_images': 428, 'last_update': '2025/10/03', 'portfolio_id': 27468922, 'last_run_id': 2398139, 'total_number_of_photos': 1315}} No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1994, 'nb_two_criteria_ok': 1994, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 128, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1987, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 105, 'nb_images_finished': 448, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 448, 'last_update': '2025/10/03', 'portfolio_id': 27431371, 'last_run_id': 2396411, 'total_number_of_photos': 1992}} No error ? {'log_dict': {'total_nb_images': 2115, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21150 seconds', 'coverage_times_pause': '0 days 42300 seconds', 'nb_photos_decision': 2117, 'nb_gray_level_ok': 2117, 'nb_dedup_ok': 1981, 'nb_two_criteria_ok': 1981, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 135, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1976, 'ratio_coverage': 0.24479449993634186}, 'dashboard_dict': {'nb_ptf_finished': 79, 'nb_images_finished': 450, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2025/10/02', 'portfolio_id': 27382819, 'last_run_id': 2386891, 'total_number_of_photos': 1982}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 1956, 'nb_two_criteria_ok': 1956, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 163, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 1953, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1921, 'nb_two_criteria_ok': 1921, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 201, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1919, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 2125, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21250 seconds', 'coverage_times_pause': '0 days 42500 seconds', 'nb_photos_decision': 2126, 'nb_gray_level_ok': 2126, 'nb_dedup_ok': 1983, 'nb_two_criteria_ok': 1983, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 143, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.2459519207398234}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 401, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 3, 'nb_images_started': 27, 'nb_selected_images': 428, 'last_update': '2025/10/03', 'portfolio_id': 27468922, 'last_run_id': 2398139, 'total_number_of_photos': 1315}} No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1994, 'nb_two_criteria_ok': 1994, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 128, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1987, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 105, 'nb_images_finished': 448, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 448, 'last_update': '2025/10/03', 'portfolio_id': 27431371, 'last_run_id': 2396411, 'total_number_of_photos': 1992}} No error ? {'log_dict': {'total_nb_images': 2115, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21150 seconds', 'coverage_times_pause': '0 days 42300 seconds', 'nb_photos_decision': 2117, 'nb_gray_level_ok': 2117, 'nb_dedup_ok': 1981, 'nb_two_criteria_ok': 1981, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 135, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1976, 'ratio_coverage': 0.24479449993634186}, 'dashboard_dict': {'nb_ptf_finished': 79, 'nb_images_finished': 450, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2025/10/02', 'portfolio_id': 27382819, 'last_run_id': 2386891, 'total_number_of_photos': 1982}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1921, 'nb_two_criteria_ok': 1921, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 201, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1919, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 2125, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21250 seconds', 'coverage_times_pause': '0 days 42500 seconds', 'nb_photos_decision': 2126, 'nb_gray_level_ok': 2126, 'nb_dedup_ok': 1983, 'nb_two_criteria_ok': 1983, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 143, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.2459519207398234}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 401, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 3, 'nb_images_started': 27, 'nb_selected_images': 428, 'last_update': '2025/10/03', 'portfolio_id': 27468922, 'last_run_id': 2398139, 'total_number_of_photos': 1315}} No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1994, 'nb_two_criteria_ok': 1994, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 128, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1987, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 105, 'nb_images_finished': 448, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 448, 'last_update': '2025/10/03', 'portfolio_id': 27431371, 'last_run_id': 2396411, 'total_number_of_photos': 1992}} No error ? {'log_dict': {'total_nb_images': 2115, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21150 seconds', 'coverage_times_pause': '0 days 42300 seconds', 'nb_photos_decision': 2117, 'nb_gray_level_ok': 2117, 'nb_dedup_ok': 1981, 'nb_two_criteria_ok': 1981, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 135, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1976, 'ratio_coverage': 0.24479449993634186}, 'dashboard_dict': {'nb_ptf_finished': 79, 'nb_images_finished': 450, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2025/10/02', 'portfolio_id': 27382819, 'last_run_id': 2386891, 'total_number_of_photos': 1982}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2125, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21250 seconds', 'coverage_times_pause': '0 days 42500 seconds', 'nb_photos_decision': 2126, 'nb_gray_level_ok': 2126, 'nb_dedup_ok': 1983, 'nb_two_criteria_ok': 1983, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 143, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.2459519207398234}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 401, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 3, 'nb_images_started': 27, 'nb_selected_images': 428, 'last_update': '2025/10/03', 'portfolio_id': 27468922, 'last_run_id': 2398139, 'total_number_of_photos': 1315}} No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1994, 'nb_two_criteria_ok': 1994, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 128, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1987, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 105, 'nb_images_finished': 448, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 448, 'last_update': '2025/10/03', 'portfolio_id': 27431371, 'last_run_id': 2396411, 'total_number_of_photos': 1992}} No error ? {'log_dict': {'total_nb_images': 2115, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21150 seconds', 'coverage_times_pause': '0 days 42300 seconds', 'nb_photos_decision': 2117, 'nb_gray_level_ok': 2117, 'nb_dedup_ok': 1981, 'nb_two_criteria_ok': 1981, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 135, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1976, 'ratio_coverage': 0.24479449993634186}, 'dashboard_dict': {'nb_ptf_finished': 79, 'nb_images_finished': 450, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2025/10/02', 'portfolio_id': 27382819, 'last_run_id': 2386891, 'total_number_of_photos': 1982}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2119, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21190 seconds', 'coverage_times_pause': '0 days 42380 seconds', 'nb_photos_decision': 2122, 'nb_gray_level_ok': 2122, 'nb_dedup_ok': 1994, 'nb_two_criteria_ok': 1994, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 128, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1987, 'ratio_coverage': 0.24525746825773445}, 'dashboard_dict': {'nb_ptf_finished': 105, 'nb_images_finished': 448, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 448, 'last_update': '2025/10/03', 'portfolio_id': 27431371, 'last_run_id': 2394555, 'total_number_of_photos': 1992}} No error ? {'log_dict': {'total_nb_images': 2115, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21150 seconds', 'coverage_times_pause': '0 days 42300 seconds', 'nb_photos_decision': 2117, 'nb_gray_level_ok': 2117, 'nb_dedup_ok': 1981, 'nb_two_criteria_ok': 1981, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 135, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1976, 'ratio_coverage': 0.24479449993634186}, 'dashboard_dict': {'nb_ptf_finished': 79, 'nb_images_finished': 450, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2025/10/02', 'portfolio_id': 27382819, 'last_run_id': 2386891, 'total_number_of_photos': 1982}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2115, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21150 seconds', 'coverage_times_pause': '0 days 42300 seconds', 'nb_photos_decision': 2117, 'nb_gray_level_ok': 2117, 'nb_dedup_ok': 1981, 'nb_two_criteria_ok': 1981, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 135, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1976, 'ratio_coverage': 0.24479449993634186}, 'dashboard_dict': {'nb_ptf_finished': 79, 'nb_images_finished': 450, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 450, 'last_update': '2025/10/02', 'portfolio_id': 27382819, 'last_run_id': 2386891, 'total_number_of_photos': 1982}} Since we don't have condition on date we need to verify this lately ! Found day : 2025-10-18 00:00:00 Found day : 2025-10-17 00:00:00 Found day : 2025-10-16 00:00:00 Found day : 2025-10-15 00:00:00 Found day : 2025-10-14 00:00:00 Found day : 2025-10-13 00:00:00 Found day : 2025-10-12 00:00:00 Found day : 2025-10-11 00:00:00 Found day : 2025-10-10 00:00:00 Found day : 2025-10-09 00:00:00 Found day : 2025-10-08 00:00:00 Found day : 2025-10-07 00:00:00 Found day : 2025-10-06 00:00:00 Found day : 2025-10-05 00:00:00 Found day : 2025-10-04 00:00:00 Found day : 2025-10-03 00:00:00 Found day : 2025-10-02 00:00:00 Found day : 2025-10-01 00:00:00 Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-10-19 00:00:00,2025-10-20 00:00:00,2025-10-21 00:00:00,2025-10-22 00:00:00,2025-10-23 00:00:00,2025-10-24 00:00:00,2025-10-25 00:00:00,2025-10-26 00:00:00,2025-10-27 00:00:00,2025-10-28 00:00:00,2025-10-29 00:00:00,2025-10-30 00:00:00,2025-10-31 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where ded.dashboard_place_id = 132 and month(ded.date) = 10 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______truck' and ded.dashboard_place_id = 132 and month(ded.date) = 10 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 132 and mp.name like '%102025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-10-01 : dt_date_just_month_year : 2025-10-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "dechet_Valcor_v2" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-10-01" AND ded.date <= "2025-10-31" apple3 {'test': {'mat': 'test', 'pht': 0, 'datou_carac_id': 370, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 538914404}, 'truck': {'mat': 'truck', 'pht': 4230, 'datou_carac_id': 4234, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'refus'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (2386891,2396411,2398139,2460967,2460983,2423219,2460929,2423417,2460911,2438807,2442295,2443085,2452591,2460335,2470195,2475571,2477245,2477253) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id AND ptp.type IN (0,4230) group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.02082795753236499, 'nb_photo': 73870, 'list_port_cont': '27395522,27395645,27395738,27399428,27399589,27399893,27400182,27400336,27400399,27400533,27400683,27400920,27400989,27401273,27401362,27403075,27403191,27403449,27403494,27403541,27403578,27403602,27403671,27403706,27403773,27403804,27404005,27404092,27404127,27404186,27404430,27406058,27406165,27406250,27406772,27406927,27407068,27407161,27407551,27407696,27409798,27409951,27410081,27410149,27410271,27410577,27410640,27410960,27411156,27411270,27411298,27411402,27411915,27412052,27412288,27412396,27412485,27413906,27414022,27414225,27414276,27414462,27416043,27416316,27416480,27416586,27417030,27417062,27417263,27417327,27417572,27417721,27418008,27418429,27425133,27436286,27436446,27436775,27436881,27437097,27437305,27437392,27437563,27437679,27437733,27437845,27437935,27438337,27438510,27438603,27438699,27438891,27441075,27441155,27441260,27441390,27441533,27441568,27441636,27441676,27441907,27442027,27442152,27442192,27442561,27443972,27444034,27444099,27444320,27444836,27444881,27445197,27445267,2744531', 'assoc_port': '27395259:27395738,27395260:27395645,27395273:27395522,27399109:27401273,27399111:27401362,27399113:27400920,27399139:27400989,27399141:27400533,27399143:27400683,27399159:27400336,27399161:27400399,27399163:27400182,27399165:27399589,27399184:27399893,27399186:27399428,27402982:27404186,27402983:27404005,27402984:27404127,27402985:27404092,27403006:27403804,27403011:27403602,27403012:27403773,27403013:27403494,27403014:27403541,27403015:27403449,27403016:27403191,27403017:27403075,27403519:27403671,27403520:27403578,27403521:27403706,27404229:27404430,27405831:27407161,27405833:27407068,27405859:27406772,27405861:27406927,27405862:27406250,27405864:27406165,27405866:27406058,27407237:27407696,27407239:27407551,27409558:27412396,27409584:27412288,27409586:27411270,27409588:27410640,27409590:27410960,27409592:27410577,27409594:27411156,27409596:27410149,27409598:27410271,27409600:27409951,27409602:27410081,27409604:27409798,27410743:27412052,27410745:27412485,27410772:27411298,27410774:27411915,27410776:2741140', 'assoc_mat': '27395259:autre:4230:27395738,27395260:autre:4230:27395645,27395273:autre:4230:27395522,27399109:autre:4230:27401273,27399111:autre:4230:27401362,27399113:autre:4230:27400920,27399139:autre:4230:27400989,27399141:autre:4230:27400533,27399143:autre:4230:27400683,27399159:autre:4230:27400336,27399161:autre:4230:27400399,27399163:autre:4230:27400182,27399165:autre:4230:27399589,27399184:autre:4230:27399893,27399186:autre:4230:27399428,27402982:autre:4230:27404186,27402983:autre:4230:27404005,27402984:autre:4230:27404127,27402985:autre:4230:27404092,27403006:autre:4230:27403804,27403011:autre:4230:27403602,27403012:autre:4230:27403773,27403013:autre:4230:27403494,27403014:autre:4230:27403541,27403015:autre:4230:27403449,27403016:autre:4230:27403191,27403017:autre:4230:27403075,27403519:autre:4230:27403671,27403520:autre:4230:27403578,27403521:autre:4230:27403706,27404229:autre:4230:27404430,27405831:autre:4230:27407161,27405833:autre:4230:27407068,27405859:autre:4230:27406772,27405861:autre:4230:27406927,27405862:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.026849581033900574, 'nb_photo': 87051, 'list_port_cont': '27395531,27395639,27395741,27399443,27399594,27399899,27400174,27400349,27400411,27400537,27400686,27400919,27400996,27401279,27401359,27403077,27403200,27403458,27403498,27403530,27403579,27403612,27403674,27403714,27403774,27403807,27404002,27404103,27404134,27404183,27404443,27406057,27406166,27406260,27406768,27406924,27407072,27407153,27407544,27407709,27409810,27409958,27410092,27410164,27410268,27410576,27410646,27410963,27411168,27411266,27411303,27411412,27411917,27412053,27412297,27412398,27412479,27413908,27414011,27414238,27414273,27414452,27416055,27416325,27416485,27416583,27417034,27417065,27417258,27417318,27417571,27417725,27418015,27418428,27425130,27436290,27436457,27436777,27436893,27437107,27437307,27437386,27437568,27437685,27437727,27437840,27437937,27438346,27438516,27438614,27438704,27438897,27441082,27441153,27441264,27441393,27441545,27441579,27441640,27441674,27441909,27442025,27442154,27442190,27442566,27443966,27444048,27444102,27444321,27444840,27444869,27445209,27445268,2744533', 'assoc_port': '27395259:27395741,27395260:27395639,27395273:27395531,27399109:27401279,27399111:27401359,27399113:27400919,27399139:27400996,27399141:27400537,27399143:27400686,27399159:27400349,27399161:27400411,27399163:27400174,27399165:27399594,27399184:27399899,27399186:27399443,27402982:27404183,27402983:27404002,27402984:27404134,27402985:27404103,27403006:27403807,27403011:27403612,27403012:27403774,27403013:27403498,27403014:27403530,27403015:27403458,27403016:27403200,27403017:27403077,27403519:27403674,27403520:27403579,27403521:27403714,27404229:27404443,27405831:27407153,27405833:27407072,27405859:27406768,27405861:27406924,27405862:27406260,27405864:27406166,27405866:27406057,27407237:27407709,27407239:27407544,27409558:27412398,27409584:27412297,27409586:27411266,27409588:27410646,27409590:27410963,27409592:27410576,27409594:27411168,27409596:27410164,27409598:27410268,27409600:27409958,27409602:27410092,27409604:27409810,27410743:27412053,27410745:27412479,27410772:27411303,27410774:27411917,27410776:2741141', 'assoc_mat': '27395259:carton:4230:27395741,27395260:carton:4230:27395639,27395273:carton:4230:27395531,27399109:carton:4230:27401279,27399111:carton:4230:27401359,27399113:carton:4230:27400919,27399139:carton:4230:27400996,27399141:carton:4230:27400537,27399143:carton:4230:27400686,27399159:carton:4230:27400349,27399161:carton:4230:27400411,27399163:carton:4230:27400174,27399165:carton:4230:27399594,27399184:carton:4230:27399899,27399186:carton:4230:27399443,27402982:carton:4230:27404183,27402983:carton:4230:27404002,27402984:carton:4230:27404134,27402985:carton:4230:27404103,27403006:carton:4230:27403807,27403011:carton:4230:27403612,27403012:carton:4230:27403774,27403013:carton:4230:27403498,27403014:carton:4230:27403530,27403015:carton:4230:27403458,27403016:carton:4230:27403200,27403017:carton:4230:27403077,27403519:carton:4230:27403674,27403520:carton:4230:27403579,27403521:carton:4230:27403714,27404229:carton:4230:27404443,27405831:carton:4230:27407153,27405833:carton:4230:27407072,27405859:carton:4230:27406768,2740'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.004924424740854543, 'nb_photo': 2691, 'list_port_cont': '27395526,27395737,27399601,27399901,27400183,27400404,27401352,27403066,27403199,27403455,27403529,27403605,27403811,27403998,27404099,27404124,27404179,27404427,27406056,27406257,27406773,27407064,27407145,27407541,27407704,27409812,27410094,27410159,27410275,27410584,27410644,27410956,27411159,27411264,27411411,27411921,27412051,27412295,27412383,27412468,27413905,27414236,27414266,27414450,27416044,27416320,27416475,27416580,27417029,27417071,27417260,27417321,27417559,27417726,27418002,27418426,27436458,27436770,27436883,27437105,27437295,27437393,27437574,27437670,27437728,27437838,27437934,27438511,27438619,27438700,27438884,27441262,27441628,27441894,27442186,27443978,27444032,27444108,27444839,27444879,27445196,27445275,27445331,27445381,27445435,27445564,27445600,27446975,27447018,27447127,27447193,27447340,27447377,27447425,27447466,27447557,27447591,27447692,27447831,27447886,27447935,27447980,27448081,27448110,27448149,27448486,27448553,27448641,27449125,27449231,27449320,27450919,27450973,2745135', 'assoc_port': '27395259:27395737,27395273:27395526,27399111:27401352,27399161:27400404,27399163:27400183,27399165:27399601,27399184:27399901,27402982:27404179,27402983:27403998,27402984:27404124,27402985:27404099,27403006:27403811,27403011:27403605,27403014:27403529,27403015:27403455,27403016:27403199,27403017:27403066,27404229:27404427,27405831:27407145,27405833:27407064,27405859:27406773,27405862:27406257,27405866:27406056,27407237:27407704,27407239:27407541,27409558:27412383,27409584:27412295,27409586:27411264,27409588:27410644,27409590:27410956,27409592:27410584,27409594:27411159,27409596:27410159,27409598:27410275,27409602:27410094,27409604:27409812,27410743:27412051,27410745:27412468,27410774:27411921,27410776:27411411,27413735:27414450,27413736:27414266,27413737:27414236,27413739:27413905,27415784:27416580,27415785:27416475,27415810:27416044,27415811:27416320,27416706:27417559,27416720:27417321,27416734:27417071,27416736:27417260,27416738:27417029,27417551:27417726,27417552:27418002,27418344:27418426,27436082:2743861', 'assoc_mat': '27395259:metal:4230:27395737,27395273:metal:4230:27395526,27399111:metal:4230:27401352,27399161:metal:4230:27400404,27399163:metal:4230:27400183,27399165:metal:4230:27399601,27399184:metal:4230:27399901,27402982:metal:4230:27404179,27402983:metal:4230:27403998,27402984:metal:4230:27404124,27402985:metal:4230:27404099,27403006:metal:4230:27403811,27403011:metal:4230:27403605,27403014:metal:4230:27403529,27403015:metal:4230:27403455,27403016:metal:4230:27403199,27403017:metal:4230:27403066,27404229:metal:4230:27404427,27405831:metal:4230:27407145,27405833:metal:4230:27407064,27405859:metal:4230:27406773,27405862:metal:4230:27406257,27405866:metal:4230:27406056,27407237:metal:4230:27407704,27407239:metal:4230:27407541,27409558:metal:4230:27412383,27409584:metal:4230:27412295,27409586:metal:4230:27411264,27409588:metal:4230:27410644,27409590:metal:4230:27410956,27409592:metal:4230:27410584,27409594:metal:4230:27411159,27409596:metal:4230:27410159,27409598:metal:4230:27410275,27409602:metal:4230:27410094,27409604:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.11440422348652039, 'nb_photo': 272036, 'list_port_cont': '27395523,27395634,27395742,27399441,27399597,27399902,27400176,27400340,27400410,27400538,27400692,27400930,27400999,27401282,27401361,27403074,27403201,27403450,27403499,27403538,27403572,27403616,27403670,27403713,27403771,27403816,27403997,27404101,27404137,27404192,27404442,27406065,27406161,27406263,27406779,27406926,27407080,27407156,27407553,27407703,27409808,27409949,27410088,27410163,27410264,27410582,27410643,27410957,27411166,27411275,27411308,27411404,27411918,27412046,27412285,27412391,27412478,27413896,27414012,27414233,27414263,27414457,27416057,27416323,27416474,27416594,27417037,27417072,27417253,27417319,27417567,27417731,27418012,27418437,27425142,27436293,27436459,27436778,27436891,27437108,27437306,27437384,27437575,27437673,27437736,27437841,27437933,27438345,27438526,27438608,27438711,27438896,27441081,27441158,27441261,27441404,27441534,27441581,27441637,27441677,27441902,27442026,27442153,27442184,27442573,27443971,27444041,27444109,27444322,27444834,27444880,27445206,27445266,2744532', 'assoc_port': '27395259:27395742,27395260:27395634,27395273:27395523,27399109:27401282,27399111:27401361,27399113:27400930,27399139:27400999,27399141:27400538,27399143:27400692,27399159:27400340,27399161:27400410,27399163:27400176,27399165:27399597,27399184:27399902,27399186:27399441,27402982:27404192,27402983:27403997,27402984:27404137,27402985:27404101,27403006:27403816,27403011:27403616,27403012:27403771,27403013:27403499,27403014:27403538,27403015:27403450,27403016:27403201,27403017:27403074,27403519:27403670,27403520:27403572,27403521:27403713,27404229:27404442,27405831:27407156,27405833:27407080,27405859:27406779,27405861:27406926,27405862:27406263,27405864:27406161,27405866:27406065,27407237:27407703,27407239:27407553,27409558:27412391,27409584:27412285,27409586:27411275,27409588:27410643,27409590:27410957,27409592:27410582,27409594:27411166,27409596:27410163,27409598:27410264,27409600:27409949,27409602:27410088,27409604:27409808,27410743:27412046,27410745:27412478,27410772:27411308,27410774:27411918,27410776:2741140', 'assoc_mat': '27395259:papier:4230:27395742,27395260:papier:4230:27395634,27395273:papier:4230:27395523,27399109:papier:4230:27401282,27399111:papier:4230:27401361,27399113:papier:4230:27400930,27399139:papier:4230:27400999,27399141:papier:4230:27400538,27399143:papier:4230:27400692,27399159:papier:4230:27400340,27399161:papier:4230:27400410,27399163:papier:4230:27400176,27399165:papier:4230:27399597,27399184:papier:4230:27399902,27399186:papier:4230:27399441,27402982:papier:4230:27404192,27402983:papier:4230:27403997,27402984:papier:4230:27404137,27402985:papier:4230:27404101,27403006:papier:4230:27403816,27403011:papier:4230:27403616,27403012:papier:4230:27403771,27403013:papier:4230:27403499,27403014:papier:4230:27403538,27403015:papier:4230:27403450,27403016:papier:4230:27403201,27403017:papier:4230:27403074,27403519:papier:4230:27403670,27403520:papier:4230:27403572,27403521:papier:4230:27403713,27404229:papier:4230:27404442,27405831:papier:4230:27407156,27405833:papier:4230:27407080,27405859:papier:4230:27406779,2740'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0012162768274405992, 'nb_photo': 1401, 'list_port_cont': '27395527,27395647,27400403,27403063,27403460,27406067,27406164,27406775,27406919,27407075,27407554,27409962,27410086,27410588,27410647,27410961,27411167,27411273,27411312,27411410,27412294,27414454,27416324,27436456,27441085,27441156,27441398,27441536,27441574,27442023,27442155,27442180,27444042,27444105,27444846,27445205,27445277,27445327,27445382,27445439,27445563,27445602,27447370,27447434,27447561,27448078,27448497,27449332,27451357,27451552,27451695,27454122,27455901,27486764,27487056,27487098,27487474,27487802,27487838,27488051,27488225,27488416,27488454,27489002,27489151,27489766,27492446,27493343,27493670,27493876,27494894,27495577,27495733,27496229,27496698,27585164,27585427,27585759,27585844,27586171,27586373,27589066,27589755,27589895,27594701,27597449,27603093,27634101,27634266,27634377,27634598,27634706,27635609,27635885,27637411,27637717,27637928,27638523,27640825,27641115,27641323,27641410,27641506,27642494,27642629,27643288,27643920,27644196,27644733,27644776,27644978,27645119,27645329,2764559', 'assoc_port': '27395260:27395647,27395273:27395527,27399161:27400403,27403015:27403460,27403017:27403063,27405833:27407075,27405859:27406775,27405861:27406919,27405864:27406164,27405866:27406067,27407239:27407554,27409584:27412294,27409586:27411273,27409588:27410647,27409590:27410961,27409592:27410588,27409594:27411167,27409600:27409962,27409602:27410086,27410772:27411312,27410776:27411410,27413735:27414454,27415811:27416324,27436163:27436456,27440929:27442155,27440930:27441398,27440931:27441536,27440956:27441574,27440958:27441085,27440959:27441156,27441729:27442180,27441754:27442023,27443903:27444105,27443904:27445602,27443905:27444042,27444787:27445205,27444788:27445382,27444789:27445563,27444791:27444846,27444792:27445277,27445235:27445327,27445236:27445439,27446720:27448078,27446728:27447370,27447321:27447561,27447322:27447434,27448406:27448497,27449011:27449332,27450681:27451552,27450682:27451695,27450708:27451357,27453274:27454122,27454450:27455901,27486314:27489766,27486318:27489151,27486322:27489002,27486340:2748845', 'assoc_mat': '27395260:pehd:4230:27395647,27395273:pehd:4230:27395527,27399161:pehd:4230:27400403,27403015:pehd:4230:27403460,27403017:pehd:4230:27403063,27405833:pehd:4230:27407075,27405859:pehd:4230:27406775,27405861:pehd:4230:27406919,27405864:pehd:4230:27406164,27405866:pehd:4230:27406067,27407239:pehd:4230:27407554,27409584:pehd:4230:27412294,27409586:pehd:4230:27411273,27409588:pehd:4230:27410647,27409590:pehd:4230:27410961,27409592:pehd:4230:27410588,27409594:pehd:4230:27411167,27409600:pehd:4230:27409962,27409602:pehd:4230:27410086,27410772:pehd:4230:27411312,27410776:pehd:4230:27411410,27413735:pehd:4230:27414454,27415811:pehd:4230:27416324,27436163:pehd:4230:27436456,27440929:pehd:4230:27442155,27440930:pehd:4230:27441398,27440931:pehd:4230:27441536,27440956:pehd:4230:27441574,27440958:pehd:4230:27441085,27440959:pehd:4230:27441156,27441729:pehd:4230:27442180,27441754:pehd:4230:27442023,27443903:pehd:4230:27444105,27443904:pehd:4230:27445602,27443905:pehd:4230:27444042,27444787:pehd:4230:27445205,27444788:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.011350275966004459, 'nb_photo': 47484, 'list_port_cont': '27395521,27395648,27395743,27399442,27399599,27399900,27400172,27400350,27400408,27400534,27400697,27400928,27400990,27401284,27401358,27403069,27403193,27403459,27403497,27403532,27403575,27403611,27403673,27403715,27403767,27403814,27404004,27404100,27404138,27404182,27404434,27406063,27406158,27406261,27406776,27406918,27407074,27407159,27407557,27407708,27409800,27409957,27410084,27410161,27410273,27410580,27410635,27410970,27411165,27411274,27411302,27411407,27411925,27412049,27412287,27412400,27412475,27413909,27414013,27414237,27414274,27414464,27416052,27416329,27416482,27416587,27417036,27417067,27417264,27417330,27417565,27417735,27418005,27418436,27425138,27436295,27436455,27436787,27436886,27437106,27437302,27437388,27437577,27437677,27437732,27437837,27437938,27438347,27438527,27438611,27438702,27438900,27441079,27441148,27441271,27441402,27441546,27441580,27441632,27441679,27441904,27442024,27442145,27442188,27442568,27443969,27444046,27444110,27444314,27444842,27444883,27445210,27445274,2744533', 'assoc_port': '27395259:27395743,27395260:27395648,27395273:27395521,27399109:27401284,27399111:27401358,27399113:27400928,27399139:27400990,27399141:27400534,27399143:27400697,27399159:27400350,27399161:27400408,27399163:27400172,27399165:27399599,27399184:27399900,27399186:27399442,27402982:27404182,27402983:27404004,27402984:27404138,27402985:27404100,27403006:27403814,27403011:27403611,27403012:27403767,27403013:27403497,27403014:27403532,27403015:27403459,27403016:27403193,27403017:27403069,27403519:27403673,27403520:27403575,27403521:27403715,27404229:27404434,27405831:27407159,27405833:27407074,27405859:27406776,27405861:27406918,27405862:27406261,27405864:27406158,27405866:27406063,27407237:27407708,27407239:27407557,27409558:27412400,27409584:27412287,27409586:27411274,27409588:27410635,27409590:27410970,27409592:27410580,27409594:27411165,27409596:27410161,27409598:27410273,27409600:27409957,27409602:27410084,27409604:27409800,27410743:27412049,27410745:27412475,27410772:27411302,27410774:27411925,27410776:2741140', 'assoc_mat': '27395259:pet_clair:4230:27395743,27395260:pet_clair:4230:27395648,27395273:pet_clair:4230:27395521,27399109:pet_clair:4230:27401284,27399111:pet_clair:4230:27401358,27399113:pet_clair:4230:27400928,27399139:pet_clair:4230:27400990,27399141:pet_clair:4230:27400534,27399143:pet_clair:4230:27400697,27399159:pet_clair:4230:27400350,27399161:pet_clair:4230:27400408,27399163:pet_clair:4230:27400172,27399165:pet_clair:4230:27399599,27399184:pet_clair:4230:27399900,27399186:pet_clair:4230:27399442,27402982:pet_clair:4230:27404182,27402983:pet_clair:4230:27404004,27402984:pet_clair:4230:27404138,27402985:pet_clair:4230:27404100,27403006:pet_clair:4230:27403814,27403011:pet_clair:4230:27403611,27403012:pet_clair:4230:27403767,27403013:pet_clair:4230:27403497,27403014:pet_clair:4230:27403532,27403015:pet_clair:4230:27403459,27403016:pet_clair:4230:27403193,27403017:pet_clair:4230:27403069,27403519:pet_clair:4230:27403673,27403520:pet_clair:4230:27403575,27403521:pet_clair:4230:27403715,27404229:pet_clair:4230:27404434,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0008547299245768952, 'nb_photo': 582, 'list_port_cont': '27395748,27399436,27399897,27400405,27400531,27400998,27401283,27403574,27403678,27403710,27404003,27404136,27404441,27406155,27406777,27406922,27407069,27407152,27409960,27410093,27410585,27411164,27411276,27411413,27412055,27412394,27412477,27413894,27414020,27414235,27414271,27414463,27416486,27416592,27417032,27417261,27436460,27437308,27438707,27438899,27441089,27441403,27441543,27441578,27441903,27442156,27442189,27443975,27444103,27444843,27445272,27445328,27445388,27445566,27445606,27447117,27447900,27448117,27448501,27448645,27450927,27451233,27451554,27451690,27453963,27487836,27488449,27489687,27489770,27490452,27491282,27491679,27491858,27492278,27492444,27492899,27493058,27493350,27493558,27493677,27493866,27494336,27494898,27495729,27496244,27496689,27584928,27586375,27594359,27594706,27597355,27603096,27635617,27638530,27638655,27639201,27639859,27640670,27640823,27641041,27641107,27641409,27641499,27642008,27642506,27642627,27642990,27643285,27643458,27643924,27644287,27644378,27644738,2764626', 'assoc_port': '27395259:27395748,27399109:27401283,27399139:27400998,27399141:27400531,27399161:27400405,27399184:27399897,27399186:27399436,27402983:27404003,27402984:27404136,27403519:27403678,27403520:27403574,27403521:27403710,27404229:27404441,27405831:27407152,27405833:27407069,27405859:27406777,27405861:27406922,27405864:27406155,27409558:27412394,27409586:27411276,27409592:27410585,27409594:27411164,27409600:27409960,27409602:27410093,27410743:27412055,27410745:27412477,27410776:27411413,27413735:27414463,27413736:27414271,27413737:27414235,27413738:27414020,27413739:27413894,27415784:27416592,27415785:27416486,27416736:27417261,27416738:27417032,27436084:27438707,27436087:27438899,27436153:27437308,27436163:27436460,27440929:27442156,27440930:27441403,27440931:27441543,27440956:27441578,27440958:27441089,27441729:27442189,27441755:27441903,27443903:27444103,27443904:27445606,27443920:27443975,27444788:27445388,27444789:27445566,27444791:27444843,27444792:27445272,27445235:27445328,27446719:27448117,27446726:2744790', 'assoc_mat': '27395259:pet_fonce:4230:27395748,27399109:pet_fonce:4230:27401283,27399139:pet_fonce:4230:27400998,27399141:pet_fonce:4230:27400531,27399161:pet_fonce:4230:27400405,27399184:pet_fonce:4230:27399897,27399186:pet_fonce:4230:27399436,27402983:pet_fonce:4230:27404003,27402984:pet_fonce:4230:27404136,27403519:pet_fonce:4230:27403678,27403520:pet_fonce:4230:27403574,27403521:pet_fonce:4230:27403710,27404229:pet_fonce:4230:27404441,27405831:pet_fonce:4230:27407152,27405833:pet_fonce:4230:27407069,27405859:pet_fonce:4230:27406777,27405861:pet_fonce:4230:27406922,27405864:pet_fonce:4230:27406155,27409558:pet_fonce:4230:27412394,27409586:pet_fonce:4230:27411276,27409592:pet_fonce:4230:27410585,27409594:pet_fonce:4230:27411164,27409600:pet_fonce:4230:27409960,27409602:pet_fonce:4230:27410093,27410743:pet_fonce:4230:27412055,27410745:pet_fonce:4230:27412477,27410776:pet_fonce:4230:27411413,27413735:pet_fonce:4230:27414463,27413736:pet_fonce:4230:27414271,27413737:pet_fonce:4230:27414235,27413738:pet_fonce:4230:27414020,2'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(2386891,2396411,2398139,2460967,2460983,2423219,2460929,2423417,2460911,2438807,2442295,2443085,2452591,2460335,2470195,2475571,2477245,2477253)); after get_hostname_from_raspi hasthag : truck hasthag that could be used but not yet : _______refus SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______truck' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1055) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=132 and date >='2025-10-01' and date <= '2025-10-31') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((5297,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('truck', 5031),), 'material_dict': {'truck': 5031}, 'coverage_data': (('2025/10/18/', 0.245257), ('2025/10/17/', 0.245605), ('2025/10/16/', 0.245373), ('2025/10/15/', 0.24572), ('2025/10/14/', 0.245026), ('2025/10/13/', 0.245142), ('2025/10/12/', 0.245836), ('2025/10/11/', 0.245142), ('2025/10/10/', 0.245142), ('2025/10/09/', 0.245257), ('2025/10/08/', 0.245373), ('2025/10/07/', 0.24572), ('2025/10/06/', 0.245026), ('2025/10/05/', 0.245142), ('2025/10/04/', 0.245489), ('2025/10/03/', 0.245952), ('2025/10/02/', 0.245257), ('2025/10/01/', 0.244795)), 'impurety_average_data': ((datetime.date(2025, 10, 1), 0.15459241350447547, 2), (datetime.date(2025, 10, 2), 0.19508427173230838, 3), (datetime.date(2025, 10, 3), 0.14981955984378395, 2), (datetime.date(2025, 10, 4), 0.18701815050984477, 3), (datetime.date(2025, 10, 5), 0.14517035415585344, 2), (datetime.date(2025, 10, 6), 0.190161376064753, 2), (datetime.date(2025, 10, 7), 0.1933123832392713, 5), (datetime.date(2025, 10, 8), 0.17856707323220522, 2), (datetime.date(2025, 10, 9), 0.19102644067141736, 25), (datetime.date(2025, 10, 10), 0.1958075070068677, 4), (datetime.date(2025, 10, 11), 0.1810294878791529, 2), (datetime.date(2025, 10, 12), 0.1837807241633068, 7), (datetime.date(2025, 10, 13), 0.17499918786511443, 2), (datetime.date(2025, 10, 14), 0.16632264666450666, 4), (datetime.date(2025, 10, 15), 0.18656150597031548, 2), (datetime.date(2025, 10, 16), 0.19017179211406757, 4), (datetime.date(2025, 10, 17), 0.16949601373555895, 3)), 'impurety_average_data_per_hashtag': {'truck': ((datetime.date(2025, 10, 1), 0.15459241350447547, 2), (datetime.date(2025, 10, 2), 0.19508427173230838, 3), (datetime.date(2025, 10, 3), 0.14981955984378395, 2), (datetime.date(2025, 10, 4), 0.18701815050984477, 3), (datetime.date(2025, 10, 5), 0.14517035415585344, 2), (datetime.date(2025, 10, 6), 0.190161376064753, 2), (datetime.date(2025, 10, 7), 0.1933123832392713, 5), (datetime.date(2025, 10, 8), 0.17856707323220522, 2), (datetime.date(2025, 10, 9), 0.19102644067141736, 25), (datetime.date(2025, 10, 10), 0.1958075070068677, 4), (datetime.date(2025, 10, 11), 0.1810294878791529, 2), (datetime.date(2025, 10, 12), 0.1837807241633068, 7), (datetime.date(2025, 10, 13), 0.17499918786511443, 2), (datetime.date(2025, 10, 14), 0.16632264666450666, 4), (datetime.date(2025, 10, 15), 0.18656150597031548, 2), (datetime.date(2025, 10, 16), 0.19017179211406757, 4), (datetime.date(2025, 10, 17), 0.16949601373555895, 3))}, 'quality_array': [['-7.749731242977575', '01102025'], ['-7.7340145391407935', '02102025'], ['-7.522904678761355', '03102025'], ['-7.361013470587695', '04102025'], ['-7.660796674119093', '05102025'], ['-7.1912601736032356', '06102025'], ['-7.4085973155451965', '07102025'], ['-7.3961983014553585', '08102025'], ['-7.058967530156725', '09102025'], ['-7.354792621762543', '10102025'], ['-7.104281626653477', '11102025'], ['-7.242738806286403', '12102025'], ['-7.120935467274089', '13102025'], ['-7.151555940250032', '14102025'], ['-6.782584331970562', '15102025'], ['-6.969893193424652', '16102025'], ['-7.235530784005886', '17102025']], 'number_of_batch': ((887,),), 'datou_id_sts': 4311, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.02082795753236499, 'nb_photo': 73870, 'list_port_cont': '27395522,27395645,27395738,27399428,27399589,27399893,27400182,27400336,27400399,27400533,27400683,27400920,27400989,27401273,27401362,27403075,27403191,27403449,27403494,27403541,27403578,27403602,27403671,27403706,27403773,27403804,27404005,27404092,27404127,27404186,27404430,27406058,27406165,27406250,27406772,27406927,27407068,27407161,27407551,27407696,27409798,27409951,27410081,27410149,27410271,27410577,27410640,27410960,27411156,27411270,27411298,27411402,27411915,27412052,27412288,27412396,27412485,27413906,27414022,27414225,27414276,27414462,27416043,27416316,27416480,27416586,27417030,27417062,27417263,27417327,27417572,27417721,27418008,27418429,27425133,27436286,27436446,27436775,27436881,27437097,27437305,27437392,27437563,27437679,27437733,27437845,27437935,27438337,27438510,27438603,27438699,27438891,27441075,27441155,27441260,27441390,27441533,27441568,27441636,27441676,27441907,27442027,27442152,27442192,27442561,27443972,27444034,27444099,27444320,27444836,27444881,27445197,27445267,2744531', 'assoc_port': '27395259:27395738,27395260:27395645,27395273:27395522,27399109:27401273,27399111:27401362,27399113:27400920,27399139:27400989,27399141:27400533,27399143:27400683,27399159:27400336,27399161:27400399,27399163:27400182,27399165:27399589,27399184:27399893,27399186:27399428,27402982:27404186,27402983:27404005,27402984:27404127,27402985:27404092,27403006:27403804,27403011:27403602,27403012:27403773,27403013:27403494,27403014:27403541,27403015:27403449,27403016:27403191,27403017:27403075,27403519:27403671,27403520:27403578,27403521:27403706,27404229:27404430,27405831:27407161,27405833:27407068,27405859:27406772,27405861:27406927,27405862:27406250,27405864:27406165,27405866:27406058,27407237:27407696,27407239:27407551,27409558:27412396,27409584:27412288,27409586:27411270,27409588:27410640,27409590:27410960,27409592:27410577,27409594:27411156,27409596:27410149,27409598:27410271,27409600:27409951,27409602:27410081,27409604:27409798,27410743:27412052,27410745:27412485,27410772:27411298,27410774:27411915,27410776:2741140', 'assoc_mat': '27395259:autre:4230:27395738,27395260:autre:4230:27395645,27395273:autre:4230:27395522,27399109:autre:4230:27401273,27399111:autre:4230:27401362,27399113:autre:4230:27400920,27399139:autre:4230:27400989,27399141:autre:4230:27400533,27399143:autre:4230:27400683,27399159:autre:4230:27400336,27399161:autre:4230:27400399,27399163:autre:4230:27400182,27399165:autre:4230:27399589,27399184:autre:4230:27399893,27399186:autre:4230:27399428,27402982:autre:4230:27404186,27402983:autre:4230:27404005,27402984:autre:4230:27404127,27402985:autre:4230:27404092,27403006:autre:4230:27403804,27403011:autre:4230:27403602,27403012:autre:4230:27403773,27403013:autre:4230:27403494,27403014:autre:4230:27403541,27403015:autre:4230:27403449,27403016:autre:4230:27403191,27403017:autre:4230:27403075,27403519:autre:4230:27403671,27403520:autre:4230:27403578,27403521:autre:4230:27403706,27404229:autre:4230:27404430,27405831:autre:4230:27407161,27405833:autre:4230:27407068,27405859:autre:4230:27406772,27405861:autre:4230:27406927,27405862:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.026849581033900574, 'nb_photo': 87051, 'list_port_cont': '27395531,27395639,27395741,27399443,27399594,27399899,27400174,27400349,27400411,27400537,27400686,27400919,27400996,27401279,27401359,27403077,27403200,27403458,27403498,27403530,27403579,27403612,27403674,27403714,27403774,27403807,27404002,27404103,27404134,27404183,27404443,27406057,27406166,27406260,27406768,27406924,27407072,27407153,27407544,27407709,27409810,27409958,27410092,27410164,27410268,27410576,27410646,27410963,27411168,27411266,27411303,27411412,27411917,27412053,27412297,27412398,27412479,27413908,27414011,27414238,27414273,27414452,27416055,27416325,27416485,27416583,27417034,27417065,27417258,27417318,27417571,27417725,27418015,27418428,27425130,27436290,27436457,27436777,27436893,27437107,27437307,27437386,27437568,27437685,27437727,27437840,27437937,27438346,27438516,27438614,27438704,27438897,27441082,27441153,27441264,27441393,27441545,27441579,27441640,27441674,27441909,27442025,27442154,27442190,27442566,27443966,27444048,27444102,27444321,27444840,27444869,27445209,27445268,2744533', 'assoc_port': '27395259:27395741,27395260:27395639,27395273:27395531,27399109:27401279,27399111:27401359,27399113:27400919,27399139:27400996,27399141:27400537,27399143:27400686,27399159:27400349,27399161:27400411,27399163:27400174,27399165:27399594,27399184:27399899,27399186:27399443,27402982:27404183,27402983:27404002,27402984:27404134,27402985:27404103,27403006:27403807,27403011:27403612,27403012:27403774,27403013:27403498,27403014:27403530,27403015:27403458,27403016:27403200,27403017:27403077,27403519:27403674,27403520:27403579,27403521:27403714,27404229:27404443,27405831:27407153,27405833:27407072,27405859:27406768,27405861:27406924,27405862:27406260,27405864:27406166,27405866:27406057,27407237:27407709,27407239:27407544,27409558:27412398,27409584:27412297,27409586:27411266,27409588:27410646,27409590:27410963,27409592:27410576,27409594:27411168,27409596:27410164,27409598:27410268,27409600:27409958,27409602:27410092,27409604:27409810,27410743:27412053,27410745:27412479,27410772:27411303,27410774:27411917,27410776:2741141', 'assoc_mat': '27395259:carton:4230:27395741,27395260:carton:4230:27395639,27395273:carton:4230:27395531,27399109:carton:4230:27401279,27399111:carton:4230:27401359,27399113:carton:4230:27400919,27399139:carton:4230:27400996,27399141:carton:4230:27400537,27399143:carton:4230:27400686,27399159:carton:4230:27400349,27399161:carton:4230:27400411,27399163:carton:4230:27400174,27399165:carton:4230:27399594,27399184:carton:4230:27399899,27399186:carton:4230:27399443,27402982:carton:4230:27404183,27402983:carton:4230:27404002,27402984:carton:4230:27404134,27402985:carton:4230:27404103,27403006:carton:4230:27403807,27403011:carton:4230:27403612,27403012:carton:4230:27403774,27403013:carton:4230:27403498,27403014:carton:4230:27403530,27403015:carton:4230:27403458,27403016:carton:4230:27403200,27403017:carton:4230:27403077,27403519:carton:4230:27403674,27403520:carton:4230:27403579,27403521:carton:4230:27403714,27404229:carton:4230:27404443,27405831:carton:4230:27407153,27405833:carton:4230:27407072,27405859:carton:4230:27406768,2740'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.004924424740854543, 'nb_photo': 2691, 'list_port_cont': '27395526,27395737,27399601,27399901,27400183,27400404,27401352,27403066,27403199,27403455,27403529,27403605,27403811,27403998,27404099,27404124,27404179,27404427,27406056,27406257,27406773,27407064,27407145,27407541,27407704,27409812,27410094,27410159,27410275,27410584,27410644,27410956,27411159,27411264,27411411,27411921,27412051,27412295,27412383,27412468,27413905,27414236,27414266,27414450,27416044,27416320,27416475,27416580,27417029,27417071,27417260,27417321,27417559,27417726,27418002,27418426,27436458,27436770,27436883,27437105,27437295,27437393,27437574,27437670,27437728,27437838,27437934,27438511,27438619,27438700,27438884,27441262,27441628,27441894,27442186,27443978,27444032,27444108,27444839,27444879,27445196,27445275,27445331,27445381,27445435,27445564,27445600,27446975,27447018,27447127,27447193,27447340,27447377,27447425,27447466,27447557,27447591,27447692,27447831,27447886,27447935,27447980,27448081,27448110,27448149,27448486,27448553,27448641,27449125,27449231,27449320,27450919,27450973,2745135', 'assoc_port': '27395259:27395737,27395273:27395526,27399111:27401352,27399161:27400404,27399163:27400183,27399165:27399601,27399184:27399901,27402982:27404179,27402983:27403998,27402984:27404124,27402985:27404099,27403006:27403811,27403011:27403605,27403014:27403529,27403015:27403455,27403016:27403199,27403017:27403066,27404229:27404427,27405831:27407145,27405833:27407064,27405859:27406773,27405862:27406257,27405866:27406056,27407237:27407704,27407239:27407541,27409558:27412383,27409584:27412295,27409586:27411264,27409588:27410644,27409590:27410956,27409592:27410584,27409594:27411159,27409596:27410159,27409598:27410275,27409602:27410094,27409604:27409812,27410743:27412051,27410745:27412468,27410774:27411921,27410776:27411411,27413735:27414450,27413736:27414266,27413737:27414236,27413739:27413905,27415784:27416580,27415785:27416475,27415810:27416044,27415811:27416320,27416706:27417559,27416720:27417321,27416734:27417071,27416736:27417260,27416738:27417029,27417551:27417726,27417552:27418002,27418344:27418426,27436082:2743861', 'assoc_mat': '27395259:metal:4230:27395737,27395273:metal:4230:27395526,27399111:metal:4230:27401352,27399161:metal:4230:27400404,27399163:metal:4230:27400183,27399165:metal:4230:27399601,27399184:metal:4230:27399901,27402982:metal:4230:27404179,27402983:metal:4230:27403998,27402984:metal:4230:27404124,27402985:metal:4230:27404099,27403006:metal:4230:27403811,27403011:metal:4230:27403605,27403014:metal:4230:27403529,27403015:metal:4230:27403455,27403016:metal:4230:27403199,27403017:metal:4230:27403066,27404229:metal:4230:27404427,27405831:metal:4230:27407145,27405833:metal:4230:27407064,27405859:metal:4230:27406773,27405862:metal:4230:27406257,27405866:metal:4230:27406056,27407237:metal:4230:27407704,27407239:metal:4230:27407541,27409558:metal:4230:27412383,27409584:metal:4230:27412295,27409586:metal:4230:27411264,27409588:metal:4230:27410644,27409590:metal:4230:27410956,27409592:metal:4230:27410584,27409594:metal:4230:27411159,27409596:metal:4230:27410159,27409598:metal:4230:27410275,27409602:metal:4230:27410094,27409604:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.11440422348652039, 'nb_photo': 272036, 'list_port_cont': '27395523,27395634,27395742,27399441,27399597,27399902,27400176,27400340,27400410,27400538,27400692,27400930,27400999,27401282,27401361,27403074,27403201,27403450,27403499,27403538,27403572,27403616,27403670,27403713,27403771,27403816,27403997,27404101,27404137,27404192,27404442,27406065,27406161,27406263,27406779,27406926,27407080,27407156,27407553,27407703,27409808,27409949,27410088,27410163,27410264,27410582,27410643,27410957,27411166,27411275,27411308,27411404,27411918,27412046,27412285,27412391,27412478,27413896,27414012,27414233,27414263,27414457,27416057,27416323,27416474,27416594,27417037,27417072,27417253,27417319,27417567,27417731,27418012,27418437,27425142,27436293,27436459,27436778,27436891,27437108,27437306,27437384,27437575,27437673,27437736,27437841,27437933,27438345,27438526,27438608,27438711,27438896,27441081,27441158,27441261,27441404,27441534,27441581,27441637,27441677,27441902,27442026,27442153,27442184,27442573,27443971,27444041,27444109,27444322,27444834,27444880,27445206,27445266,2744532', 'assoc_port': '27395259:27395742,27395260:27395634,27395273:27395523,27399109:27401282,27399111:27401361,27399113:27400930,27399139:27400999,27399141:27400538,27399143:27400692,27399159:27400340,27399161:27400410,27399163:27400176,27399165:27399597,27399184:27399902,27399186:27399441,27402982:27404192,27402983:27403997,27402984:27404137,27402985:27404101,27403006:27403816,27403011:27403616,27403012:27403771,27403013:27403499,27403014:27403538,27403015:27403450,27403016:27403201,27403017:27403074,27403519:27403670,27403520:27403572,27403521:27403713,27404229:27404442,27405831:27407156,27405833:27407080,27405859:27406779,27405861:27406926,27405862:27406263,27405864:27406161,27405866:27406065,27407237:27407703,27407239:27407553,27409558:27412391,27409584:27412285,27409586:27411275,27409588:27410643,27409590:27410957,27409592:27410582,27409594:27411166,27409596:27410163,27409598:27410264,27409600:27409949,27409602:27410088,27409604:27409808,27410743:27412046,27410745:27412478,27410772:27411308,27410774:27411918,27410776:2741140', 'assoc_mat': '27395259:papier:4230:27395742,27395260:papier:4230:27395634,27395273:papier:4230:27395523,27399109:papier:4230:27401282,27399111:papier:4230:27401361,27399113:papier:4230:27400930,27399139:papier:4230:27400999,27399141:papier:4230:27400538,27399143:papier:4230:27400692,27399159:papier:4230:27400340,27399161:papier:4230:27400410,27399163:papier:4230:27400176,27399165:papier:4230:27399597,27399184:papier:4230:27399902,27399186:papier:4230:27399441,27402982:papier:4230:27404192,27402983:papier:4230:27403997,27402984:papier:4230:27404137,27402985:papier:4230:27404101,27403006:papier:4230:27403816,27403011:papier:4230:27403616,27403012:papier:4230:27403771,27403013:papier:4230:27403499,27403014:papier:4230:27403538,27403015:papier:4230:27403450,27403016:papier:4230:27403201,27403017:papier:4230:27403074,27403519:papier:4230:27403670,27403520:papier:4230:27403572,27403521:papier:4230:27403713,27404229:papier:4230:27404442,27405831:papier:4230:27407156,27405833:papier:4230:27407080,27405859:papier:4230:27406779,2740'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0012162768274405992, 'nb_photo': 1401, 'list_port_cont': '27395527,27395647,27400403,27403063,27403460,27406067,27406164,27406775,27406919,27407075,27407554,27409962,27410086,27410588,27410647,27410961,27411167,27411273,27411312,27411410,27412294,27414454,27416324,27436456,27441085,27441156,27441398,27441536,27441574,27442023,27442155,27442180,27444042,27444105,27444846,27445205,27445277,27445327,27445382,27445439,27445563,27445602,27447370,27447434,27447561,27448078,27448497,27449332,27451357,27451552,27451695,27454122,27455901,27486764,27487056,27487098,27487474,27487802,27487838,27488051,27488225,27488416,27488454,27489002,27489151,27489766,27492446,27493343,27493670,27493876,27494894,27495577,27495733,27496229,27496698,27585164,27585427,27585759,27585844,27586171,27586373,27589066,27589755,27589895,27594701,27597449,27603093,27634101,27634266,27634377,27634598,27634706,27635609,27635885,27637411,27637717,27637928,27638523,27640825,27641115,27641323,27641410,27641506,27642494,27642629,27643288,27643920,27644196,27644733,27644776,27644978,27645119,27645329,2764559', 'assoc_port': '27395260:27395647,27395273:27395527,27399161:27400403,27403015:27403460,27403017:27403063,27405833:27407075,27405859:27406775,27405861:27406919,27405864:27406164,27405866:27406067,27407239:27407554,27409584:27412294,27409586:27411273,27409588:27410647,27409590:27410961,27409592:27410588,27409594:27411167,27409600:27409962,27409602:27410086,27410772:27411312,27410776:27411410,27413735:27414454,27415811:27416324,27436163:27436456,27440929:27442155,27440930:27441398,27440931:27441536,27440956:27441574,27440958:27441085,27440959:27441156,27441729:27442180,27441754:27442023,27443903:27444105,27443904:27445602,27443905:27444042,27444787:27445205,27444788:27445382,27444789:27445563,27444791:27444846,27444792:27445277,27445235:27445327,27445236:27445439,27446720:27448078,27446728:27447370,27447321:27447561,27447322:27447434,27448406:27448497,27449011:27449332,27450681:27451552,27450682:27451695,27450708:27451357,27453274:27454122,27454450:27455901,27486314:27489766,27486318:27489151,27486322:27489002,27486340:2748845', 'assoc_mat': '27395260:pehd:4230:27395647,27395273:pehd:4230:27395527,27399161:pehd:4230:27400403,27403015:pehd:4230:27403460,27403017:pehd:4230:27403063,27405833:pehd:4230:27407075,27405859:pehd:4230:27406775,27405861:pehd:4230:27406919,27405864:pehd:4230:27406164,27405866:pehd:4230:27406067,27407239:pehd:4230:27407554,27409584:pehd:4230:27412294,27409586:pehd:4230:27411273,27409588:pehd:4230:27410647,27409590:pehd:4230:27410961,27409592:pehd:4230:27410588,27409594:pehd:4230:27411167,27409600:pehd:4230:27409962,27409602:pehd:4230:27410086,27410772:pehd:4230:27411312,27410776:pehd:4230:27411410,27413735:pehd:4230:27414454,27415811:pehd:4230:27416324,27436163:pehd:4230:27436456,27440929:pehd:4230:27442155,27440930:pehd:4230:27441398,27440931:pehd:4230:27441536,27440956:pehd:4230:27441574,27440958:pehd:4230:27441085,27440959:pehd:4230:27441156,27441729:pehd:4230:27442180,27441754:pehd:4230:27442023,27443903:pehd:4230:27444105,27443904:pehd:4230:27445602,27443905:pehd:4230:27444042,27444787:pehd:4230:27445205,27444788:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.011350275966004459, 'nb_photo': 47484, 'list_port_cont': '27395521,27395648,27395743,27399442,27399599,27399900,27400172,27400350,27400408,27400534,27400697,27400928,27400990,27401284,27401358,27403069,27403193,27403459,27403497,27403532,27403575,27403611,27403673,27403715,27403767,27403814,27404004,27404100,27404138,27404182,27404434,27406063,27406158,27406261,27406776,27406918,27407074,27407159,27407557,27407708,27409800,27409957,27410084,27410161,27410273,27410580,27410635,27410970,27411165,27411274,27411302,27411407,27411925,27412049,27412287,27412400,27412475,27413909,27414013,27414237,27414274,27414464,27416052,27416329,27416482,27416587,27417036,27417067,27417264,27417330,27417565,27417735,27418005,27418436,27425138,27436295,27436455,27436787,27436886,27437106,27437302,27437388,27437577,27437677,27437732,27437837,27437938,27438347,27438527,27438611,27438702,27438900,27441079,27441148,27441271,27441402,27441546,27441580,27441632,27441679,27441904,27442024,27442145,27442188,27442568,27443969,27444046,27444110,27444314,27444842,27444883,27445210,27445274,2744533', 'assoc_port': '27395259:27395743,27395260:27395648,27395273:27395521,27399109:27401284,27399111:27401358,27399113:27400928,27399139:27400990,27399141:27400534,27399143:27400697,27399159:27400350,27399161:27400408,27399163:27400172,27399165:27399599,27399184:27399900,27399186:27399442,27402982:27404182,27402983:27404004,27402984:27404138,27402985:27404100,27403006:27403814,27403011:27403611,27403012:27403767,27403013:27403497,27403014:27403532,27403015:27403459,27403016:27403193,27403017:27403069,27403519:27403673,27403520:27403575,27403521:27403715,27404229:27404434,27405831:27407159,27405833:27407074,27405859:27406776,27405861:27406918,27405862:27406261,27405864:27406158,27405866:27406063,27407237:27407708,27407239:27407557,27409558:27412400,27409584:27412287,27409586:27411274,27409588:27410635,27409590:27410970,27409592:27410580,27409594:27411165,27409596:27410161,27409598:27410273,27409600:27409957,27409602:27410084,27409604:27409800,27410743:27412049,27410745:27412475,27410772:27411302,27410774:27411925,27410776:2741140', 'assoc_mat': '27395259:pet_clair:4230:27395743,27395260:pet_clair:4230:27395648,27395273:pet_clair:4230:27395521,27399109:pet_clair:4230:27401284,27399111:pet_clair:4230:27401358,27399113:pet_clair:4230:27400928,27399139:pet_clair:4230:27400990,27399141:pet_clair:4230:27400534,27399143:pet_clair:4230:27400697,27399159:pet_clair:4230:27400350,27399161:pet_clair:4230:27400408,27399163:pet_clair:4230:27400172,27399165:pet_clair:4230:27399599,27399184:pet_clair:4230:27399900,27399186:pet_clair:4230:27399442,27402982:pet_clair:4230:27404182,27402983:pet_clair:4230:27404004,27402984:pet_clair:4230:27404138,27402985:pet_clair:4230:27404100,27403006:pet_clair:4230:27403814,27403011:pet_clair:4230:27403611,27403012:pet_clair:4230:27403767,27403013:pet_clair:4230:27403497,27403014:pet_clair:4230:27403532,27403015:pet_clair:4230:27403459,27403016:pet_clair:4230:27403193,27403017:pet_clair:4230:27403069,27403519:pet_clair:4230:27403673,27403520:pet_clair:4230:27403575,27403521:pet_clair:4230:27403715,27404229:pet_clair:4230:27404434,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0008547299245768952, 'nb_photo': 582, 'list_port_cont': '27395748,27399436,27399897,27400405,27400531,27400998,27401283,27403574,27403678,27403710,27404003,27404136,27404441,27406155,27406777,27406922,27407069,27407152,27409960,27410093,27410585,27411164,27411276,27411413,27412055,27412394,27412477,27413894,27414020,27414235,27414271,27414463,27416486,27416592,27417032,27417261,27436460,27437308,27438707,27438899,27441089,27441403,27441543,27441578,27441903,27442156,27442189,27443975,27444103,27444843,27445272,27445328,27445388,27445566,27445606,27447117,27447900,27448117,27448501,27448645,27450927,27451233,27451554,27451690,27453963,27487836,27488449,27489687,27489770,27490452,27491282,27491679,27491858,27492278,27492444,27492899,27493058,27493350,27493558,27493677,27493866,27494336,27494898,27495729,27496244,27496689,27584928,27586375,27594359,27594706,27597355,27603096,27635617,27638530,27638655,27639201,27639859,27640670,27640823,27641041,27641107,27641409,27641499,27642008,27642506,27642627,27642990,27643285,27643458,27643924,27644287,27644378,27644738,2764626', 'assoc_port': '27395259:27395748,27399109:27401283,27399139:27400998,27399141:27400531,27399161:27400405,27399184:27399897,27399186:27399436,27402983:27404003,27402984:27404136,27403519:27403678,27403520:27403574,27403521:27403710,27404229:27404441,27405831:27407152,27405833:27407069,27405859:27406777,27405861:27406922,27405864:27406155,27409558:27412394,27409586:27411276,27409592:27410585,27409594:27411164,27409600:27409960,27409602:27410093,27410743:27412055,27410745:27412477,27410776:27411413,27413735:27414463,27413736:27414271,27413737:27414235,27413738:27414020,27413739:27413894,27415784:27416592,27415785:27416486,27416736:27417261,27416738:27417032,27436084:27438707,27436087:27438899,27436153:27437308,27436163:27436460,27440929:27442156,27440930:27441403,27440931:27441543,27440956:27441578,27440958:27441089,27441729:27442189,27441755:27441903,27443903:27444103,27443904:27445606,27443920:27443975,27444788:27445388,27444789:27445566,27444791:27444843,27444792:27445272,27445235:27445328,27446719:27448117,27446726:2744790', 'assoc_mat': '27395259:pet_fonce:4230:27395748,27399109:pet_fonce:4230:27401283,27399139:pet_fonce:4230:27400998,27399141:pet_fonce:4230:27400531,27399161:pet_fonce:4230:27400405,27399184:pet_fonce:4230:27399897,27399186:pet_fonce:4230:27399436,27402983:pet_fonce:4230:27404003,27402984:pet_fonce:4230:27404136,27403519:pet_fonce:4230:27403678,27403520:pet_fonce:4230:27403574,27403521:pet_fonce:4230:27403710,27404229:pet_fonce:4230:27404441,27405831:pet_fonce:4230:27407152,27405833:pet_fonce:4230:27407069,27405859:pet_fonce:4230:27406777,27405861:pet_fonce:4230:27406922,27405864:pet_fonce:4230:27406155,27409558:pet_fonce:4230:27412394,27409586:pet_fonce:4230:27411276,27409592:pet_fonce:4230:27410585,27409594:pet_fonce:4230:27411164,27409600:pet_fonce:4230:27409960,27409602:pet_fonce:4230:27410093,27410743:pet_fonce:4230:27412055,27410745:pet_fonce:4230:27412477,27410776:pet_fonce:4230:27411413,27413735:pet_fonce:4230:27414463,27413736:pet_fonce:4230:27414271,27413737:pet_fonce:4230:27414235,27413738:pet_fonce:4230:27414020,2'}), 'main_stat': {'nb_photos': 5297}}, 'hostname': (('raspi-84',),), 'impurety_average_per_hashtag': []} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((5297,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('truck', 5031),), 'material_dict': {'truck': 5031}, 'coverage_data': (('2025/10/18/', 0.245257), ('2025/10/17/', 0.245605), ('2025/10/16/', 0.245373), ('2025/10/15/', 0.24572), ('2025/10/14/', 0.245026), ('2025/10/13/', 0.245142), ('2025/10/12/', 0.245836), ('2025/10/11/', 0.245142), ('2025/10/10/', 0.245142), ('2025/10/09/', 0.245257), ('2025/10/08/', 0.245373), ('2025/10/07/', 0.24572), ('2025/10/06/', 0.245026), ('2025/10/05/', 0.245142), ('2025/10/04/', 0.245489), ('2025/10/03/', 0.245952), ('2025/10/02/', 0.245257), ('2025/10/01/', 0.244795)), 'impurety_average_data': ((datetime.date(2025, 10, 1), 0.15459241350447547, 2), (datetime.date(2025, 10, 2), 0.19508427173230838, 3), (datetime.date(2025, 10, 3), 0.14981955984378395, 2), (datetime.date(2025, 10, 4), 0.18701815050984477, 3), (datetime.date(2025, 10, 5), 0.14517035415585344, 2), (datetime.date(2025, 10, 6), 0.190161376064753, 2), (datetime.date(2025, 10, 7), 0.1933123832392713, 5), (datetime.date(2025, 10, 8), 0.17856707323220522, 2), (datetime.date(2025, 10, 9), 0.19102644067141736, 25), (datetime.date(2025, 10, 10), 0.1958075070068677, 4), (datetime.date(2025, 10, 11), 0.1810294878791529, 2), (datetime.date(2025, 10, 12), 0.1837807241633068, 7), (datetime.date(2025, 10, 13), 0.17499918786511443, 2), (datetime.date(2025, 10, 14), 0.16632264666450666, 4), (datetime.date(2025, 10, 15), 0.18656150597031548, 2), (datetime.date(2025, 10, 16), 0.19017179211406757, 4), (datetime.date(2025, 10, 17), 0.16949601373555895, 3)), 'impurety_average_data_per_hashtag': {'truck': ((datetime.date(2025, 10, 1), 0.15459241350447547, 2), (datetime.date(2025, 10, 2), 0.19508427173230838, 3), (datetime.date(2025, 10, 3), 0.14981955984378395, 2), (datetime.date(2025, 10, 4), 0.18701815050984477, 3), (datetime.date(2025, 10, 5), 0.14517035415585344, 2), (datetime.date(2025, 10, 6), 0.190161376064753, 2), (datetime.date(2025, 10, 7), 0.1933123832392713, 5), (datetime.date(2025, 10, 8), 0.17856707323220522, 2), (datetime.date(2025, 10, 9), 0.19102644067141736, 25), (datetime.date(2025, 10, 10), 0.1958075070068677, 4), (datetime.date(2025, 10, 11), 0.1810294878791529, 2), (datetime.date(2025, 10, 12), 0.1837807241633068, 7), (datetime.date(2025, 10, 13), 0.17499918786511443, 2), (datetime.date(2025, 10, 14), 0.16632264666450666, 4), (datetime.date(2025, 10, 15), 0.18656150597031548, 2), (datetime.date(2025, 10, 16), 0.19017179211406757, 4), (datetime.date(2025, 10, 17), 0.16949601373555895, 3))}, 'quality_array': [['-7.749731242977575', '01102025'], ['-7.7340145391407935', '02102025'], ['-7.522904678761355', '03102025'], ['-7.361013470587695', '04102025'], ['-7.660796674119093', '05102025'], ['-7.1912601736032356', '06102025'], ['-7.4085973155451965', '07102025'], ['-7.3961983014553585', '08102025'], ['-7.058967530156725', '09102025'], ['-7.354792621762543', '10102025'], ['-7.104281626653477', '11102025'], ['-7.242738806286403', '12102025'], ['-7.120935467274089', '13102025'], ['-7.151555940250032', '14102025'], ['-6.782584331970562', '15102025'], ['-6.969893193424652', '16102025'], ['-7.235530784005886', '17102025']], 'number_of_batch': ((887,),), 'datou_id_sts': 4311, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.02082795753236499, 'nb_photo': 73870, 'list_port_cont': '27395522,27395645,27395738,27399428,27399589,27399893,27400182,27400336,27400399,27400533,27400683,27400920,27400989,27401273,27401362,27403075,27403191,27403449,27403494,27403541,27403578,27403602,27403671,27403706,27403773,27403804,27404005,27404092,27404127,27404186,27404430,27406058,27406165,27406250,27406772,27406927,27407068,27407161,27407551,27407696,27409798,27409951,27410081,27410149,27410271,27410577,27410640,27410960,27411156,27411270,27411298,27411402,27411915,27412052,27412288,27412396,27412485,27413906,27414022,27414225,27414276,27414462,27416043,27416316,27416480,27416586,27417030,27417062,27417263,27417327,27417572,27417721,27418008,27418429,27425133,27436286,27436446,27436775,27436881,27437097,27437305,27437392,27437563,27437679,27437733,27437845,27437935,27438337,27438510,27438603,27438699,27438891,27441075,27441155,27441260,27441390,27441533,27441568,27441636,27441676,27441907,27442027,27442152,27442192,27442561,27443972,27444034,27444099,27444320,27444836,27444881,27445197,27445267,2744531', 'assoc_port': '27395259:27395738,27395260:27395645,27395273:27395522,27399109:27401273,27399111:27401362,27399113:27400920,27399139:27400989,27399141:27400533,27399143:27400683,27399159:27400336,27399161:27400399,27399163:27400182,27399165:27399589,27399184:27399893,27399186:27399428,27402982:27404186,27402983:27404005,27402984:27404127,27402985:27404092,27403006:27403804,27403011:27403602,27403012:27403773,27403013:27403494,27403014:27403541,27403015:27403449,27403016:27403191,27403017:27403075,27403519:27403671,27403520:27403578,27403521:27403706,27404229:27404430,27405831:27407161,27405833:27407068,27405859:27406772,27405861:27406927,27405862:27406250,27405864:27406165,27405866:27406058,27407237:27407696,27407239:27407551,27409558:27412396,27409584:27412288,27409586:27411270,27409588:27410640,27409590:27410960,27409592:27410577,27409594:27411156,27409596:27410149,27409598:27410271,27409600:27409951,27409602:27410081,27409604:27409798,27410743:27412052,27410745:27412485,27410772:27411298,27410774:27411915,27410776:2741140', 'assoc_mat': '27395259:autre:4230:27395738,27395260:autre:4230:27395645,27395273:autre:4230:27395522,27399109:autre:4230:27401273,27399111:autre:4230:27401362,27399113:autre:4230:27400920,27399139:autre:4230:27400989,27399141:autre:4230:27400533,27399143:autre:4230:27400683,27399159:autre:4230:27400336,27399161:autre:4230:27400399,27399163:autre:4230:27400182,27399165:autre:4230:27399589,27399184:autre:4230:27399893,27399186:autre:4230:27399428,27402982:autre:4230:27404186,27402983:autre:4230:27404005,27402984:autre:4230:27404127,27402985:autre:4230:27404092,27403006:autre:4230:27403804,27403011:autre:4230:27403602,27403012:autre:4230:27403773,27403013:autre:4230:27403494,27403014:autre:4230:27403541,27403015:autre:4230:27403449,27403016:autre:4230:27403191,27403017:autre:4230:27403075,27403519:autre:4230:27403671,27403520:autre:4230:27403578,27403521:autre:4230:27403706,27404229:autre:4230:27404430,27405831:autre:4230:27407161,27405833:autre:4230:27407068,27405859:autre:4230:27406772,27405861:autre:4230:27406927,27405862:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.026849581033900574, 'nb_photo': 87051, 'list_port_cont': '27395531,27395639,27395741,27399443,27399594,27399899,27400174,27400349,27400411,27400537,27400686,27400919,27400996,27401279,27401359,27403077,27403200,27403458,27403498,27403530,27403579,27403612,27403674,27403714,27403774,27403807,27404002,27404103,27404134,27404183,27404443,27406057,27406166,27406260,27406768,27406924,27407072,27407153,27407544,27407709,27409810,27409958,27410092,27410164,27410268,27410576,27410646,27410963,27411168,27411266,27411303,27411412,27411917,27412053,27412297,27412398,27412479,27413908,27414011,27414238,27414273,27414452,27416055,27416325,27416485,27416583,27417034,27417065,27417258,27417318,27417571,27417725,27418015,27418428,27425130,27436290,27436457,27436777,27436893,27437107,27437307,27437386,27437568,27437685,27437727,27437840,27437937,27438346,27438516,27438614,27438704,27438897,27441082,27441153,27441264,27441393,27441545,27441579,27441640,27441674,27441909,27442025,27442154,27442190,27442566,27443966,27444048,27444102,27444321,27444840,27444869,27445209,27445268,2744533', 'assoc_port': '27395259:27395741,27395260:27395639,27395273:27395531,27399109:27401279,27399111:27401359,27399113:27400919,27399139:27400996,27399141:27400537,27399143:27400686,27399159:27400349,27399161:27400411,27399163:27400174,27399165:27399594,27399184:27399899,27399186:27399443,27402982:27404183,27402983:27404002,27402984:27404134,27402985:27404103,27403006:27403807,27403011:27403612,27403012:27403774,27403013:27403498,27403014:27403530,27403015:27403458,27403016:27403200,27403017:27403077,27403519:27403674,27403520:27403579,27403521:27403714,27404229:27404443,27405831:27407153,27405833:27407072,27405859:27406768,27405861:27406924,27405862:27406260,27405864:27406166,27405866:27406057,27407237:27407709,27407239:27407544,27409558:27412398,27409584:27412297,27409586:27411266,27409588:27410646,27409590:27410963,27409592:27410576,27409594:27411168,27409596:27410164,27409598:27410268,27409600:27409958,27409602:27410092,27409604:27409810,27410743:27412053,27410745:27412479,27410772:27411303,27410774:27411917,27410776:2741141', 'assoc_mat': '27395259:carton:4230:27395741,27395260:carton:4230:27395639,27395273:carton:4230:27395531,27399109:carton:4230:27401279,27399111:carton:4230:27401359,27399113:carton:4230:27400919,27399139:carton:4230:27400996,27399141:carton:4230:27400537,27399143:carton:4230:27400686,27399159:carton:4230:27400349,27399161:carton:4230:27400411,27399163:carton:4230:27400174,27399165:carton:4230:27399594,27399184:carton:4230:27399899,27399186:carton:4230:27399443,27402982:carton:4230:27404183,27402983:carton:4230:27404002,27402984:carton:4230:27404134,27402985:carton:4230:27404103,27403006:carton:4230:27403807,27403011:carton:4230:27403612,27403012:carton:4230:27403774,27403013:carton:4230:27403498,27403014:carton:4230:27403530,27403015:carton:4230:27403458,27403016:carton:4230:27403200,27403017:carton:4230:27403077,27403519:carton:4230:27403674,27403520:carton:4230:27403579,27403521:carton:4230:27403714,27404229:carton:4230:27404443,27405831:carton:4230:27407153,27405833:carton:4230:27407072,27405859:carton:4230:27406768,2740'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.004924424740854543, 'nb_photo': 2691, 'list_port_cont': '27395526,27395737,27399601,27399901,27400183,27400404,27401352,27403066,27403199,27403455,27403529,27403605,27403811,27403998,27404099,27404124,27404179,27404427,27406056,27406257,27406773,27407064,27407145,27407541,27407704,27409812,27410094,27410159,27410275,27410584,27410644,27410956,27411159,27411264,27411411,27411921,27412051,27412295,27412383,27412468,27413905,27414236,27414266,27414450,27416044,27416320,27416475,27416580,27417029,27417071,27417260,27417321,27417559,27417726,27418002,27418426,27436458,27436770,27436883,27437105,27437295,27437393,27437574,27437670,27437728,27437838,27437934,27438511,27438619,27438700,27438884,27441262,27441628,27441894,27442186,27443978,27444032,27444108,27444839,27444879,27445196,27445275,27445331,27445381,27445435,27445564,27445600,27446975,27447018,27447127,27447193,27447340,27447377,27447425,27447466,27447557,27447591,27447692,27447831,27447886,27447935,27447980,27448081,27448110,27448149,27448486,27448553,27448641,27449125,27449231,27449320,27450919,27450973,2745135', 'assoc_port': '27395259:27395737,27395273:27395526,27399111:27401352,27399161:27400404,27399163:27400183,27399165:27399601,27399184:27399901,27402982:27404179,27402983:27403998,27402984:27404124,27402985:27404099,27403006:27403811,27403011:27403605,27403014:27403529,27403015:27403455,27403016:27403199,27403017:27403066,27404229:27404427,27405831:27407145,27405833:27407064,27405859:27406773,27405862:27406257,27405866:27406056,27407237:27407704,27407239:27407541,27409558:27412383,27409584:27412295,27409586:27411264,27409588:27410644,27409590:27410956,27409592:27410584,27409594:27411159,27409596:27410159,27409598:27410275,27409602:27410094,27409604:27409812,27410743:27412051,27410745:27412468,27410774:27411921,27410776:27411411,27413735:27414450,27413736:27414266,27413737:27414236,27413739:27413905,27415784:27416580,27415785:27416475,27415810:27416044,27415811:27416320,27416706:27417559,27416720:27417321,27416734:27417071,27416736:27417260,27416738:27417029,27417551:27417726,27417552:27418002,27418344:27418426,27436082:2743861', 'assoc_mat': '27395259:metal:4230:27395737,27395273:metal:4230:27395526,27399111:metal:4230:27401352,27399161:metal:4230:27400404,27399163:metal:4230:27400183,27399165:metal:4230:27399601,27399184:metal:4230:27399901,27402982:metal:4230:27404179,27402983:metal:4230:27403998,27402984:metal:4230:27404124,27402985:metal:4230:27404099,27403006:metal:4230:27403811,27403011:metal:4230:27403605,27403014:metal:4230:27403529,27403015:metal:4230:27403455,27403016:metal:4230:27403199,27403017:metal:4230:27403066,27404229:metal:4230:27404427,27405831:metal:4230:27407145,27405833:metal:4230:27407064,27405859:metal:4230:27406773,27405862:metal:4230:27406257,27405866:metal:4230:27406056,27407237:metal:4230:27407704,27407239:metal:4230:27407541,27409558:metal:4230:27412383,27409584:metal:4230:27412295,27409586:metal:4230:27411264,27409588:metal:4230:27410644,27409590:metal:4230:27410956,27409592:metal:4230:27410584,27409594:metal:4230:27411159,27409596:metal:4230:27410159,27409598:metal:4230:27410275,27409602:metal:4230:27410094,27409604:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.11440422348652039, 'nb_photo': 272036, 'list_port_cont': '27395523,27395634,27395742,27399441,27399597,27399902,27400176,27400340,27400410,27400538,27400692,27400930,27400999,27401282,27401361,27403074,27403201,27403450,27403499,27403538,27403572,27403616,27403670,27403713,27403771,27403816,27403997,27404101,27404137,27404192,27404442,27406065,27406161,27406263,27406779,27406926,27407080,27407156,27407553,27407703,27409808,27409949,27410088,27410163,27410264,27410582,27410643,27410957,27411166,27411275,27411308,27411404,27411918,27412046,27412285,27412391,27412478,27413896,27414012,27414233,27414263,27414457,27416057,27416323,27416474,27416594,27417037,27417072,27417253,27417319,27417567,27417731,27418012,27418437,27425142,27436293,27436459,27436778,27436891,27437108,27437306,27437384,27437575,27437673,27437736,27437841,27437933,27438345,27438526,27438608,27438711,27438896,27441081,27441158,27441261,27441404,27441534,27441581,27441637,27441677,27441902,27442026,27442153,27442184,27442573,27443971,27444041,27444109,27444322,27444834,27444880,27445206,27445266,2744532', 'assoc_port': '27395259:27395742,27395260:27395634,27395273:27395523,27399109:27401282,27399111:27401361,27399113:27400930,27399139:27400999,27399141:27400538,27399143:27400692,27399159:27400340,27399161:27400410,27399163:27400176,27399165:27399597,27399184:27399902,27399186:27399441,27402982:27404192,27402983:27403997,27402984:27404137,27402985:27404101,27403006:27403816,27403011:27403616,27403012:27403771,27403013:27403499,27403014:27403538,27403015:27403450,27403016:27403201,27403017:27403074,27403519:27403670,27403520:27403572,27403521:27403713,27404229:27404442,27405831:27407156,27405833:27407080,27405859:27406779,27405861:27406926,27405862:27406263,27405864:27406161,27405866:27406065,27407237:27407703,27407239:27407553,27409558:27412391,27409584:27412285,27409586:27411275,27409588:27410643,27409590:27410957,27409592:27410582,27409594:27411166,27409596:27410163,27409598:27410264,27409600:27409949,27409602:27410088,27409604:27409808,27410743:27412046,27410745:27412478,27410772:27411308,27410774:27411918,27410776:2741140', 'assoc_mat': '27395259:papier:4230:27395742,27395260:papier:4230:27395634,27395273:papier:4230:27395523,27399109:papier:4230:27401282,27399111:papier:4230:27401361,27399113:papier:4230:27400930,27399139:papier:4230:27400999,27399141:papier:4230:27400538,27399143:papier:4230:27400692,27399159:papier:4230:27400340,27399161:papier:4230:27400410,27399163:papier:4230:27400176,27399165:papier:4230:27399597,27399184:papier:4230:27399902,27399186:papier:4230:27399441,27402982:papier:4230:27404192,27402983:papier:4230:27403997,27402984:papier:4230:27404137,27402985:papier:4230:27404101,27403006:papier:4230:27403816,27403011:papier:4230:27403616,27403012:papier:4230:27403771,27403013:papier:4230:27403499,27403014:papier:4230:27403538,27403015:papier:4230:27403450,27403016:papier:4230:27403201,27403017:papier:4230:27403074,27403519:papier:4230:27403670,27403520:papier:4230:27403572,27403521:papier:4230:27403713,27404229:papier:4230:27404442,27405831:papier:4230:27407156,27405833:papier:4230:27407080,27405859:papier:4230:27406779,2740'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0012162768274405992, 'nb_photo': 1401, 'list_port_cont': '27395527,27395647,27400403,27403063,27403460,27406067,27406164,27406775,27406919,27407075,27407554,27409962,27410086,27410588,27410647,27410961,27411167,27411273,27411312,27411410,27412294,27414454,27416324,27436456,27441085,27441156,27441398,27441536,27441574,27442023,27442155,27442180,27444042,27444105,27444846,27445205,27445277,27445327,27445382,27445439,27445563,27445602,27447370,27447434,27447561,27448078,27448497,27449332,27451357,27451552,27451695,27454122,27455901,27486764,27487056,27487098,27487474,27487802,27487838,27488051,27488225,27488416,27488454,27489002,27489151,27489766,27492446,27493343,27493670,27493876,27494894,27495577,27495733,27496229,27496698,27585164,27585427,27585759,27585844,27586171,27586373,27589066,27589755,27589895,27594701,27597449,27603093,27634101,27634266,27634377,27634598,27634706,27635609,27635885,27637411,27637717,27637928,27638523,27640825,27641115,27641323,27641410,27641506,27642494,27642629,27643288,27643920,27644196,27644733,27644776,27644978,27645119,27645329,2764559', 'assoc_port': '27395260:27395647,27395273:27395527,27399161:27400403,27403015:27403460,27403017:27403063,27405833:27407075,27405859:27406775,27405861:27406919,27405864:27406164,27405866:27406067,27407239:27407554,27409584:27412294,27409586:27411273,27409588:27410647,27409590:27410961,27409592:27410588,27409594:27411167,27409600:27409962,27409602:27410086,27410772:27411312,27410776:27411410,27413735:27414454,27415811:27416324,27436163:27436456,27440929:27442155,27440930:27441398,27440931:27441536,27440956:27441574,27440958:27441085,27440959:27441156,27441729:27442180,27441754:27442023,27443903:27444105,27443904:27445602,27443905:27444042,27444787:27445205,27444788:27445382,27444789:27445563,27444791:27444846,27444792:27445277,27445235:27445327,27445236:27445439,27446720:27448078,27446728:27447370,27447321:27447561,27447322:27447434,27448406:27448497,27449011:27449332,27450681:27451552,27450682:27451695,27450708:27451357,27453274:27454122,27454450:27455901,27486314:27489766,27486318:27489151,27486322:27489002,27486340:2748845', 'assoc_mat': '27395260:pehd:4230:27395647,27395273:pehd:4230:27395527,27399161:pehd:4230:27400403,27403015:pehd:4230:27403460,27403017:pehd:4230:27403063,27405833:pehd:4230:27407075,27405859:pehd:4230:27406775,27405861:pehd:4230:27406919,27405864:pehd:4230:27406164,27405866:pehd:4230:27406067,27407239:pehd:4230:27407554,27409584:pehd:4230:27412294,27409586:pehd:4230:27411273,27409588:pehd:4230:27410647,27409590:pehd:4230:27410961,27409592:pehd:4230:27410588,27409594:pehd:4230:27411167,27409600:pehd:4230:27409962,27409602:pehd:4230:27410086,27410772:pehd:4230:27411312,27410776:pehd:4230:27411410,27413735:pehd:4230:27414454,27415811:pehd:4230:27416324,27436163:pehd:4230:27436456,27440929:pehd:4230:27442155,27440930:pehd:4230:27441398,27440931:pehd:4230:27441536,27440956:pehd:4230:27441574,27440958:pehd:4230:27441085,27440959:pehd:4230:27441156,27441729:pehd:4230:27442180,27441754:pehd:4230:27442023,27443903:pehd:4230:27444105,27443904:pehd:4230:27445602,27443905:pehd:4230:27444042,27444787:pehd:4230:27445205,27444788:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.011350275966004459, 'nb_photo': 47484, 'list_port_cont': '27395521,27395648,27395743,27399442,27399599,27399900,27400172,27400350,27400408,27400534,27400697,27400928,27400990,27401284,27401358,27403069,27403193,27403459,27403497,27403532,27403575,27403611,27403673,27403715,27403767,27403814,27404004,27404100,27404138,27404182,27404434,27406063,27406158,27406261,27406776,27406918,27407074,27407159,27407557,27407708,27409800,27409957,27410084,27410161,27410273,27410580,27410635,27410970,27411165,27411274,27411302,27411407,27411925,27412049,27412287,27412400,27412475,27413909,27414013,27414237,27414274,27414464,27416052,27416329,27416482,27416587,27417036,27417067,27417264,27417330,27417565,27417735,27418005,27418436,27425138,27436295,27436455,27436787,27436886,27437106,27437302,27437388,27437577,27437677,27437732,27437837,27437938,27438347,27438527,27438611,27438702,27438900,27441079,27441148,27441271,27441402,27441546,27441580,27441632,27441679,27441904,27442024,27442145,27442188,27442568,27443969,27444046,27444110,27444314,27444842,27444883,27445210,27445274,2744533', 'assoc_port': '27395259:27395743,27395260:27395648,27395273:27395521,27399109:27401284,27399111:27401358,27399113:27400928,27399139:27400990,27399141:27400534,27399143:27400697,27399159:27400350,27399161:27400408,27399163:27400172,27399165:27399599,27399184:27399900,27399186:27399442,27402982:27404182,27402983:27404004,27402984:27404138,27402985:27404100,27403006:27403814,27403011:27403611,27403012:27403767,27403013:27403497,27403014:27403532,27403015:27403459,27403016:27403193,27403017:27403069,27403519:27403673,27403520:27403575,27403521:27403715,27404229:27404434,27405831:27407159,27405833:27407074,27405859:27406776,27405861:27406918,27405862:27406261,27405864:27406158,27405866:27406063,27407237:27407708,27407239:27407557,27409558:27412400,27409584:27412287,27409586:27411274,27409588:27410635,27409590:27410970,27409592:27410580,27409594:27411165,27409596:27410161,27409598:27410273,27409600:27409957,27409602:27410084,27409604:27409800,27410743:27412049,27410745:27412475,27410772:27411302,27410774:27411925,27410776:2741140', 'assoc_mat': '27395259:pet_clair:4230:27395743,27395260:pet_clair:4230:27395648,27395273:pet_clair:4230:27395521,27399109:pet_clair:4230:27401284,27399111:pet_clair:4230:27401358,27399113:pet_clair:4230:27400928,27399139:pet_clair:4230:27400990,27399141:pet_clair:4230:27400534,27399143:pet_clair:4230:27400697,27399159:pet_clair:4230:27400350,27399161:pet_clair:4230:27400408,27399163:pet_clair:4230:27400172,27399165:pet_clair:4230:27399599,27399184:pet_clair:4230:27399900,27399186:pet_clair:4230:27399442,27402982:pet_clair:4230:27404182,27402983:pet_clair:4230:27404004,27402984:pet_clair:4230:27404138,27402985:pet_clair:4230:27404100,27403006:pet_clair:4230:27403814,27403011:pet_clair:4230:27403611,27403012:pet_clair:4230:27403767,27403013:pet_clair:4230:27403497,27403014:pet_clair:4230:27403532,27403015:pet_clair:4230:27403459,27403016:pet_clair:4230:27403193,27403017:pet_clair:4230:27403069,27403519:pet_clair:4230:27403673,27403520:pet_clair:4230:27403575,27403521:pet_clair:4230:27403715,27404229:pet_clair:4230:27404434,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0008547299245768952, 'nb_photo': 582, 'list_port_cont': '27395748,27399436,27399897,27400405,27400531,27400998,27401283,27403574,27403678,27403710,27404003,27404136,27404441,27406155,27406777,27406922,27407069,27407152,27409960,27410093,27410585,27411164,27411276,27411413,27412055,27412394,27412477,27413894,27414020,27414235,27414271,27414463,27416486,27416592,27417032,27417261,27436460,27437308,27438707,27438899,27441089,27441403,27441543,27441578,27441903,27442156,27442189,27443975,27444103,27444843,27445272,27445328,27445388,27445566,27445606,27447117,27447900,27448117,27448501,27448645,27450927,27451233,27451554,27451690,27453963,27487836,27488449,27489687,27489770,27490452,27491282,27491679,27491858,27492278,27492444,27492899,27493058,27493350,27493558,27493677,27493866,27494336,27494898,27495729,27496244,27496689,27584928,27586375,27594359,27594706,27597355,27603096,27635617,27638530,27638655,27639201,27639859,27640670,27640823,27641041,27641107,27641409,27641499,27642008,27642506,27642627,27642990,27643285,27643458,27643924,27644287,27644378,27644738,2764626', 'assoc_port': '27395259:27395748,27399109:27401283,27399139:27400998,27399141:27400531,27399161:27400405,27399184:27399897,27399186:27399436,27402983:27404003,27402984:27404136,27403519:27403678,27403520:27403574,27403521:27403710,27404229:27404441,27405831:27407152,27405833:27407069,27405859:27406777,27405861:27406922,27405864:27406155,27409558:27412394,27409586:27411276,27409592:27410585,27409594:27411164,27409600:27409960,27409602:27410093,27410743:27412055,27410745:27412477,27410776:27411413,27413735:27414463,27413736:27414271,27413737:27414235,27413738:27414020,27413739:27413894,27415784:27416592,27415785:27416486,27416736:27417261,27416738:27417032,27436084:27438707,27436087:27438899,27436153:27437308,27436163:27436460,27440929:27442156,27440930:27441403,27440931:27441543,27440956:27441578,27440958:27441089,27441729:27442189,27441755:27441903,27443903:27444103,27443904:27445606,27443920:27443975,27444788:27445388,27444789:27445566,27444791:27444843,27444792:27445272,27445235:27445328,27446719:27448117,27446726:2744790', 'assoc_mat': '27395259:pet_fonce:4230:27395748,27399109:pet_fonce:4230:27401283,27399139:pet_fonce:4230:27400998,27399141:pet_fonce:4230:27400531,27399161:pet_fonce:4230:27400405,27399184:pet_fonce:4230:27399897,27399186:pet_fonce:4230:27399436,27402983:pet_fonce:4230:27404003,27402984:pet_fonce:4230:27404136,27403519:pet_fonce:4230:27403678,27403520:pet_fonce:4230:27403574,27403521:pet_fonce:4230:27403710,27404229:pet_fonce:4230:27404441,27405831:pet_fonce:4230:27407152,27405833:pet_fonce:4230:27407069,27405859:pet_fonce:4230:27406777,27405861:pet_fonce:4230:27406922,27405864:pet_fonce:4230:27406155,27409558:pet_fonce:4230:27412394,27409586:pet_fonce:4230:27411276,27409592:pet_fonce:4230:27410585,27409594:pet_fonce:4230:27411164,27409600:pet_fonce:4230:27409960,27409602:pet_fonce:4230:27410093,27410743:pet_fonce:4230:27412055,27410745:pet_fonce:4230:27412477,27410776:pet_fonce:4230:27411413,27413735:pet_fonce:4230:27414463,27413736:pet_fonce:4230:27414271,27413737:pet_fonce:4230:27414235,27413738:pet_fonce:4230:27414020,2'}), 'main_stat': {'nb_photos': 5297}}, 'hostname': (('raspi-84',),), 'impurety_average_per_hashtag': []} filepath : /data_4/data_log/job/memo/dechet_Valcor_v2/sla_mensuel_dechet_Valcor_v2_mois_10_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'truck': {'autre': ['autre', '2.08%', 73870], 'carton': ['carton', '2.68%', 87051], 'metal': ['metal', '0.49%', 2691], 'papier': ['papier', '11.44%', 272036], 'pehd': ['pehd', '0.12%', 1401], 'pet_clair': ['pet_clair', '1.14%', 47484], 'pet_fonce': ['pet_fonce', '0.09%', 582]}} before organize_and_plot_coverage_data before organize_and_plot_impurety_average_data before organize_and_plot_quality_photo_data finish generating filepath : /data_4/data_log/job/memo/dechet_Valcor_v2/sla_mensuel_dechet_Valcor_v2_mois_10_annee_2025.pdf le fichier se trouve ici : /data_4/data_log/job/memo/dechet_Valcor_v2 3.06user 2.21system 2:02:05elapsed 0%CPU (0avgtext+0avgdata 157768maxresident)k 199208inputs+560outputs (16169major+71788minor)pagefaults 0swaps