python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=30073 --dashboard_places=arc_en_ciel_jrm --rootfolder_sla=/data_2/data_log/job/memo/arc_en_ciel_jrm -v --mtr_id=979 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 30073, Date : 2025-03 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (5, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4873 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4873 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4873 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4873 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4878 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4878 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4878 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4878 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4302 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4302 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4302 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (5, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4873 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4873 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4873 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4873 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4878 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4878 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4878 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4878 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4302 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4302 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4302 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 10 month : 03 mtr_id : 979 dashboard_places : arc_en_ciel_jrm date : 2025-03 year : 2025 raspi : 30073 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'arc_en_ciel_jrm' and date like '%2025-03%') and created_at like '%2025-03%'))); nb_day : (5, 31) after unwanted_material_data nb_day : (5, 31) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%30073%' AND ms.result_str like '%2025/03%'ORDER BY ms.id desc LIMIT 0, 1000000; No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66863 seconds', 'coverage_times_pause': '0 days 67860 seconds', 'nb_photos_decision': 6706, 'nb_gray_level_ok': 6706, 'nb_dedup_ok': 2898, 'nb_two_criteria_ok': 2898, 'nb_forced_upload': 62, 'end_of_day_photos_duplicated': 3807, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2959, 'ratio_coverage': 0.9775435313381775}, 'dashboard_dict': {'nb_ptf_finished': 49, 'nb_images_finished': 2858, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 50, 'nb_selected_images': 2908, 'last_update': '2025/04/04', 'portfolio_id': 21894590, 'last_run_id': 1714497, 'total_number_of_photos': 2965}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66863 seconds', 'coverage_times_pause': '0 days 67860 seconds', 'nb_photos_decision': 6706, 'nb_gray_level_ok': 6706, 'nb_dedup_ok': 2898, 'nb_two_criteria_ok': 2898, 'nb_forced_upload': 62, 'end_of_day_photos_duplicated': 3807, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2959, 'ratio_coverage': 0.9775435313381775}, 'dashboard_dict': {'nb_ptf_finished': 49, 'nb_images_finished': 2858, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 50, 'nb_selected_images': 2908, 'last_update': '2025/04/01', 'portfolio_id': 21894590, 'last_run_id': 1714497, 'total_number_of_photos': 2965}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1784, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 17615 seconds', 'coverage_times_pause': '0 days 17889 seconds', 'nb_photos_decision': 1776, 'nb_gray_level_ok': 1776, 'nb_dedup_ok': 40, 'nb_two_criteria_ok': 40, 'nb_forced_upload': 13, 'end_of_day_photos_duplicated': 1731, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 52, 'ratio_coverage': 0.9786654814156343}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 9, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 9, 'last_update': '2025/03/31', 'portfolio_id': 21866910, 'last_run_id': 1710028, 'total_number_of_photos': 53}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 84482 seconds', 'coverage_times_pause': '0 days 85745 seconds', 'nb_photos_decision': 8466, 'nb_gray_level_ok': 8466, 'nb_dedup_ok': 3279, 'nb_two_criteria_ok': 3279, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 5183, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3366, 'ratio_coverage': 0.9778122431972592}, 'dashboard_dict': {'nb_ptf_finished': 63, 'nb_images_finished': 3300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3300, 'last_update': '2025/03/29', 'portfolio_id': 21820661, 'last_run_id': 1708297, 'total_number_of_photos': 3395}} No error ? {'log_dict': {'total_nb_images': 8563, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84671 seconds', 'coverage_times_pause': '0 days 85866 seconds', 'nb_photos_decision': 8491, 'nb_gray_level_ok': 8491, 'nb_dedup_ok': 4285, 'nb_two_criteria_ok': 4285, 'nb_forced_upload': 77, 'end_of_day_photos_duplicated': 4204, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4358, 'ratio_coverage': 0.9799997685158393}, 'dashboard_dict': {'nb_ptf_finished': 71, 'nb_images_finished': 4336, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4336, 'last_update': '2025/03/28', 'portfolio_id': 21758531, 'last_run_id': 1704593, 'total_number_of_photos': 4388}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66863 seconds', 'coverage_times_pause': '0 days 67860 seconds', 'nb_photos_decision': 6706, 'nb_gray_level_ok': 6706, 'nb_dedup_ok': 2898, 'nb_two_criteria_ok': 2898, 'nb_forced_upload': 62, 'end_of_day_photos_duplicated': 3807, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2959, 'ratio_coverage': 0.9775435313381775}, 'dashboard_dict': {'nb_ptf_finished': 49, 'nb_images_finished': 2858, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 50, 'nb_selected_images': 2908, 'last_update': '2025/04/01', 'portfolio_id': 21894590, 'last_run_id': 1714497, 'total_number_of_photos': 2965}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 84482 seconds', 'coverage_times_pause': '0 days 85745 seconds', 'nb_photos_decision': 8466, 'nb_gray_level_ok': 8466, 'nb_dedup_ok': 3279, 'nb_two_criteria_ok': 3279, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 5183, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3366, 'ratio_coverage': 0.9778122431972592}, 'dashboard_dict': {'nb_ptf_finished': 63, 'nb_images_finished': 3300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3300, 'last_update': '2025/03/29', 'portfolio_id': 21820661, 'last_run_id': 1708297, 'total_number_of_photos': 3395}} No error ? {'log_dict': {'total_nb_images': 8563, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84671 seconds', 'coverage_times_pause': '0 days 85866 seconds', 'nb_photos_decision': 8491, 'nb_gray_level_ok': 8491, 'nb_dedup_ok': 4285, 'nb_two_criteria_ok': 4285, 'nb_forced_upload': 77, 'end_of_day_photos_duplicated': 4204, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4358, 'ratio_coverage': 0.9799997685158393}, 'dashboard_dict': {'nb_ptf_finished': 71, 'nb_images_finished': 4336, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4336, 'last_update': '2025/03/28', 'portfolio_id': 21758531, 'last_run_id': 1704593, 'total_number_of_photos': 4388}} No error ? {'log_dict': {'total_nb_images': 8545, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84486 seconds', 'coverage_times_pause': '0 days 85690 seconds', 'nb_photos_decision': 8450, 'nb_gray_level_ok': 8450, 'nb_dedup_ok': 3905, 'nb_two_criteria_ok': 3905, 'nb_forced_upload': 100, 'end_of_day_photos_duplicated': 4540, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 6, 'end_of_day_photos_uploaded': 3998, 'ratio_coverage': 0.9778585400293985}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3261, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 706, 'nb_selected_images': 3967, 'last_update': '2025/03/31', 'portfolio_id': 21715706, 'last_run_id': 1700517, 'total_number_of_photos': 4026}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66863 seconds', 'coverage_times_pause': '0 days 67860 seconds', 'nb_photos_decision': 6706, 'nb_gray_level_ok': 6706, 'nb_dedup_ok': 2898, 'nb_two_criteria_ok': 2898, 'nb_forced_upload': 62, 'end_of_day_photos_duplicated': 3807, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2959, 'ratio_coverage': 0.9775435313381775}, 'dashboard_dict': {'nb_ptf_finished': 49, 'nb_images_finished': 2858, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 50, 'nb_selected_images': 2908, 'last_update': '2025/04/01', 'portfolio_id': 21894590, 'last_run_id': 1713801, 'total_number_of_photos': 2965}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 84482 seconds', 'coverage_times_pause': '0 days 85745 seconds', 'nb_photos_decision': 8466, 'nb_gray_level_ok': 8466, 'nb_dedup_ok': 3279, 'nb_two_criteria_ok': 3279, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 5183, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3366, 'ratio_coverage': 0.9778122431972592}, 'dashboard_dict': {'nb_ptf_finished': 63, 'nb_images_finished': 3300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3300, 'last_update': '2025/03/29', 'portfolio_id': 21820661, 'last_run_id': 1708297, 'total_number_of_photos': 3395}} No error ? {'log_dict': {'total_nb_images': 8563, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84671 seconds', 'coverage_times_pause': '0 days 85866 seconds', 'nb_photos_decision': 8491, 'nb_gray_level_ok': 8491, 'nb_dedup_ok': 4285, 'nb_two_criteria_ok': 4285, 'nb_forced_upload': 77, 'end_of_day_photos_duplicated': 4204, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4358, 'ratio_coverage': 0.9799997685158393}, 'dashboard_dict': {'nb_ptf_finished': 71, 'nb_images_finished': 4336, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4336, 'last_update': '2025/03/28', 'portfolio_id': 21758531, 'last_run_id': 1704593, 'total_number_of_photos': 4388}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84445 seconds', 'coverage_times_pause': '0 days 85740 seconds', 'nb_photos_decision': 8451, 'nb_gray_level_ok': 8451, 'nb_dedup_ok': 2602, 'nb_two_criteria_ok': 2602, 'nb_forced_upload': 99, 'end_of_day_photos_duplicated': 5849, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2700, 'ratio_coverage': 0.9773839974999711}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2632, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2632, 'last_update': '2025/03/26', 'portfolio_id': 21674640, 'last_run_id': 1697610, 'total_number_of_photos': 2736}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1784, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 17615 seconds', 'coverage_times_pause': '0 days 17889 seconds', 'nb_photos_decision': 1776, 'nb_gray_level_ok': 1776, 'nb_dedup_ok': 40, 'nb_two_criteria_ok': 40, 'nb_forced_upload': 13, 'end_of_day_photos_duplicated': 1731, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 52, 'ratio_coverage': 0.9786654814156343}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 9, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 9, 'last_update': '2025/03/31', 'portfolio_id': 21866910, 'last_run_id': 1710028, 'total_number_of_photos': 53}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 84482 seconds', 'coverage_times_pause': '0 days 85745 seconds', 'nb_photos_decision': 8466, 'nb_gray_level_ok': 8466, 'nb_dedup_ok': 3279, 'nb_two_criteria_ok': 3279, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 5183, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3366, 'ratio_coverage': 0.9778122431972592}, 'dashboard_dict': {'nb_ptf_finished': 63, 'nb_images_finished': 3300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3300, 'last_update': '2025/03/29', 'portfolio_id': 21820661, 'last_run_id': 1708297, 'total_number_of_photos': 3395}} No error ? {'log_dict': {'total_nb_images': 8563, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84671 seconds', 'coverage_times_pause': '0 days 85866 seconds', 'nb_photos_decision': 8491, 'nb_gray_level_ok': 8491, 'nb_dedup_ok': 4285, 'nb_two_criteria_ok': 4285, 'nb_forced_upload': 77, 'end_of_day_photos_duplicated': 4204, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4358, 'ratio_coverage': 0.9799997685158393}, 'dashboard_dict': {'nb_ptf_finished': 71, 'nb_images_finished': 4336, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4336, 'last_update': '2025/03/28', 'portfolio_id': 21758531, 'last_run_id': 1704593, 'total_number_of_photos': 4388}} No error ? {'log_dict': {'total_nb_images': 8545, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84486 seconds', 'coverage_times_pause': '0 days 85690 seconds', 'nb_photos_decision': 8450, 'nb_gray_level_ok': 8450, 'nb_dedup_ok': 3905, 'nb_two_criteria_ok': 3905, 'nb_forced_upload': 100, 'end_of_day_photos_duplicated': 4540, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 6, 'end_of_day_photos_uploaded': 3998, 'ratio_coverage': 0.9778585400293985}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3261, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 706, 'nb_selected_images': 3967, 'last_update': '2025/03/27', 'portfolio_id': 21715706, 'last_run_id': 1700517, 'total_number_of_photos': 4026}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66857 seconds', 'coverage_times_pause': '0 days 67855 seconds', 'nb_photos_decision': 6695, 'nb_gray_level_ok': 6695, 'nb_dedup_ok': 3380, 'nb_two_criteria_ok': 3380, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 3315, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3451, 'ratio_coverage': 0.9774558107574672}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 3415, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3415, 'last_update': '2025/03/25', 'portfolio_id': 21626068, 'last_run_id': 1694093, 'total_number_of_photos': 3457}} No error ? {'log_dict': {'total_nb_images': 1784, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 17615 seconds', 'coverage_times_pause': '0 days 17889 seconds', 'nb_photos_decision': 1776, 'nb_gray_level_ok': 1776, 'nb_dedup_ok': 40, 'nb_two_criteria_ok': 40, 'nb_forced_upload': 13, 'end_of_day_photos_duplicated': 1731, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 52, 'ratio_coverage': 0.9786654814156343}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 9, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 9, 'last_update': '2025/03/30', 'portfolio_id': 21866910, 'last_run_id': 1709698, 'total_number_of_photos': 52}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 84482 seconds', 'coverage_times_pause': '0 days 85745 seconds', 'nb_photos_decision': 8466, 'nb_gray_level_ok': 8466, 'nb_dedup_ok': 3279, 'nb_two_criteria_ok': 3279, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 5183, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3366, 'ratio_coverage': 0.9778122431972592}, 'dashboard_dict': {'nb_ptf_finished': 63, 'nb_images_finished': 3300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3300, 'last_update': '2025/03/29', 'portfolio_id': 21820661, 'last_run_id': 1708297, 'total_number_of_photos': 3395}} No error ? {'log_dict': {'total_nb_images': 8563, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84671 seconds', 'coverage_times_pause': '0 days 85866 seconds', 'nb_photos_decision': 8491, 'nb_gray_level_ok': 8491, 'nb_dedup_ok': 4285, 'nb_two_criteria_ok': 4285, 'nb_forced_upload': 77, 'end_of_day_photos_duplicated': 4204, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4358, 'ratio_coverage': 0.9799997685158393}, 'dashboard_dict': {'nb_ptf_finished': 71, 'nb_images_finished': 4336, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4336, 'last_update': '2025/03/28', 'portfolio_id': 21758531, 'last_run_id': 1704593, 'total_number_of_photos': 4388}} No error ? {'log_dict': {'total_nb_images': 8545, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84486 seconds', 'coverage_times_pause': '0 days 85690 seconds', 'nb_photos_decision': 8450, 'nb_gray_level_ok': 8450, 'nb_dedup_ok': 3905, 'nb_two_criteria_ok': 3905, 'nb_forced_upload': 100, 'end_of_day_photos_duplicated': 4540, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 6, 'end_of_day_photos_uploaded': 3998, 'ratio_coverage': 0.9778585400293985}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3261, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 706, 'nb_selected_images': 3967, 'last_update': '2025/03/27', 'portfolio_id': 21715706, 'last_run_id': 1700517, 'total_number_of_photos': 4026}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84445 seconds', 'coverage_times_pause': '0 days 85740 seconds', 'nb_photos_decision': 8451, 'nb_gray_level_ok': 8451, 'nb_dedup_ok': 2602, 'nb_two_criteria_ok': 2602, 'nb_forced_upload': 99, 'end_of_day_photos_duplicated': 5849, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2700, 'ratio_coverage': 0.9773839974999711}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2632, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2632, 'last_update': '2025/03/26', 'portfolio_id': 21674640, 'last_run_id': 1697610, 'total_number_of_photos': 2736}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66857 seconds', 'coverage_times_pause': '0 days 67855 seconds', 'nb_photos_decision': 6695, 'nb_gray_level_ok': 6695, 'nb_dedup_ok': 3380, 'nb_two_criteria_ok': 3380, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 3315, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3451, 'ratio_coverage': 0.9774558107574672}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 3415, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3415, 'last_update': '2025/03/25', 'portfolio_id': 21626068, 'last_run_id': 1694093, 'total_number_of_photos': 3457}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 84482 seconds', 'coverage_times_pause': '0 days 85745 seconds', 'nb_photos_decision': 8466, 'nb_gray_level_ok': 8466, 'nb_dedup_ok': 3279, 'nb_two_criteria_ok': 3279, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 5183, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3366, 'ratio_coverage': 0.9778122431972592}, 'dashboard_dict': {'nb_ptf_finished': 63, 'nb_images_finished': 3300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3300, 'last_update': '2025/03/29', 'portfolio_id': 21820661, 'last_run_id': 1707886, 'total_number_of_photos': 3395}} No error ? {'log_dict': {'total_nb_images': 8563, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84671 seconds', 'coverage_times_pause': '0 days 85866 seconds', 'nb_photos_decision': 8491, 'nb_gray_level_ok': 8491, 'nb_dedup_ok': 4285, 'nb_two_criteria_ok': 4285, 'nb_forced_upload': 77, 'end_of_day_photos_duplicated': 4204, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4358, 'ratio_coverage': 0.9799997685158393}, 'dashboard_dict': {'nb_ptf_finished': 71, 'nb_images_finished': 4336, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4336, 'last_update': '2025/03/28', 'portfolio_id': 21758531, 'last_run_id': 1704593, 'total_number_of_photos': 4388}} No error ? {'log_dict': {'total_nb_images': 8545, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84486 seconds', 'coverage_times_pause': '0 days 85690 seconds', 'nb_photos_decision': 8450, 'nb_gray_level_ok': 8450, 'nb_dedup_ok': 3905, 'nb_two_criteria_ok': 3905, 'nb_forced_upload': 100, 'end_of_day_photos_duplicated': 4540, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 6, 'end_of_day_photos_uploaded': 3998, 'ratio_coverage': 0.9778585400293985}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3261, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 706, 'nb_selected_images': 3967, 'last_update': '2025/03/27', 'portfolio_id': 21715706, 'last_run_id': 1700517, 'total_number_of_photos': 4026}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84445 seconds', 'coverage_times_pause': '0 days 85740 seconds', 'nb_photos_decision': 8451, 'nb_gray_level_ok': 8451, 'nb_dedup_ok': 2602, 'nb_two_criteria_ok': 2602, 'nb_forced_upload': 99, 'end_of_day_photos_duplicated': 5849, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2700, 'ratio_coverage': 0.9773839974999711}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2632, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2632, 'last_update': '2025/03/26', 'portfolio_id': 21674640, 'last_run_id': 1697610, 'total_number_of_photos': 2736}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1777, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17602 seconds', 'coverage_times_pause': '0 days 17818 seconds', 'nb_photos_decision': 1765, 'nb_gray_level_ok': 1765, 'nb_dedup_ok': 15, 'nb_two_criteria_ok': 15, 'nb_forced_upload': 12, 'end_of_day_photos_duplicated': 1750, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 26, 'ratio_coverage': 0.977943219067726}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/23', 'portfolio_id': 21601444, 'last_run_id': 1689885, 'total_number_of_photos': 31}} No error ? {'log_dict': {'total_nb_images': 8563, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84671 seconds', 'coverage_times_pause': '0 days 85866 seconds', 'nb_photos_decision': 8491, 'nb_gray_level_ok': 8491, 'nb_dedup_ok': 4285, 'nb_two_criteria_ok': 4285, 'nb_forced_upload': 77, 'end_of_day_photos_duplicated': 4204, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4358, 'ratio_coverage': 0.9799997685158393}, 'dashboard_dict': {'nb_ptf_finished': 70, 'nb_images_finished': 4265, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 71, 'nb_selected_images': 4336, 'last_update': '2025/03/28', 'portfolio_id': 21758531, 'last_run_id': 1704324, 'total_number_of_photos': 4388}} No error ? {'log_dict': {'total_nb_images': 8545, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84486 seconds', 'coverage_times_pause': '0 days 85690 seconds', 'nb_photos_decision': 8450, 'nb_gray_level_ok': 8450, 'nb_dedup_ok': 3905, 'nb_two_criteria_ok': 3905, 'nb_forced_upload': 100, 'end_of_day_photos_duplicated': 4540, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 6, 'end_of_day_photos_uploaded': 3998, 'ratio_coverage': 0.9778585400293985}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3261, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 706, 'nb_selected_images': 3967, 'last_update': '2025/03/27', 'portfolio_id': 21715706, 'last_run_id': 1700517, 'total_number_of_photos': 4026}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84445 seconds', 'coverage_times_pause': '0 days 85740 seconds', 'nb_photos_decision': 8451, 'nb_gray_level_ok': 8451, 'nb_dedup_ok': 2602, 'nb_two_criteria_ok': 2602, 'nb_forced_upload': 99, 'end_of_day_photos_duplicated': 5849, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2700, 'ratio_coverage': 0.9773839974999711}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2632, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2632, 'last_update': '2025/03/26', 'portfolio_id': 21674640, 'last_run_id': 1697610, 'total_number_of_photos': 2736}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66857 seconds', 'coverage_times_pause': '0 days 67855 seconds', 'nb_photos_decision': 6695, 'nb_gray_level_ok': 6695, 'nb_dedup_ok': 3380, 'nb_two_criteria_ok': 3380, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 3315, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3451, 'ratio_coverage': 0.9774558107574672}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 3415, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3415, 'last_update': '2025/03/25', 'portfolio_id': 21626068, 'last_run_id': 1694093, 'total_number_of_photos': 3457}} No error ? {'log_dict': {'total_nb_images': 1777, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17602 seconds', 'coverage_times_pause': '0 days 17818 seconds', 'nb_photos_decision': 1765, 'nb_gray_level_ok': 1765, 'nb_dedup_ok': 15, 'nb_two_criteria_ok': 15, 'nb_forced_upload': 12, 'end_of_day_photos_duplicated': 1750, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 26, 'ratio_coverage': 0.977943219067726}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/23', 'portfolio_id': 21601444, 'last_run_id': 1689885, 'total_number_of_photos': 31}} No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84124 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8449, 'nb_gray_level_ok': 8449, 'nb_dedup_ok': 4148, 'nb_two_criteria_ok': 4148, 'nb_forced_upload': 83, 'end_of_day_photos_duplicated': 4300, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4226, 'ratio_coverage': 0.9736686767207954}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 1801, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 38, 'nb_images_started': 2639, 'nb_selected_images': 4440, 'last_update': '2025/03/25', 'portfolio_id': 21570233, 'last_run_id': 1688544, 'total_number_of_photos': 4506}} No error ? {'log_dict': {'total_nb_images': 8545, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84486 seconds', 'coverage_times_pause': '0 days 85690 seconds', 'nb_photos_decision': 8450, 'nb_gray_level_ok': 8450, 'nb_dedup_ok': 3905, 'nb_two_criteria_ok': 3905, 'nb_forced_upload': 100, 'end_of_day_photos_duplicated': 4540, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 6, 'end_of_day_photos_uploaded': 3998, 'ratio_coverage': 0.9778585400293985}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3261, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 706, 'nb_selected_images': 3967, 'last_update': '2025/03/27', 'portfolio_id': 21715706, 'last_run_id': 1700366, 'total_number_of_photos': 4026}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66857 seconds', 'coverage_times_pause': '0 days 67855 seconds', 'nb_photos_decision': 6695, 'nb_gray_level_ok': 6695, 'nb_dedup_ok': 3380, 'nb_two_criteria_ok': 3380, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 3315, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3451, 'ratio_coverage': 0.9774558107574672}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 3415, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3415, 'last_update': '2025/03/25', 'portfolio_id': 21626068, 'last_run_id': 1694093, 'total_number_of_photos': 3457}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1777, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17602 seconds', 'coverage_times_pause': '0 days 17818 seconds', 'nb_photos_decision': 1765, 'nb_gray_level_ok': 1765, 'nb_dedup_ok': 15, 'nb_two_criteria_ok': 15, 'nb_forced_upload': 12, 'end_of_day_photos_duplicated': 1750, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 26, 'ratio_coverage': 0.977943219067726}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/23', 'portfolio_id': 21601444, 'last_run_id': 1689885, 'total_number_of_photos': 31}} No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84124 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8449, 'nb_gray_level_ok': 8449, 'nb_dedup_ok': 4148, 'nb_two_criteria_ok': 4148, 'nb_forced_upload': 83, 'end_of_day_photos_duplicated': 4300, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4226, 'ratio_coverage': 0.9736686767207954}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 1801, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 38, 'nb_images_started': 2639, 'nb_selected_images': 4440, 'last_update': '2025/03/25', 'portfolio_id': 21570233, 'last_run_id': 1688544, 'total_number_of_photos': 4506}} No error ? {'log_dict': {'total_nb_images': 8533, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84298 seconds', 'coverage_times_pause': '0 days 85569 seconds', 'nb_photos_decision': 8448, 'nb_gray_level_ok': 8448, 'nb_dedup_ok': 3818, 'nb_two_criteria_ok': 3818, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 4626, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3906, 'ratio_coverage': 0.9756825889188532}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66857 seconds', 'coverage_times_pause': '0 days 67855 seconds', 'nb_photos_decision': 6695, 'nb_gray_level_ok': 6695, 'nb_dedup_ok': 3380, 'nb_two_criteria_ok': 3380, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 3315, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3451, 'ratio_coverage': 0.9774558107574672}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 3415, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3415, 'last_update': '2025/03/25', 'portfolio_id': 21626068, 'last_run_id': 1694093, 'total_number_of_photos': 3457}} No error ? {'log_dict': {'total_nb_images': 1777, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17602 seconds', 'coverage_times_pause': '0 days 17818 seconds', 'nb_photos_decision': 1765, 'nb_gray_level_ok': 1765, 'nb_dedup_ok': 15, 'nb_two_criteria_ok': 15, 'nb_forced_upload': 12, 'end_of_day_photos_duplicated': 1750, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 26, 'ratio_coverage': 0.977943219067726}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/23', 'portfolio_id': 21601444, 'last_run_id': 1689885, 'total_number_of_photos': 31}} No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84124 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8449, 'nb_gray_level_ok': 8449, 'nb_dedup_ok': 4148, 'nb_two_criteria_ok': 4148, 'nb_forced_upload': 83, 'end_of_day_photos_duplicated': 4300, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4226, 'ratio_coverage': 0.9736686767207954}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 1801, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 38, 'nb_images_started': 2639, 'nb_selected_images': 4440, 'last_update': '2025/03/25', 'portfolio_id': 21570233, 'last_run_id': 1688544, 'total_number_of_photos': 4506}} No error ? {'log_dict': {'total_nb_images': 8533, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84298 seconds', 'coverage_times_pause': '0 days 85569 seconds', 'nb_photos_decision': 8448, 'nb_gray_level_ok': 8448, 'nb_dedup_ok': 3818, 'nb_two_criteria_ok': 3818, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 4626, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3906, 'ratio_coverage': 0.9756825889188532}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8545, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84415 seconds', 'coverage_times_pause': '0 days 85687 seconds', 'nb_photos_decision': 8456, 'nb_gray_level_ok': 8456, 'nb_dedup_ok': 3018, 'nb_two_criteria_ok': 3018, 'nb_forced_upload': 94, 'end_of_day_photos_duplicated': 5433, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3111, 'ratio_coverage': 0.9770367712589266}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66857 seconds', 'coverage_times_pause': '0 days 67855 seconds', 'nb_photos_decision': 6695, 'nb_gray_level_ok': 6695, 'nb_dedup_ok': 3380, 'nb_two_criteria_ok': 3380, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 3315, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3451, 'ratio_coverage': 0.9774558107574672}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 3415, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3415, 'last_update': '2025/03/25', 'portfolio_id': 21626068, 'last_run_id': 1693995, 'total_number_of_photos': 3457}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1777, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17602 seconds', 'coverage_times_pause': '0 days 17818 seconds', 'nb_photos_decision': 1765, 'nb_gray_level_ok': 1765, 'nb_dedup_ok': 15, 'nb_two_criteria_ok': 15, 'nb_forced_upload': 12, 'end_of_day_photos_duplicated': 1750, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 26, 'ratio_coverage': 0.977943219067726}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/23', 'portfolio_id': 21601444, 'last_run_id': 1689885, 'total_number_of_photos': 31}} No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84124 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8449, 'nb_gray_level_ok': 8449, 'nb_dedup_ok': 4148, 'nb_two_criteria_ok': 4148, 'nb_forced_upload': 83, 'end_of_day_photos_duplicated': 4300, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4226, 'ratio_coverage': 0.9736686767207954}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 1801, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 38, 'nb_images_started': 2639, 'nb_selected_images': 4440, 'last_update': '2025/03/22', 'portfolio_id': 21570233, 'last_run_id': 1688544, 'total_number_of_photos': 4506}} No error ? {'log_dict': {'total_nb_images': 8533, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84298 seconds', 'coverage_times_pause': '0 days 85569 seconds', 'nb_photos_decision': 8448, 'nb_gray_level_ok': 8448, 'nb_dedup_ok': 3818, 'nb_two_criteria_ok': 3818, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 4626, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3906, 'ratio_coverage': 0.9756825889188532}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8545, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84415 seconds', 'coverage_times_pause': '0 days 85687 seconds', 'nb_photos_decision': 8456, 'nb_gray_level_ok': 8456, 'nb_dedup_ok': 3018, 'nb_two_criteria_ok': 3018, 'nb_forced_upload': 94, 'end_of_day_photos_duplicated': 5433, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3111, 'ratio_coverage': 0.9770367712589266}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84375 seconds', 'coverage_times_pause': '0 days 85683 seconds', 'nb_photos_decision': 8459, 'nb_gray_level_ok': 8459, 'nb_dedup_ok': 3223, 'nb_two_criteria_ok': 3223, 'nb_forced_upload': 85, 'end_of_day_photos_duplicated': 5236, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3307, 'ratio_coverage': 0.976573802937534}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1777, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17602 seconds', 'coverage_times_pause': '0 days 17818 seconds', 'nb_photos_decision': 1765, 'nb_gray_level_ok': 1765, 'nb_dedup_ok': 15, 'nb_two_criteria_ok': 15, 'nb_forced_upload': 12, 'end_of_day_photos_duplicated': 1750, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 26, 'ratio_coverage': 0.977943219067726}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/23', 'portfolio_id': 21601444, 'last_run_id': 1689885, 'total_number_of_photos': 31}} No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84124 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8449, 'nb_gray_level_ok': 8449, 'nb_dedup_ok': 4148, 'nb_two_criteria_ok': 4148, 'nb_forced_upload': 83, 'end_of_day_photos_duplicated': 4300, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4226, 'ratio_coverage': 0.9736686767207954}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 1801, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 38, 'nb_images_started': 2639, 'nb_selected_images': 4440, 'last_update': '2025/03/22', 'portfolio_id': 21570233, 'last_run_id': 1688544, 'total_number_of_photos': 4506}} No error ? {'log_dict': {'total_nb_images': 8533, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84298 seconds', 'coverage_times_pause': '0 days 85569 seconds', 'nb_photos_decision': 8448, 'nb_gray_level_ok': 8448, 'nb_dedup_ok': 3818, 'nb_two_criteria_ok': 3818, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 4626, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3906, 'ratio_coverage': 0.9756825889188532}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8545, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84415 seconds', 'coverage_times_pause': '0 days 85687 seconds', 'nb_photos_decision': 8456, 'nb_gray_level_ok': 8456, 'nb_dedup_ok': 3018, 'nb_two_criteria_ok': 3018, 'nb_forced_upload': 94, 'end_of_day_photos_duplicated': 5433, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3111, 'ratio_coverage': 0.9770367712589266}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84375 seconds', 'coverage_times_pause': '0 days 85683 seconds', 'nb_photos_decision': 8459, 'nb_gray_level_ok': 8459, 'nb_dedup_ok': 3223, 'nb_two_criteria_ok': 3223, 'nb_forced_upload': 85, 'end_of_day_photos_duplicated': 5236, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3307, 'ratio_coverage': 0.976573802937534}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 6755, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66769 seconds', 'coverage_times_pause': '0 days 67742 seconds', 'nb_photos_decision': 6692, 'nb_gray_level_ok': 6692, 'nb_dedup_ok': 3883, 'nb_two_criteria_ok': 3883, 'nb_forced_upload': 63, 'end_of_day_photos_duplicated': 2809, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2885, 'end_of_day_photos_uploaded': 1060, 'ratio_coverage': 0.9761692422403836}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 77, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 9, 'nb_selected_images': 86, 'last_update': '2025/03/18', 'portfolio_id': 21478223, 'last_run_id': 1680749, 'total_number_of_photos': 4132}} No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84124 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8449, 'nb_gray_level_ok': 8449, 'nb_dedup_ok': 4148, 'nb_two_criteria_ok': 4148, 'nb_forced_upload': 83, 'end_of_day_photos_duplicated': 4300, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4226, 'ratio_coverage': 0.9736686767207954}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 1801, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 38, 'nb_images_started': 2639, 'nb_selected_images': 4440, 'last_update': '2025/03/22', 'portfolio_id': 21570233, 'last_run_id': 1688544, 'total_number_of_photos': 4506}} No error ? {'log_dict': {'total_nb_images': 8533, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84298 seconds', 'coverage_times_pause': '0 days 85569 seconds', 'nb_photos_decision': 8448, 'nb_gray_level_ok': 8448, 'nb_dedup_ok': 3818, 'nb_two_criteria_ok': 3818, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 4626, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3906, 'ratio_coverage': 0.9756825889188532}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8545, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84415 seconds', 'coverage_times_pause': '0 days 85687 seconds', 'nb_photos_decision': 8456, 'nb_gray_level_ok': 8456, 'nb_dedup_ok': 3018, 'nb_two_criteria_ok': 3018, 'nb_forced_upload': 94, 'end_of_day_photos_duplicated': 5433, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3111, 'ratio_coverage': 0.9770367712589266}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84375 seconds', 'coverage_times_pause': '0 days 85683 seconds', 'nb_photos_decision': 8459, 'nb_gray_level_ok': 8459, 'nb_dedup_ok': 3223, 'nb_two_criteria_ok': 3223, 'nb_forced_upload': 85, 'end_of_day_photos_duplicated': 5236, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3307, 'ratio_coverage': 0.976573802937534}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 6755, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66769 seconds', 'coverage_times_pause': '0 days 67742 seconds', 'nb_photos_decision': 6692, 'nb_gray_level_ok': 6692, 'nb_dedup_ok': 3883, 'nb_two_criteria_ok': 3883, 'nb_forced_upload': 63, 'end_of_day_photos_duplicated': 2809, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2885, 'end_of_day_photos_uploaded': 1060, 'ratio_coverage': 0.9761692422403836}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 77, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 9, 'nb_selected_images': 86, 'last_update': '2025/03/18', 'portfolio_id': 21478223, 'last_run_id': 1680749, 'total_number_of_photos': 4132}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84124 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8449, 'nb_gray_level_ok': 8449, 'nb_dedup_ok': 4148, 'nb_two_criteria_ok': 4148, 'nb_forced_upload': 83, 'end_of_day_photos_duplicated': 4300, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4226, 'ratio_coverage': 0.9736686767207954}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 1801, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 38, 'nb_images_started': 2639, 'nb_selected_images': 4440, 'last_update': '2025/03/22', 'portfolio_id': 21570233, 'last_run_id': 1688473, 'total_number_of_photos': 4505}} No error ? {'log_dict': {'total_nb_images': 8533, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84298 seconds', 'coverage_times_pause': '0 days 85569 seconds', 'nb_photos_decision': 8448, 'nb_gray_level_ok': 8448, 'nb_dedup_ok': 3818, 'nb_two_criteria_ok': 3818, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 4626, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3906, 'ratio_coverage': 0.9756825889188532}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8545, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84415 seconds', 'coverage_times_pause': '0 days 85687 seconds', 'nb_photos_decision': 8456, 'nb_gray_level_ok': 8456, 'nb_dedup_ok': 3018, 'nb_two_criteria_ok': 3018, 'nb_forced_upload': 94, 'end_of_day_photos_duplicated': 5433, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3111, 'ratio_coverage': 0.9770367712589266}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84375 seconds', 'coverage_times_pause': '0 days 85683 seconds', 'nb_photos_decision': 8459, 'nb_gray_level_ok': 8459, 'nb_dedup_ok': 3223, 'nb_two_criteria_ok': 3223, 'nb_forced_upload': 85, 'end_of_day_photos_duplicated': 5236, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3307, 'ratio_coverage': 0.976573802937534}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 6755, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66769 seconds', 'coverage_times_pause': '0 days 67742 seconds', 'nb_photos_decision': 6692, 'nb_gray_level_ok': 6692, 'nb_dedup_ok': 3883, 'nb_two_criteria_ok': 3883, 'nb_forced_upload': 63, 'end_of_day_photos_duplicated': 2809, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2885, 'end_of_day_photos_uploaded': 1060, 'ratio_coverage': 0.9761692422403836}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 77, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 9, 'nb_selected_images': 86, 'last_update': '2025/03/18', 'portfolio_id': 21478223, 'last_run_id': 1680749, 'total_number_of_photos': 4132}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2143, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 21165 seconds', 'coverage_times_pause': '0 days 21488 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 140, 'nb_two_criteria_ok': 140, 'nb_forced_upload': 23, 'end_of_day_photos_duplicated': 1981, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 161, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 151, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 151, 'last_update': '2025/03/16', 'portfolio_id': 21458507, 'last_run_id': 1679935, 'total_number_of_photos': 162}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2143, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 21165 seconds', 'coverage_times_pause': '0 days 21488 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 140, 'nb_two_criteria_ok': 140, 'nb_forced_upload': 23, 'end_of_day_photos_duplicated': 1981, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 161, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 151, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 151, 'last_update': '2025/03/16', 'portfolio_id': 21458507, 'last_run_id': 1679935, 'total_number_of_photos': 162}} No error ? {'log_dict': {'total_nb_images': 8574, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84751 seconds', 'coverage_times_pause': '0 days 85985 seconds', 'nb_photos_decision': 8496, 'nb_gray_level_ok': 8496, 'nb_dedup_ok': 4267, 'nb_two_criteria_ok': 4267, 'nb_forced_upload': 78, 'end_of_day_photos_duplicated': 4224, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 4344, 'ratio_coverage': 0.9809257051586245}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 4613, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4613, 'last_update': '2025/03/15', 'portfolio_id': 21403117, 'last_run_id': 1678912, 'total_number_of_photos': 4666}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2143, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 21165 seconds', 'coverage_times_pause': '0 days 21488 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 140, 'nb_two_criteria_ok': 140, 'nb_forced_upload': 23, 'end_of_day_photos_duplicated': 1981, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 161, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 151, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 151, 'last_update': '2025/03/16', 'portfolio_id': 21458507, 'last_run_id': 1679935, 'total_number_of_photos': 162}} No error ? {'log_dict': {'total_nb_images': 8574, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84751 seconds', 'coverage_times_pause': '0 days 85985 seconds', 'nb_photos_decision': 8496, 'nb_gray_level_ok': 8496, 'nb_dedup_ok': 4267, 'nb_two_criteria_ok': 4267, 'nb_forced_upload': 78, 'end_of_day_photos_duplicated': 4224, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 4344, 'ratio_coverage': 0.9809257051586245}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 4613, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4613, 'last_update': '2025/03/15', 'portfolio_id': 21403117, 'last_run_id': 1678912, 'total_number_of_photos': 4666}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84474 seconds', 'coverage_times_pause': '0 days 85744 seconds', 'nb_photos_decision': 8466, 'nb_gray_level_ok': 8466, 'nb_dedup_ok': 2345, 'nb_two_criteria_ok': 2345, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 6116, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2434, 'ratio_coverage': 0.9777196495329807}, 'dashboard_dict': {'nb_ptf_finished': 30, 'nb_images_finished': 1475, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 843, 'nb_selected_images': 2318, 'last_update': '2025/03/14', 'portfolio_id': 21370538, 'last_run_id': 1675492, 'total_number_of_photos': 2454}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2143, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 21165 seconds', 'coverage_times_pause': '0 days 21488 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 140, 'nb_two_criteria_ok': 140, 'nb_forced_upload': 23, 'end_of_day_photos_duplicated': 1981, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 161, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 151, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 151, 'last_update': '2025/03/16', 'portfolio_id': 21458507, 'last_run_id': 1679935, 'total_number_of_photos': 162}} No error ? {'log_dict': {'total_nb_images': 8574, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84751 seconds', 'coverage_times_pause': '0 days 85985 seconds', 'nb_photos_decision': 8496, 'nb_gray_level_ok': 8496, 'nb_dedup_ok': 4267, 'nb_two_criteria_ok': 4267, 'nb_forced_upload': 78, 'end_of_day_photos_duplicated': 4224, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 4344, 'ratio_coverage': 0.9809257051586245}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 4613, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4613, 'last_update': '2025/03/15', 'portfolio_id': 21403117, 'last_run_id': 1678912, 'total_number_of_photos': 4666}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84474 seconds', 'coverage_times_pause': '0 days 85744 seconds', 'nb_photos_decision': 8466, 'nb_gray_level_ok': 8466, 'nb_dedup_ok': 2345, 'nb_two_criteria_ok': 2345, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 6116, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2434, 'ratio_coverage': 0.9777196495329807}, 'dashboard_dict': {'nb_ptf_finished': 30, 'nb_images_finished': 1475, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 843, 'nb_selected_images': 2318, 'last_update': '2025/03/14', 'portfolio_id': 21370538, 'last_run_id': 1675492, 'total_number_of_photos': 2454}} No error ? {'log_dict': {'total_nb_images': 8561, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85857 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 3243, 'nb_two_criteria_ok': 3243, 'nb_forced_upload': 87, 'end_of_day_photos_duplicated': 5226, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 3329, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 3560, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 188, 'nb_selected_images': 3748, 'last_update': '2025/03/13', 'portfolio_id': 21319625, 'last_run_id': 1672759, 'total_number_of_photos': 3809}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2143, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 21165 seconds', 'coverage_times_pause': '0 days 21488 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 140, 'nb_two_criteria_ok': 140, 'nb_forced_upload': 23, 'end_of_day_photos_duplicated': 1981, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 161, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 151, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 151, 'last_update': '2025/03/16', 'portfolio_id': 21458507, 'last_run_id': 1679935, 'total_number_of_photos': 162}} No error ? {'log_dict': {'total_nb_images': 8574, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84751 seconds', 'coverage_times_pause': '0 days 85985 seconds', 'nb_photos_decision': 8496, 'nb_gray_level_ok': 8496, 'nb_dedup_ok': 4267, 'nb_two_criteria_ok': 4267, 'nb_forced_upload': 78, 'end_of_day_photos_duplicated': 4224, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 4344, 'ratio_coverage': 0.9809257051586245}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 4613, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4613, 'last_update': '2025/03/15', 'portfolio_id': 21403117, 'last_run_id': 1678912, 'total_number_of_photos': 4666}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84474 seconds', 'coverage_times_pause': '0 days 85744 seconds', 'nb_photos_decision': 8466, 'nb_gray_level_ok': 8466, 'nb_dedup_ok': 2345, 'nb_two_criteria_ok': 2345, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 6116, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2434, 'ratio_coverage': 0.9777196495329807}, 'dashboard_dict': {'nb_ptf_finished': 30, 'nb_images_finished': 1475, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 843, 'nb_selected_images': 2318, 'last_update': '2025/03/14', 'portfolio_id': 21370538, 'last_run_id': 1675492, 'total_number_of_photos': 2454}} No error ? {'log_dict': {'total_nb_images': 8561, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85857 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 3243, 'nb_two_criteria_ok': 3243, 'nb_forced_upload': 87, 'end_of_day_photos_duplicated': 5226, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 3329, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 3560, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 188, 'nb_selected_images': 3748, 'last_update': '2025/03/13', 'portfolio_id': 21319625, 'last_run_id': 1672759, 'total_number_of_photos': 3809}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84491 seconds', 'coverage_times_pause': '0 days 85741 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 5007, 'nb_two_criteria_ok': 5007, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 3462, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 5083, 'ratio_coverage': 0.9779164110695726}, 'dashboard_dict': {'nb_ptf_finished': 82, 'nb_images_finished': 5113, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 5113, 'last_update': '2025/03/12', 'portfolio_id': 21247263, 'last_run_id': 1670137, 'total_number_of_photos': 5134}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2143, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 21165 seconds', 'coverage_times_pause': '0 days 21488 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 140, 'nb_two_criteria_ok': 140, 'nb_forced_upload': 23, 'end_of_day_photos_duplicated': 1981, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 161, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 151, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 151, 'last_update': '2025/03/16', 'portfolio_id': 21458507, 'last_run_id': 1679935, 'total_number_of_photos': 162}} No error ? {'log_dict': {'total_nb_images': 8574, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84751 seconds', 'coverage_times_pause': '0 days 85985 seconds', 'nb_photos_decision': 8496, 'nb_gray_level_ok': 8496, 'nb_dedup_ok': 4267, 'nb_two_criteria_ok': 4267, 'nb_forced_upload': 78, 'end_of_day_photos_duplicated': 4224, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 4344, 'ratio_coverage': 0.9809257051586245}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 4613, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4613, 'last_update': '2025/03/15', 'portfolio_id': 21403117, 'last_run_id': 1678912, 'total_number_of_photos': 4666}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84474 seconds', 'coverage_times_pause': '0 days 85744 seconds', 'nb_photos_decision': 8466, 'nb_gray_level_ok': 8466, 'nb_dedup_ok': 2345, 'nb_two_criteria_ok': 2345, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 6116, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2434, 'ratio_coverage': 0.9777196495329807}, 'dashboard_dict': {'nb_ptf_finished': 30, 'nb_images_finished': 1475, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 843, 'nb_selected_images': 2318, 'last_update': '2025/03/14', 'portfolio_id': 21370538, 'last_run_id': 1675492, 'total_number_of_photos': 2454}} No error ? {'log_dict': {'total_nb_images': 8561, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85857 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 3243, 'nb_two_criteria_ok': 3243, 'nb_forced_upload': 87, 'end_of_day_photos_duplicated': 5226, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 3329, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 3560, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 188, 'nb_selected_images': 3748, 'last_update': '2025/03/13', 'portfolio_id': 21319625, 'last_run_id': 1672759, 'total_number_of_photos': 3809}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84491 seconds', 'coverage_times_pause': '0 days 85741 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 5007, 'nb_two_criteria_ok': 5007, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 3462, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 5083, 'ratio_coverage': 0.9779164110695726}, 'dashboard_dict': {'nb_ptf_finished': 82, 'nb_images_finished': 5113, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 5113, 'last_update': '2025/03/12', 'portfolio_id': 21247263, 'last_run_id': 1670137, 'total_number_of_photos': 5134}} No error ? {'log_dict': {'total_nb_images': 6749, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66691 seconds', 'coverage_times_pause': '0 days 67683 seconds', 'nb_photos_decision': 6680, 'nb_gray_level_ok': 6680, 'nb_dedup_ok': 1611, 'nb_two_criteria_ok': 1611, 'nb_forced_upload': 69, 'end_of_day_photos_duplicated': 5069, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1679, 'ratio_coverage': 0.9750288746911504}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1689, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1689, 'last_update': '2025/03/12', 'portfolio_id': 21219185, 'last_run_id': 1668939, 'total_number_of_photos': 1733}} No error ? {'log_dict': {'total_nb_images': 2143, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 21165 seconds', 'coverage_times_pause': '0 days 21488 seconds', 'nb_photos_decision': 2125, 'nb_gray_level_ok': 2125, 'nb_dedup_ok': 140, 'nb_two_criteria_ok': 140, 'nb_forced_upload': 23, 'end_of_day_photos_duplicated': 1981, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 161, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 151, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 151, 'last_update': '2025/03/16', 'portfolio_id': 21458507, 'last_run_id': 1679927, 'total_number_of_photos': 161}} No error ? {'log_dict': {'total_nb_images': 8574, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84751 seconds', 'coverage_times_pause': '0 days 85985 seconds', 'nb_photos_decision': 8496, 'nb_gray_level_ok': 8496, 'nb_dedup_ok': 4267, 'nb_two_criteria_ok': 4267, 'nb_forced_upload': 78, 'end_of_day_photos_duplicated': 4224, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 4344, 'ratio_coverage': 0.9809257051586245}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 4613, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4613, 'last_update': '2025/03/15', 'portfolio_id': 21403117, 'last_run_id': 1678912, 'total_number_of_photos': 4666}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84474 seconds', 'coverage_times_pause': '0 days 85744 seconds', 'nb_photos_decision': 8466, 'nb_gray_level_ok': 8466, 'nb_dedup_ok': 2345, 'nb_two_criteria_ok': 2345, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 6116, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2434, 'ratio_coverage': 0.9777196495329807}, 'dashboard_dict': {'nb_ptf_finished': 30, 'nb_images_finished': 1475, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 843, 'nb_selected_images': 2318, 'last_update': '2025/03/14', 'portfolio_id': 21370538, 'last_run_id': 1675492, 'total_number_of_photos': 2454}} No error ? {'log_dict': {'total_nb_images': 8561, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85857 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 3243, 'nb_two_criteria_ok': 3243, 'nb_forced_upload': 87, 'end_of_day_photos_duplicated': 5226, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 3329, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 3560, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 188, 'nb_selected_images': 3748, 'last_update': '2025/03/13', 'portfolio_id': 21319625, 'last_run_id': 1672759, 'total_number_of_photos': 3809}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84491 seconds', 'coverage_times_pause': '0 days 85741 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 5007, 'nb_two_criteria_ok': 5007, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 3462, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 5083, 'ratio_coverage': 0.9779164110695726}, 'dashboard_dict': {'nb_ptf_finished': 82, 'nb_images_finished': 5113, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 5113, 'last_update': '2025/03/12', 'portfolio_id': 21247263, 'last_run_id': 1670137, 'total_number_of_photos': 5134}} No error ? {'log_dict': {'total_nb_images': 6749, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66691 seconds', 'coverage_times_pause': '0 days 67683 seconds', 'nb_photos_decision': 6680, 'nb_gray_level_ok': 6680, 'nb_dedup_ok': 1611, 'nb_two_criteria_ok': 1611, 'nb_forced_upload': 69, 'end_of_day_photos_duplicated': 5069, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1679, 'ratio_coverage': 0.9750288746911504}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1689, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1689, 'last_update': '2025/03/12', 'portfolio_id': 21219185, 'last_run_id': 1668939, 'total_number_of_photos': 1733}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8574, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84751 seconds', 'coverage_times_pause': '0 days 85985 seconds', 'nb_photos_decision': 8496, 'nb_gray_level_ok': 8496, 'nb_dedup_ok': 4267, 'nb_two_criteria_ok': 4267, 'nb_forced_upload': 78, 'end_of_day_photos_duplicated': 4224, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 4344, 'ratio_coverage': 0.9809257051586245}, 'dashboard_dict': {'nb_ptf_finished': 69, 'nb_images_finished': 4613, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4613, 'last_update': '2025/03/15', 'portfolio_id': 21403117, 'last_run_id': 1678835, 'total_number_of_photos': 4666}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84474 seconds', 'coverage_times_pause': '0 days 85744 seconds', 'nb_photos_decision': 8466, 'nb_gray_level_ok': 8466, 'nb_dedup_ok': 2345, 'nb_two_criteria_ok': 2345, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 6116, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2434, 'ratio_coverage': 0.9777196495329807}, 'dashboard_dict': {'nb_ptf_finished': 30, 'nb_images_finished': 1475, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 843, 'nb_selected_images': 2318, 'last_update': '2025/03/14', 'portfolio_id': 21370538, 'last_run_id': 1675492, 'total_number_of_photos': 2454}} No error ? {'log_dict': {'total_nb_images': 8561, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85857 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 3243, 'nb_two_criteria_ok': 3243, 'nb_forced_upload': 87, 'end_of_day_photos_duplicated': 5226, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 3329, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 3560, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 188, 'nb_selected_images': 3748, 'last_update': '2025/03/13', 'portfolio_id': 21319625, 'last_run_id': 1672759, 'total_number_of_photos': 3809}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84491 seconds', 'coverage_times_pause': '0 days 85741 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 5007, 'nb_two_criteria_ok': 5007, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 3462, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 5083, 'ratio_coverage': 0.9779164110695726}, 'dashboard_dict': {'nb_ptf_finished': 82, 'nb_images_finished': 5113, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 5113, 'last_update': '2025/03/12', 'portfolio_id': 21247263, 'last_run_id': 1670137, 'total_number_of_photos': 5134}} No error ? {'log_dict': {'total_nb_images': 6749, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66691 seconds', 'coverage_times_pause': '0 days 67683 seconds', 'nb_photos_decision': 6680, 'nb_gray_level_ok': 6680, 'nb_dedup_ok': 1611, 'nb_two_criteria_ok': 1611, 'nb_forced_upload': 69, 'end_of_day_photos_duplicated': 5069, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1679, 'ratio_coverage': 0.9750288746911504}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1689, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1689, 'last_update': '2025/03/12', 'portfolio_id': 21219185, 'last_run_id': 1668939, 'total_number_of_photos': 1733}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1783, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17642 seconds', 'coverage_times_pause': '0 days 17880 seconds', 'nb_photos_decision': 1769, 'nb_gray_level_ok': 1769, 'nb_dedup_ok': 54, 'nb_two_criteria_ok': 54, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1715, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 67, 'ratio_coverage': 0.9801655647535974}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/09', 'portfolio_id': 21164040, 'last_run_id': 1660674, 'total_number_of_photos': 68}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84474 seconds', 'coverage_times_pause': '0 days 85744 seconds', 'nb_photos_decision': 8466, 'nb_gray_level_ok': 8466, 'nb_dedup_ok': 2345, 'nb_two_criteria_ok': 2345, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 6116, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2434, 'ratio_coverage': 0.9777196495329807}, 'dashboard_dict': {'nb_ptf_finished': 30, 'nb_images_finished': 1475, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 843, 'nb_selected_images': 2318, 'last_update': '2025/03/14', 'portfolio_id': 21370538, 'last_run_id': 1675410, 'total_number_of_photos': 2454}} No error ? {'log_dict': {'total_nb_images': 8561, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85857 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 3243, 'nb_two_criteria_ok': 3243, 'nb_forced_upload': 87, 'end_of_day_photos_duplicated': 5226, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 3329, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 3560, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 188, 'nb_selected_images': 3748, 'last_update': '2025/03/13', 'portfolio_id': 21319625, 'last_run_id': 1672759, 'total_number_of_photos': 3809}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84491 seconds', 'coverage_times_pause': '0 days 85741 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 5007, 'nb_two_criteria_ok': 5007, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 3462, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 5083, 'ratio_coverage': 0.9779164110695726}, 'dashboard_dict': {'nb_ptf_finished': 82, 'nb_images_finished': 5113, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 5113, 'last_update': '2025/03/12', 'portfolio_id': 21247263, 'last_run_id': 1670137, 'total_number_of_photos': 5134}} No error ? {'log_dict': {'total_nb_images': 6749, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66691 seconds', 'coverage_times_pause': '0 days 67683 seconds', 'nb_photos_decision': 6680, 'nb_gray_level_ok': 6680, 'nb_dedup_ok': 1611, 'nb_two_criteria_ok': 1611, 'nb_forced_upload': 69, 'end_of_day_photos_duplicated': 5069, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1679, 'ratio_coverage': 0.9750288746911504}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1689, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1689, 'last_update': '2025/03/12', 'portfolio_id': 21219185, 'last_run_id': 1668939, 'total_number_of_photos': 1733}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1783, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17642 seconds', 'coverage_times_pause': '0 days 17880 seconds', 'nb_photos_decision': 1769, 'nb_gray_level_ok': 1769, 'nb_dedup_ok': 54, 'nb_two_criteria_ok': 54, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1715, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 67, 'ratio_coverage': 0.9801655647535974}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/09', 'portfolio_id': 21164040, 'last_run_id': 1660674, 'total_number_of_photos': 68}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84382 seconds', 'coverage_times_pause': '0 days 85736 seconds', 'nb_photos_decision': 8468, 'nb_gray_level_ok': 8468, 'nb_dedup_ok': 1351, 'nb_two_criteria_ok': 1351, 'nb_forced_upload': 82, 'end_of_day_photos_duplicated': 7117, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1432, 'ratio_coverage': 0.9766548223937777}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 1325, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1325, 'last_update': '2025/03/08', 'portfolio_id': 21131516, 'last_run_id': 1657956, 'total_number_of_photos': 1439}} No error ? {'log_dict': {'total_nb_images': 8561, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85857 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 3243, 'nb_two_criteria_ok': 3243, 'nb_forced_upload': 87, 'end_of_day_photos_duplicated': 5226, 'end_of_day_photos_nothing_done': 6, 'end_of_day_photos_uploaded': 3329, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 66, 'nb_images_finished': 3385, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 6, 'nb_images_started': 363, 'nb_selected_images': 3748, 'last_update': '2025/03/13', 'portfolio_id': 21319625, 'last_run_id': 1672581, 'total_number_of_photos': 3809}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84491 seconds', 'coverage_times_pause': '0 days 85741 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 5007, 'nb_two_criteria_ok': 5007, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 3462, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 5083, 'ratio_coverage': 0.9779164110695726}, 'dashboard_dict': {'nb_ptf_finished': 82, 'nb_images_finished': 5113, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 5113, 'last_update': '2025/03/12', 'portfolio_id': 21247263, 'last_run_id': 1670137, 'total_number_of_photos': 5134}} No error ? {'log_dict': {'total_nb_images': 6749, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66691 seconds', 'coverage_times_pause': '0 days 67683 seconds', 'nb_photos_decision': 6680, 'nb_gray_level_ok': 6680, 'nb_dedup_ok': 1611, 'nb_two_criteria_ok': 1611, 'nb_forced_upload': 69, 'end_of_day_photos_duplicated': 5069, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1679, 'ratio_coverage': 0.9750288746911504}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1689, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1689, 'last_update': '2025/03/12', 'portfolio_id': 21219185, 'last_run_id': 1668939, 'total_number_of_photos': 1733}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1783, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17642 seconds', 'coverage_times_pause': '0 days 17880 seconds', 'nb_photos_decision': 1769, 'nb_gray_level_ok': 1769, 'nb_dedup_ok': 54, 'nb_two_criteria_ok': 54, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1715, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 67, 'ratio_coverage': 0.9801655647535974}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/09', 'portfolio_id': 21164040, 'last_run_id': 1660674, 'total_number_of_photos': 68}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84382 seconds', 'coverage_times_pause': '0 days 85736 seconds', 'nb_photos_decision': 8468, 'nb_gray_level_ok': 8468, 'nb_dedup_ok': 1351, 'nb_two_criteria_ok': 1351, 'nb_forced_upload': 82, 'end_of_day_photos_duplicated': 7117, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1432, 'ratio_coverage': 0.9766548223937777}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 1325, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1325, 'last_update': '2025/03/08', 'portfolio_id': 21131516, 'last_run_id': 1657956, 'total_number_of_photos': 1439}} No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84300 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8443, 'nb_gray_level_ok': 8443, 'nb_dedup_ok': 3892, 'nb_two_criteria_ok': 3892, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 4551, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3975, 'ratio_coverage': 0.9757057373349228}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 3431, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 568, 'nb_selected_images': 3999, 'last_update': '2025/03/12', 'portfolio_id': 21089077, 'last_run_id': 1657812, 'total_number_of_photos': 4050}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84491 seconds', 'coverage_times_pause': '0 days 85741 seconds', 'nb_photos_decision': 8469, 'nb_gray_level_ok': 8469, 'nb_dedup_ok': 5007, 'nb_two_criteria_ok': 5007, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 3462, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 5083, 'ratio_coverage': 0.9779164110695726}, 'dashboard_dict': {'nb_ptf_finished': 82, 'nb_images_finished': 5113, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 5113, 'last_update': '2025/03/12', 'portfolio_id': 21247263, 'last_run_id': 1669212, 'total_number_of_photos': 5134}} No error ? {'log_dict': {'total_nb_images': 6749, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66691 seconds', 'coverage_times_pause': '0 days 67683 seconds', 'nb_photos_decision': 6680, 'nb_gray_level_ok': 6680, 'nb_dedup_ok': 1611, 'nb_two_criteria_ok': 1611, 'nb_forced_upload': 69, 'end_of_day_photos_duplicated': 5069, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1679, 'ratio_coverage': 0.9750288746911504}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1689, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1689, 'last_update': '2025/03/12', 'portfolio_id': 21219185, 'last_run_id': 1668939, 'total_number_of_photos': 1733}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1783, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17642 seconds', 'coverage_times_pause': '0 days 17880 seconds', 'nb_photos_decision': 1769, 'nb_gray_level_ok': 1769, 'nb_dedup_ok': 54, 'nb_two_criteria_ok': 54, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1715, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 67, 'ratio_coverage': 0.9801655647535974}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/09', 'portfolio_id': 21164040, 'last_run_id': 1660674, 'total_number_of_photos': 68}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84382 seconds', 'coverage_times_pause': '0 days 85736 seconds', 'nb_photos_decision': 8468, 'nb_gray_level_ok': 8468, 'nb_dedup_ok': 1351, 'nb_two_criteria_ok': 1351, 'nb_forced_upload': 82, 'end_of_day_photos_duplicated': 7117, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1432, 'ratio_coverage': 0.9766548223937777}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 1325, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1325, 'last_update': '2025/03/08', 'portfolio_id': 21131516, 'last_run_id': 1657956, 'total_number_of_photos': 1439}} No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84300 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8443, 'nb_gray_level_ok': 8443, 'nb_dedup_ok': 3892, 'nb_two_criteria_ok': 3892, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 4551, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3975, 'ratio_coverage': 0.9757057373349228}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 3431, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 568, 'nb_selected_images': 3999, 'last_update': '2025/03/08', 'portfolio_id': 21089077, 'last_run_id': 1657812, 'total_number_of_photos': 4050}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84239 seconds', 'coverage_times_pause': '0 days 85561 seconds', 'nb_photos_decision': 8460, 'nb_gray_level_ok': 8460, 'nb_dedup_ok': 4354, 'nb_two_criteria_ok': 4354, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 4106, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 4420, 'ratio_coverage': 0.9749997106447992}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 4430, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4430, 'last_update': '2025/03/07', 'portfolio_id': 21033292, 'last_run_id': 1653750, 'total_number_of_photos': 4452}} No error ? {'log_dict': {'total_nb_images': 6749, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66691 seconds', 'coverage_times_pause': '0 days 67683 seconds', 'nb_photos_decision': 6680, 'nb_gray_level_ok': 6680, 'nb_dedup_ok': 1611, 'nb_two_criteria_ok': 1611, 'nb_forced_upload': 69, 'end_of_day_photos_duplicated': 5069, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1679, 'ratio_coverage': 0.9750288746911504}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1689, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1689, 'last_update': '2025/03/11', 'portfolio_id': 21219185, 'last_run_id': 1665061, 'total_number_of_photos': 1733}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1783, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17642 seconds', 'coverage_times_pause': '0 days 17880 seconds', 'nb_photos_decision': 1769, 'nb_gray_level_ok': 1769, 'nb_dedup_ok': 54, 'nb_two_criteria_ok': 54, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1715, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 67, 'ratio_coverage': 0.9801655647535974}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/09', 'portfolio_id': 21164040, 'last_run_id': 1660674, 'total_number_of_photos': 68}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84382 seconds', 'coverage_times_pause': '0 days 85736 seconds', 'nb_photos_decision': 8468, 'nb_gray_level_ok': 8468, 'nb_dedup_ok': 1351, 'nb_two_criteria_ok': 1351, 'nb_forced_upload': 82, 'end_of_day_photos_duplicated': 7117, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1432, 'ratio_coverage': 0.9766548223937777}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 1325, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1325, 'last_update': '2025/03/08', 'portfolio_id': 21131516, 'last_run_id': 1657956, 'total_number_of_photos': 1439}} No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84300 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8443, 'nb_gray_level_ok': 8443, 'nb_dedup_ok': 3892, 'nb_two_criteria_ok': 3892, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 4551, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3975, 'ratio_coverage': 0.9757057373349228}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 3431, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 568, 'nb_selected_images': 3999, 'last_update': '2025/03/08', 'portfolio_id': 21089077, 'last_run_id': 1657812, 'total_number_of_photos': 4050}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84239 seconds', 'coverage_times_pause': '0 days 85561 seconds', 'nb_photos_decision': 8460, 'nb_gray_level_ok': 8460, 'nb_dedup_ok': 4354, 'nb_two_criteria_ok': 4354, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 4106, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 4420, 'ratio_coverage': 0.9749997106447992}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 4430, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4430, 'last_update': '2025/03/07', 'portfolio_id': 21033292, 'last_run_id': 1653750, 'total_number_of_photos': 4452}} No error ? {'log_dict': {'total_nb_images': 8568, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84726 seconds', 'coverage_times_pause': '0 days 85929 seconds', 'nb_photos_decision': 8484, 'nb_gray_level_ok': 8484, 'nb_dedup_ok': 2812, 'nb_two_criteria_ok': 2812, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 5668, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 2895, 'ratio_coverage': 0.9806363499577542}, 'dashboard_dict': {'nb_ptf_finished': 52, 'nb_images_finished': 2816, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2816, 'last_update': '2025/03/06', 'portfolio_id': 20995339, 'last_run_id': 1650604, 'total_number_of_photos': 2905}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1783, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17642 seconds', 'coverage_times_pause': '0 days 17880 seconds', 'nb_photos_decision': 1769, 'nb_gray_level_ok': 1769, 'nb_dedup_ok': 54, 'nb_two_criteria_ok': 54, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1715, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 67, 'ratio_coverage': 0.9801655647535974}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/09', 'portfolio_id': 21164040, 'last_run_id': 1660674, 'total_number_of_photos': 67}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84382 seconds', 'coverage_times_pause': '0 days 85736 seconds', 'nb_photos_decision': 8468, 'nb_gray_level_ok': 8468, 'nb_dedup_ok': 1351, 'nb_two_criteria_ok': 1351, 'nb_forced_upload': 82, 'end_of_day_photos_duplicated': 7117, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1432, 'ratio_coverage': 0.9766548223937777}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 1325, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1325, 'last_update': '2025/03/08', 'portfolio_id': 21131516, 'last_run_id': 1657956, 'total_number_of_photos': 1439}} No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84300 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8443, 'nb_gray_level_ok': 8443, 'nb_dedup_ok': 3892, 'nb_two_criteria_ok': 3892, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 4551, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3975, 'ratio_coverage': 0.9757057373349228}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 3431, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 568, 'nb_selected_images': 3999, 'last_update': '2025/03/08', 'portfolio_id': 21089077, 'last_run_id': 1657812, 'total_number_of_photos': 4050}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84239 seconds', 'coverage_times_pause': '0 days 85561 seconds', 'nb_photos_decision': 8460, 'nb_gray_level_ok': 8460, 'nb_dedup_ok': 4354, 'nb_two_criteria_ok': 4354, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 4106, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 4420, 'ratio_coverage': 0.9749997106447992}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 4430, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4430, 'last_update': '2025/03/07', 'portfolio_id': 21033292, 'last_run_id': 1653750, 'total_number_of_photos': 4452}} No error ? {'log_dict': {'total_nb_images': 8568, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84726 seconds', 'coverage_times_pause': '0 days 85929 seconds', 'nb_photos_decision': 8484, 'nb_gray_level_ok': 8484, 'nb_dedup_ok': 2812, 'nb_two_criteria_ok': 2812, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 5668, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 2895, 'ratio_coverage': 0.9806363499577542}, 'dashboard_dict': {'nb_ptf_finished': 52, 'nb_images_finished': 2816, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2816, 'last_update': '2025/03/06', 'portfolio_id': 20995339, 'last_run_id': 1650604, 'total_number_of_photos': 2905}} No error ? {'log_dict': {'total_nb_images': 6755, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66802 seconds', 'coverage_times_pause': '0 days 67743 seconds', 'nb_photos_decision': 6694, 'nb_gray_level_ok': 6694, 'nb_dedup_ok': 3470, 'nb_two_criteria_ok': 3470, 'nb_forced_upload': 61, 'end_of_day_photos_duplicated': 3224, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 3529, 'ratio_coverage': 0.97665170543429}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 3472, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3472, 'last_update': '2025/03/04', 'portfolio_id': 20960306, 'last_run_id': 1644512, 'total_number_of_photos': 3532}} No error ? {'log_dict': {'total_nb_images': 1783, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17642 seconds', 'coverage_times_pause': '0 days 17880 seconds', 'nb_photos_decision': 1769, 'nb_gray_level_ok': 1769, 'nb_dedup_ok': 54, 'nb_two_criteria_ok': 54, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1715, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 67, 'ratio_coverage': 0.9801655647535974}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/09', 'portfolio_id': 21164040, 'last_run_id': 1660606, 'total_number_of_photos': 67}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84382 seconds', 'coverage_times_pause': '0 days 85736 seconds', 'nb_photos_decision': 8468, 'nb_gray_level_ok': 8468, 'nb_dedup_ok': 1351, 'nb_two_criteria_ok': 1351, 'nb_forced_upload': 82, 'end_of_day_photos_duplicated': 7117, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1432, 'ratio_coverage': 0.9766548223937777}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 1325, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1325, 'last_update': '2025/03/08', 'portfolio_id': 21131516, 'last_run_id': 1657956, 'total_number_of_photos': 1439}} No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84300 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8443, 'nb_gray_level_ok': 8443, 'nb_dedup_ok': 3892, 'nb_two_criteria_ok': 3892, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 4551, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3975, 'ratio_coverage': 0.9757057373349228}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 3431, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 568, 'nb_selected_images': 3999, 'last_update': '2025/03/08', 'portfolio_id': 21089077, 'last_run_id': 1657812, 'total_number_of_photos': 4050}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84239 seconds', 'coverage_times_pause': '0 days 85561 seconds', 'nb_photos_decision': 8460, 'nb_gray_level_ok': 8460, 'nb_dedup_ok': 4354, 'nb_two_criteria_ok': 4354, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 4106, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 4420, 'ratio_coverage': 0.9749997106447992}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 4430, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4430, 'last_update': '2025/03/07', 'portfolio_id': 21033292, 'last_run_id': 1653750, 'total_number_of_photos': 4452}} No error ? {'log_dict': {'total_nb_images': 8568, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84726 seconds', 'coverage_times_pause': '0 days 85929 seconds', 'nb_photos_decision': 8484, 'nb_gray_level_ok': 8484, 'nb_dedup_ok': 2812, 'nb_two_criteria_ok': 2812, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 5668, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 2895, 'ratio_coverage': 0.9806363499577542}, 'dashboard_dict': {'nb_ptf_finished': 52, 'nb_images_finished': 2816, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2816, 'last_update': '2025/03/06', 'portfolio_id': 20995339, 'last_run_id': 1650604, 'total_number_of_photos': 2905}} No error ? {'log_dict': {'total_nb_images': 6755, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66802 seconds', 'coverage_times_pause': '0 days 67743 seconds', 'nb_photos_decision': 6694, 'nb_gray_level_ok': 6694, 'nb_dedup_ok': 3470, 'nb_two_criteria_ok': 3470, 'nb_forced_upload': 61, 'end_of_day_photos_duplicated': 3224, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 3529, 'ratio_coverage': 0.97665170543429}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 3472, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3472, 'last_update': '2025/03/04', 'portfolio_id': 20960306, 'last_run_id': 1644512, 'total_number_of_photos': 3532}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84382 seconds', 'coverage_times_pause': '0 days 85736 seconds', 'nb_photos_decision': 8468, 'nb_gray_level_ok': 8468, 'nb_dedup_ok': 1351, 'nb_two_criteria_ok': 1351, 'nb_forced_upload': 82, 'end_of_day_photos_duplicated': 7117, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1432, 'ratio_coverage': 0.9766548223937777}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 1325, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1325, 'last_update': '2025/03/08', 'portfolio_id': 21131516, 'last_run_id': 1657814, 'total_number_of_photos': 1439}} No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84300 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8443, 'nb_gray_level_ok': 8443, 'nb_dedup_ok': 3892, 'nb_two_criteria_ok': 3892, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 4551, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3975, 'ratio_coverage': 0.9757057373349228}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 3431, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 568, 'nb_selected_images': 3999, 'last_update': '2025/03/08', 'portfolio_id': 21089077, 'last_run_id': 1657812, 'total_number_of_photos': 4050}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84239 seconds', 'coverage_times_pause': '0 days 85561 seconds', 'nb_photos_decision': 8460, 'nb_gray_level_ok': 8460, 'nb_dedup_ok': 4354, 'nb_two_criteria_ok': 4354, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 4106, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 4420, 'ratio_coverage': 0.9749997106447992}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 4430, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4430, 'last_update': '2025/03/07', 'portfolio_id': 21033292, 'last_run_id': 1653750, 'total_number_of_photos': 4452}} No error ? {'log_dict': {'total_nb_images': 8568, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84726 seconds', 'coverage_times_pause': '0 days 85929 seconds', 'nb_photos_decision': 8484, 'nb_gray_level_ok': 8484, 'nb_dedup_ok': 2812, 'nb_two_criteria_ok': 2812, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 5668, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 2895, 'ratio_coverage': 0.9806363499577542}, 'dashboard_dict': {'nb_ptf_finished': 52, 'nb_images_finished': 2816, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2816, 'last_update': '2025/03/06', 'portfolio_id': 20995339, 'last_run_id': 1650604, 'total_number_of_photos': 2905}} No error ? {'log_dict': {'total_nb_images': 6755, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66802 seconds', 'coverage_times_pause': '0 days 67743 seconds', 'nb_photos_decision': 6694, 'nb_gray_level_ok': 6694, 'nb_dedup_ok': 3470, 'nb_two_criteria_ok': 3470, 'nb_forced_upload': 61, 'end_of_day_photos_duplicated': 3224, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 3529, 'ratio_coverage': 0.97665170543429}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 3472, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3472, 'last_update': '2025/03/04', 'portfolio_id': 20960306, 'last_run_id': 1644512, 'total_number_of_photos': 3532}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2137, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 21077 seconds', 'coverage_times_pause': '0 days 21429 seconds', 'nb_photos_decision': 2128, 'nb_gray_level_ok': 2128, 'nb_dedup_ok': 35, 'nb_two_criteria_ok': 35, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 2088, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 48, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/02', 'portfolio_id': 20943255, 'last_run_id': 1641258, 'total_number_of_photos': 49}} No error ? {'log_dict': {'total_nb_images': 8527, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84300 seconds', 'coverage_times_pause': '0 days 85513 seconds', 'nb_photos_decision': 8443, 'nb_gray_level_ok': 8443, 'nb_dedup_ok': 3892, 'nb_two_criteria_ok': 3892, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 4551, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3975, 'ratio_coverage': 0.9757057373349228}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3192, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 14, 'nb_images_started': 807, 'nb_selected_images': 3999, 'last_update': '2025/03/07', 'portfolio_id': 21089077, 'last_run_id': 1654198, 'total_number_of_photos': 4049}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84239 seconds', 'coverage_times_pause': '0 days 85561 seconds', 'nb_photos_decision': 8460, 'nb_gray_level_ok': 8460, 'nb_dedup_ok': 4354, 'nb_two_criteria_ok': 4354, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 4106, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 4420, 'ratio_coverage': 0.9749997106447992}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 4430, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4430, 'last_update': '2025/03/07', 'portfolio_id': 21033292, 'last_run_id': 1653750, 'total_number_of_photos': 4452}} No error ? {'log_dict': {'total_nb_images': 8568, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84726 seconds', 'coverage_times_pause': '0 days 85929 seconds', 'nb_photos_decision': 8484, 'nb_gray_level_ok': 8484, 'nb_dedup_ok': 2812, 'nb_two_criteria_ok': 2812, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 5668, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 2895, 'ratio_coverage': 0.9806363499577542}, 'dashboard_dict': {'nb_ptf_finished': 52, 'nb_images_finished': 2816, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2816, 'last_update': '2025/03/06', 'portfolio_id': 20995339, 'last_run_id': 1650604, 'total_number_of_photos': 2905}} No error ? {'log_dict': {'total_nb_images': 6755, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66802 seconds', 'coverage_times_pause': '0 days 67743 seconds', 'nb_photos_decision': 6694, 'nb_gray_level_ok': 6694, 'nb_dedup_ok': 3470, 'nb_two_criteria_ok': 3470, 'nb_forced_upload': 61, 'end_of_day_photos_duplicated': 3224, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 3529, 'ratio_coverage': 0.97665170543429}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 3472, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3472, 'last_update': '2025/03/04', 'portfolio_id': 20960306, 'last_run_id': 1644512, 'total_number_of_photos': 3532}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2137, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 21077 seconds', 'coverage_times_pause': '0 days 21429 seconds', 'nb_photos_decision': 2128, 'nb_gray_level_ok': 2128, 'nb_dedup_ok': 35, 'nb_two_criteria_ok': 35, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 2088, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 48, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/02', 'portfolio_id': 20943255, 'last_run_id': 1641258, 'total_number_of_photos': 49}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84239 seconds', 'coverage_times_pause': '0 days 85561 seconds', 'nb_photos_decision': 8460, 'nb_gray_level_ok': 8460, 'nb_dedup_ok': 4354, 'nb_two_criteria_ok': 4354, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 4106, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 4420, 'ratio_coverage': 0.9749997106447992}, 'dashboard_dict': {'nb_ptf_finished': 77, 'nb_images_finished': 4430, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4430, 'last_update': '2025/03/06', 'portfolio_id': 21033292, 'last_run_id': 1651438, 'total_number_of_photos': 4452}} No error ? {'log_dict': {'total_nb_images': 8568, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84726 seconds', 'coverage_times_pause': '0 days 85929 seconds', 'nb_photos_decision': 8484, 'nb_gray_level_ok': 8484, 'nb_dedup_ok': 2812, 'nb_two_criteria_ok': 2812, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 5668, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 2895, 'ratio_coverage': 0.9806363499577542}, 'dashboard_dict': {'nb_ptf_finished': 52, 'nb_images_finished': 2816, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2816, 'last_update': '2025/03/06', 'portfolio_id': 20995339, 'last_run_id': 1650604, 'total_number_of_photos': 2905}} No error ? {'log_dict': {'total_nb_images': 6755, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66802 seconds', 'coverage_times_pause': '0 days 67743 seconds', 'nb_photos_decision': 6694, 'nb_gray_level_ok': 6694, 'nb_dedup_ok': 3470, 'nb_two_criteria_ok': 3470, 'nb_forced_upload': 61, 'end_of_day_photos_duplicated': 3224, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 3529, 'ratio_coverage': 0.97665170543429}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 3472, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3472, 'last_update': '2025/03/04', 'portfolio_id': 20960306, 'last_run_id': 1644512, 'total_number_of_photos': 3532}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2137, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 21077 seconds', 'coverage_times_pause': '0 days 21429 seconds', 'nb_photos_decision': 2128, 'nb_gray_level_ok': 2128, 'nb_dedup_ok': 35, 'nb_two_criteria_ok': 35, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 2088, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 48, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/02', 'portfolio_id': 20943255, 'last_run_id': 1641258, 'total_number_of_photos': 49}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8568, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84726 seconds', 'coverage_times_pause': '0 days 85929 seconds', 'nb_photos_decision': 8484, 'nb_gray_level_ok': 8484, 'nb_dedup_ok': 2812, 'nb_two_criteria_ok': 2812, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 5668, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 2895, 'ratio_coverage': 0.9806363499577542}, 'dashboard_dict': {'nb_ptf_finished': 52, 'nb_images_finished': 2816, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2816, 'last_update': '2025/03/05', 'portfolio_id': 20995339, 'last_run_id': 1647777, 'total_number_of_photos': 2905}} No error ? {'log_dict': {'total_nb_images': 6755, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66802 seconds', 'coverage_times_pause': '0 days 67743 seconds', 'nb_photos_decision': 6694, 'nb_gray_level_ok': 6694, 'nb_dedup_ok': 3470, 'nb_two_criteria_ok': 3470, 'nb_forced_upload': 61, 'end_of_day_photos_duplicated': 3224, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 3529, 'ratio_coverage': 0.97665170543429}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 3472, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3472, 'last_update': '2025/03/04', 'portfolio_id': 20960306, 'last_run_id': 1644512, 'total_number_of_photos': 3532}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2137, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 21077 seconds', 'coverage_times_pause': '0 days 21429 seconds', 'nb_photos_decision': 2128, 'nb_gray_level_ok': 2128, 'nb_dedup_ok': 35, 'nb_two_criteria_ok': 35, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 2088, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 48, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/02', 'portfolio_id': 20943255, 'last_run_id': 1641258, 'total_number_of_photos': 49}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 6755, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 66802 seconds', 'coverage_times_pause': '0 days 67743 seconds', 'nb_photos_decision': 6694, 'nb_gray_level_ok': 6694, 'nb_dedup_ok': 3470, 'nb_two_criteria_ok': 3470, 'nb_forced_upload': 61, 'end_of_day_photos_duplicated': 3224, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 3529, 'ratio_coverage': 0.97665170543429}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 3472, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3472, 'last_update': '2025/03/04', 'portfolio_id': 20960306, 'last_run_id': 1644413, 'total_number_of_photos': 3532}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2137, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 21077 seconds', 'coverage_times_pause': '0 days 21429 seconds', 'nb_photos_decision': 2128, 'nb_gray_level_ok': 2128, 'nb_dedup_ok': 35, 'nb_two_criteria_ok': 35, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 2088, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 48, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/02', 'portfolio_id': 20943255, 'last_run_id': 1641258, 'total_number_of_photos': 49}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2137, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 21077 seconds', 'coverage_times_pause': '0 days 21429 seconds', 'nb_photos_decision': 2128, 'nb_gray_level_ok': 2128, 'nb_dedup_ok': 35, 'nb_two_criteria_ok': 35, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 2088, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 48, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/02', 'portfolio_id': 20943255, 'last_run_id': 1641258, 'total_number_of_photos': 49}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2137, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 21077 seconds', 'coverage_times_pause': '0 days 21429 seconds', 'nb_photos_decision': 2128, 'nb_gray_level_ok': 2128, 'nb_dedup_ok': 35, 'nb_two_criteria_ok': 35, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 2088, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 48, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/03/02', 'portfolio_id': 20943255, 'last_run_id': 1641252, 'total_number_of_photos': 48}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Found day : 2025-03-31 00:00:00 Found day : 2025-03-29 00:00:00 Found day : 2025-03-28 00:00:00 Found day : 2025-03-27 00:00:00 Found day : 2025-03-26 00:00:00 Found day : 2025-03-25 00:00:00 Found day : 2025-03-24 00:00:00 Found day : 2025-03-22 00:00:00 Found day : 2025-03-21 00:00:00 Found day : 2025-03-20 00:00:00 Found day : 2025-03-19 00:00:00 Found day : 2025-03-18 00:00:00 Found day : 2025-03-17 00:00:00 Found day : 2025-03-15 00:00:00 Found day : 2025-03-14 00:00:00 Found day : 2025-03-13 00:00:00 Found day : 2025-03-12 00:00:00 Found day : 2025-03-11 00:00:00 Found day : 2025-03-10 00:00:00 Found day : 2025-03-08 00:00:00 Found day : 2025-03-07 00:00:00 Found day : 2025-03-06 00:00:00 Found day : 2025-03-05 00:00:00 Found day : 2025-03-04 00:00:00 Found day : 2025-03-03 00:00:00 Found day : 2025-03-01 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and ded.dashboard_place_id = 10 and month(ded.date) = 03 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______JRM' and ded.dashboard_place_id = 10 and month(ded.date) = 03 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 10 and mp.name like '%032025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-03-01 : dt_date_just_month_year : 2025-03-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "arc_en_ciel_jrm" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-03-01" AND ded.date <= "2025-03-31" apple3 {'JRM': {'mat': 'JRM', 'pht': 3726, 'datou_carac_id': 4302, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (1641258,1644512,1650604,1653750,1657812,1657956,1660674,1668939,1670137,1672759,1675492,1678912,1679935,1680749,1688544,1689885,1694093,1697610,1700517,1704593,1708297,1710028,1714497) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.032005809875899925, 'nb_photo': 43415, 'list_port_cont': '20960314,20960526,20960903,20961073,20961525,20961950,20962444,20962826,20963343,20963692,20964484,20965031,20965544,20966667,20966759,20967398,20967737,20968205,20968792,20969555,20970260,20970824,20971360,20971851,20972572,20973320,20974096,20974836,20976068,20976527,20976812,20977094,20977629,20978008,20978656,20979265,20979708,20980386,20980865,20981354,20981997,20982257,20983114,20983813,20984423,20984783,20986047,20986477,20987014,20987517,20988188,20988616,20989070,20989578,20990354,20990945,20991583,20992753,20994607,21000161,21000339,21000686,21001010,21002181,21002354,21003280,21003735,21004339,21004939,21005503,21006158,21006701,21008539,21008905,21009464,21009971,21010626,21011249,21011837,21012519,21013003,21013957,21014730,21015633,21015759,21016742,21017254,21017860,21018855,21019995,21020588,21020864,21021005,21021920,21022480,21022721,21023309,21023875,21024436,21025575,21025970,21026743,21027340,21028058,21028648,21029326,21030204,21030871,21031672,21032407,21033013,21033428,21034049,2103472', 'assoc_port': '20960307:20960314,20960513:20960526,20960900:20960903,20961064:20961073,20961514:20961525,20961943:20961950,20962435:20962444,20962794:20962826,20963307:20963343,20963628:20963692,20964476:20964484,20965022:20965031,20965512:20965544,20966655:20966667,20966718:20966759,20967368:20967398,20967705:20967737,20968187:20968205,20968779:20968792,20969496:20969555,20970176:20970260,20970772:20970824,20971287:20971360,20971841:20971851,20972467:20972572,20973314:20973320,20974054:20974096,20974829:20974836,20976058:20976068,20976515:20976527,20976807:20976812,20977087:20977094,20977626:20977629,20978006:20978008,20978650:20978656,20979220:20979265,20979676:20979708,20980311:20980386,20980858:20980865,20981321:20981354,20981988:20981997,20982201:20982257,20983052:20983114,20983803:20983813,20984411:20984423,20984700:20984783,20986044:20986047,20986474:20986477,20987003:20987014,20987472:20987517,20988119:20988188,20988613:20988616,20989064:20989070,20989548:20989578,20990317:20990354,20990909:20990945,20991546:2099158', 'assoc_mat': '20960307:autre_refus:3726:20960314,20960513:autre_refus:3726:20960526,20960900:autre_refus:3726:20960903,20961064:autre_refus:3726:20961073,20961514:autre_refus:3726:20961525,20961943:autre_refus:3726:20961950,20962435:autre_refus:3726:20962444,20962794:autre_refus:3726:20962826,20963307:autre_refus:3726:20963343,20963628:autre_refus:3726:20963692,20964476:autre_refus:3726:20964484,20965022:autre_refus:3726:20965031,20965512:autre_refus:3726:20965544,20966655:autre_refus:3726:20966667,20966718:autre_refus:3726:20966759,20967368:autre_refus:3726:20967398,20967705:autre_refus:3726:20967737,20968187:autre_refus:3726:20968205,20968779:autre_refus:3726:20968792,20969496:autre_refus:3726:20969555,20970176:autre_refus:3726:20970260,20970772:autre_refus:3726:20970824,20971287:autre_refus:3726:20971360,20971841:autre_refus:3726:20971851,20972467:autre_refus:3726:20972572,20973314:autre_refus:3726:20973320,20974054:autre_refus:3726:20974096,20974829:autre_refus:3726:20974836,20976058:autre_refus:3726:20976068,20976515:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.005814099877437112, 'nb_photo': 15777, 'list_port_cont': '20960316,20960520,20960912,20961070,20961528,20961955,20962443,20962827,20963339,20963694,20964482,20965028,20965549,20966669,20966755,20967406,20967726,20968196,20968790,20969557,20970256,20970833,20971367,20971855,20972566,20973329,20974086,20974843,20976059,20976526,20976819,20977095,20977631,20978011,20978659,20979267,20979707,20980378,20980861,20981352,20981995,20982254,20983103,20983817,20984422,20984782,20986057,20986476,20987011,20987526,20988191,20988620,20989067,20989588,20990349,20990950,20991579,20992758,20994606,21000167,21000335,21000682,21001013,21002182,21002363,21003284,21003728,21004341,21004945,21005509,21006164,21006702,21008531,21008910,21009466,21009962,21010627,21011253,21011841,21012513,21013012,21013965,21014723,21015640,21015754,21016741,21017261,21017859,21018861,21020004,21020590,21020865,21021008,21021926,21022478,21022720,21023314,21023867,21024432,21025573,21025966,21026749,21027336,21028060,21028650,21029316,21030208,21030876,21031667,21032413,21033014,21033430,21034052,2103471', 'assoc_port': '20960307:20960316,20960513:20960520,20960900:20960912,20961064:20961070,20961514:20961528,20961943:20961955,20962435:20962443,20962794:20962827,20963307:20963339,20963628:20963694,20964476:20964482,20965022:20965028,20965512:20965549,20966655:20966669,20966718:20966755,20967368:20967406,20967705:20967726,20968187:20968196,20968779:20968790,20969496:20969557,20970176:20970256,20970772:20970833,20971287:20971367,20971841:20971855,20972467:20972566,20973314:20973329,20974054:20974086,20974829:20974843,20976058:20976059,20976515:20976526,20976807:20976819,20977087:20977095,20977626:20977631,20978006:20978011,20978650:20978659,20979220:20979267,20979676:20979707,20980311:20980378,20980858:20980861,20981321:20981352,20981988:20981995,20982201:20982254,20983052:20983103,20983803:20983817,20984411:20984422,20984700:20984782,20986044:20986057,20986474:20986476,20987003:20987011,20987472:20987526,20988119:20988191,20988613:20988620,20989064:20989067,20989548:20989588,20990317:20990349,20990909:20990950,20991546:2099157', 'assoc_mat': '20960307:cartonnette:3726:20960316,20960513:cartonnette:3726:20960520,20960900:cartonnette:3726:20960912,20961064:cartonnette:3726:20961070,20961514:cartonnette:3726:20961528,20961943:cartonnette:3726:20961955,20962435:cartonnette:3726:20962443,20962794:cartonnette:3726:20962827,20963307:cartonnette:3726:20963339,20963628:cartonnette:3726:20963694,20964476:cartonnette:3726:20964482,20965022:cartonnette:3726:20965028,20965512:cartonnette:3726:20965549,20966655:cartonnette:3726:20966669,20966718:cartonnette:3726:20966755,20967368:cartonnette:3726:20967406,20967705:cartonnette:3726:20967726,20968187:cartonnette:3726:20968196,20968779:cartonnette:3726:20968790,20969496:cartonnette:3726:20969557,20970176:cartonnette:3726:20970256,20970772:cartonnette:3726:20970833,20971287:cartonnette:3726:20971367,20971841:cartonnette:3726:20971855,20972467:cartonnette:3726:20972566,20973314:cartonnette:3726:20973329,20974054:cartonnette:3726:20974086,20974829:cartonnette:3726:20974843,20976058:cartonnette:3726:20976059,20976515:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.012366377022960028, 'nb_photo': 17265, 'list_port_cont': '20960317,20960523,20960906,20961069,20961523,20961957,20962442,20962824,20963341,20963688,20964487,20965030,20965551,20966663,20966757,20967404,20967736,20968199,20968795,20969551,20970258,20970829,20971365,20971853,20972573,20973322,20974093,20974840,20976070,20976523,20977099,20977632,20978015,20978662,20979266,20979712,20980385,20980866,20981353,20981991,20982260,20983104,20983808,20984425,20984790,20986051,20986482,20987017,20987527,20988187,20988619,20989077,20989585,20990347,20990947,20991576,20994605,21000166,21000341,21000687,21001009,21002180,21002355,21003285,21003734,21004346,21004944,21005508,21006163,21006706,21008540,21008915,21009470,21009963,21010632,21011255,21011833,21012515,21013007,21013961,21014731,21015634,21015751,21016740,21017257,21017858,21018859,21019998,21020580,21020873,21021006,21021921,21022719,21023306,21023865,21024441,21025582,21025972,21026746,21027337,21028062,21028644,21029322,21030199,21030877,21031666,21032416,21033020,21033431,21034051,21034719,21035127,21036234,2103665', 'assoc_port': '20960307:20960317,20960513:20960523,20960900:20960906,20961064:20961069,20961514:20961523,20961943:20961957,20962435:20962442,20962794:20962824,20963307:20963341,20963628:20963688,20964476:20964487,20965022:20965030,20965512:20965551,20966655:20966663,20966718:20966757,20967368:20967404,20967705:20967736,20968187:20968199,20968779:20968795,20969496:20969551,20970176:20970258,20970772:20970829,20971287:20971365,20971841:20971853,20972467:20972573,20973314:20973322,20974054:20974093,20974829:20974840,20976058:20976070,20976515:20976523,20977087:20977099,20977626:20977632,20978006:20978015,20978650:20978662,20979220:20979266,20979676:20979712,20980311:20980385,20980858:20980866,20981321:20981353,20981988:20981991,20982201:20982260,20983052:20983104,20983803:20983808,20984411:20984425,20984700:20984790,20986044:20986051,20986474:20986482,20987003:20987017,20987472:20987527,20988119:20988187,20988613:20988619,20989064:20989077,20989548:20989585,20990317:20990347,20990909:20990947,20991546:20991576,20994599:2099460', 'assoc_mat': '20960307:Carton_brun:3726:20960317,20960513:Carton_brun:3726:20960523,20960900:Carton_brun:3726:20960906,20961064:Carton_brun:3726:20961069,20961514:Carton_brun:3726:20961523,20961943:Carton_brun:3726:20961957,20962435:Carton_brun:3726:20962442,20962794:Carton_brun:3726:20962824,20963307:Carton_brun:3726:20963341,20963628:Carton_brun:3726:20963688,20964476:Carton_brun:3726:20964487,20965022:Carton_brun:3726:20965030,20965512:Carton_brun:3726:20965551,20966655:Carton_brun:3726:20966663,20966718:Carton_brun:3726:20966757,20967368:Carton_brun:3726:20967404,20967705:Carton_brun:3726:20967736,20968187:Carton_brun:3726:20968199,20968779:Carton_brun:3726:20968795,20969496:Carton_brun:3726:20969551,20970176:Carton_brun:3726:20970258,20970772:Carton_brun:3726:20970829,20971287:Carton_brun:3726:20971365,20971841:Carton_brun:3726:20971853,20972467:Carton_brun:3726:20972573,20973314:Carton_brun:3726:20973322,20974054:Carton_brun:3726:20974093,20974829:Carton_brun:3726:20974840,20976058:Carton_brun:3726:20976070,20976515:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.008737595416789699, 'nb_photo': 17567, 'list_port_cont': '20960311,20960525,20960907,20961074,20961520,20961953,20962441,20962833,20963345,20963695,20964486,20965036,20965545,20966661,20966754,20967402,20967735,20968204,20968800,20969556,20970257,20970827,20971362,20971857,20972565,20973327,20974088,20974842,20976062,20976521,20976816,20977098,20977636,20978014,20978663,20979259,20979704,20980382,20980870,20981361,20981996,20982261,20983106,20983814,20984414,20984785,20986058,20986480,20987008,20987525,20988186,20988623,20989074,20989583,20990352,20990942,20991581,21000159,21000346,21000678,21001007,21002178,21002352,21003279,21003727,21004342,21004941,21005500,21006157,21006704,21008530,21008911,21009465,21009970,21010629,21011256,21011836,21012514,21013011,21013964,21014721,21015641,21015758,21016733,21017253,21017857,21018856,21020003,21020585,21020867,21020997,21021922,21022473,21022722,21023308,21023864,21024437,21025581,21025967,21026751,21027342,21028059,21028645,21029323,21030203,21030880,21031676,21032409,21033012,21033432,21034054,21034724,21035130,2103623', 'assoc_port': '20960307:20960311,20960513:20960525,20960900:20960907,20961064:20961074,20961514:20961520,20961943:20961953,20962435:20962441,20962794:20962833,20963307:20963345,20963628:20963695,20964476:20964486,20965022:20965036,20965512:20965545,20966655:20966661,20966718:20966754,20967368:20967402,20967705:20967735,20968187:20968204,20968779:20968800,20969496:20969556,20970176:20970257,20970772:20970827,20971287:20971362,20971841:20971857,20972467:20972565,20973314:20973327,20974054:20974088,20974829:20974842,20976058:20976062,20976515:20976521,20976807:20976816,20977087:20977098,20977626:20977636,20978006:20978014,20978650:20978663,20979220:20979259,20979676:20979704,20980311:20980382,20980858:20980870,20981321:20981361,20981988:20981996,20982201:20982261,20983052:20983106,20983803:20983814,20984411:20984414,20984700:20984785,20986044:20986058,20986474:20986480,20987003:20987008,20987472:20987525,20988119:20988186,20988613:20988623,20989064:20989074,20989548:20989583,20990317:20990352,20990909:20990942,20991546:2099158', 'assoc_mat': '20960307:Carton_gris:3726:20960311,20960513:Carton_gris:3726:20960525,20960900:Carton_gris:3726:20960907,20961064:Carton_gris:3726:20961074,20961514:Carton_gris:3726:20961520,20961943:Carton_gris:3726:20961953,20962435:Carton_gris:3726:20962441,20962794:Carton_gris:3726:20962833,20963307:Carton_gris:3726:20963345,20963628:Carton_gris:3726:20963695,20964476:Carton_gris:3726:20964486,20965022:Carton_gris:3726:20965036,20965512:Carton_gris:3726:20965545,20966655:Carton_gris:3726:20966661,20966718:Carton_gris:3726:20966754,20967368:Carton_gris:3726:20967402,20967705:Carton_gris:3726:20967735,20968187:Carton_gris:3726:20968204,20968779:Carton_gris:3726:20968800,20969496:Carton_gris:3726:20969556,20970176:Carton_gris:3726:20970257,20970772:Carton_gris:3726:20970827,20971287:Carton_gris:3726:20971362,20971841:Carton_gris:3726:20971857,20972467:Carton_gris:3726:20972565,20973314:Carton_gris:3726:20973327,20974054:Carton_gris:3726:20974088,20974829:Carton_gris:3726:20974842,20976058:Carton_gris:3726:20976062,20976515:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0017644184725354906, 'nb_photo': 2831, 'list_port_cont': '20960321,20961071,20961521,20961954,20962447,20962835,20963338,20963690,20964491,20965029,20965546,20966753,20968799,20969560,20970261,20970831,20971364,20971856,20972569,20973325,20974085,20976529,20976813,20977090,20977640,20978019,20979268,20979714,20980871,20981351,20982002,20982252,20983108,20984415,20984781,20986056,20986486,20987519,20988182,20988622,20989078,20990343,20990943,20991584,21000342,21000689,21001008,21002184,21003731,21004350,21004940,21006159,21006703,21008529,21008907,21009475,21009967,21010634,21011835,21012512,21013006,21013958,21014727,21015637,21015762,21017258,21017865,21018857,21020001,21022714,21023303,21023871,21025973,21027345,21028061,21028651,21029325,21030210,21031670,21032406,21033010,21033437,21034047,21034720,21035125,21036661,21037201,21037747,21038159,21038960,21039854,21040538,21042335,21042742,21044132,21044564,21045295,21045942,21046575,21047123,21047842,21049550,21050214,21051289,21051457,21052371,21054990,21056061,21056610,21057142,21058611,21060584,21061242,2106184', 'assoc_port': '20960307:20960321,20961064:20961071,20961514:20961521,20961943:20961954,20962435:20962447,20962794:20962835,20963307:20963338,20963628:20963690,20964476:20964491,20965022:20965029,20965512:20965546,20966718:20966753,20968779:20968799,20969496:20969560,20970176:20970261,20970772:20970831,20971287:20971364,20971841:20971856,20972467:20972569,20973314:20973325,20974054:20974085,20976515:20976529,20976807:20976813,20977087:20977090,20977626:20977640,20978006:20978019,20979220:20979268,20979676:20979714,20980858:20980871,20981321:20981351,20981988:20982002,20982201:20982252,20983052:20983108,20984411:20984415,20984700:20984781,20986044:20986056,20986474:20986486,20987472:20987519,20988119:20988182,20988613:20988622,20989064:20989078,20990317:20990343,20990909:20990943,20991546:20991584,21000334:21000342,21000676:21000689,21001000:21001008,21002132:21002184,21003724:21003731,21004334:21004350,21004910:21004940,21006128:21006159,21006668:21006703,21008527:21008529,21008886:21008907,21009461:21009475,21009958:2100996', 'assoc_mat': '20960307:kraft:3726:20960321,20961064:kraft:3726:20961071,20961514:kraft:3726:20961521,20961943:kraft:3726:20961954,20962435:kraft:3726:20962447,20962794:kraft:3726:20962835,20963307:kraft:3726:20963338,20963628:kraft:3726:20963690,20964476:kraft:3726:20964491,20965022:kraft:3726:20965029,20965512:kraft:3726:20965546,20966718:kraft:3726:20966753,20968779:kraft:3726:20968799,20969496:kraft:3726:20969560,20970176:kraft:3726:20970261,20970772:kraft:3726:20970831,20971287:kraft:3726:20971364,20971841:kraft:3726:20971856,20972467:kraft:3726:20972569,20973314:kraft:3726:20973325,20974054:kraft:3726:20974085,20976515:kraft:3726:20976529,20976807:kraft:3726:20976813,20977087:kraft:3726:20977090,20977626:kraft:3726:20977640,20978006:kraft:3726:20978019,20979220:kraft:3726:20979268,20979676:kraft:3726:20979714,20980858:kraft:3726:20980871,20981321:kraft:3726:20981351,20981988:kraft:3726:20982002,20982201:kraft:3726:20982252,20983052:kraft:3726:20983108,20984411:kraft:3726:20984415,20984700:kraft:3726:20984781,20986044:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0005556362152610759, 'nb_photo': 671, 'list_port_cont': '20962825,20963344,20963684,20964489,20965541,20966752,20968200,20968796,20970254,20970825,20971363,20972571,20974087,20974844,20976061,20978013,20978661,20979710,20981360,20982259,20983109,20983809,20984416,20984786,20986485,20987010,20989582,21000162,21001012,21003277,21003733,21004343,21005505,21009474,21010636,21013956,21014726,21017260,21019997,21020863,21022474,21023872,21026740,21027338,21028065,21028640,21030209,21030878,21031669,21033429,21034050,21035129,21036653,21037200,21037742,21038158,21038962,21040534,21042748,21043140,21044565,21045290,21047121,21047844,21048700,21051450,21052362,21059630,21067430,21068865,21069476,21070741,21072057,21075482,21078019,21078694,21079398,21080965,21081726,21085776,21088252,21089231,21089852,21090393,21092982,21093328,21095287,21096727,21098113,21100028,21104333,21104724,21106674,21108367,21111890,21118105,21125087,21126085,21127191,21133341,21133365,21133490,21133520,21144781,21145010,21145725,21146464,21151519,21152732,21153287,21154262,21155600,21156367,2122274', 'assoc_port': '20962794:20962825,20963307:20963344,20963628:20963684,20964476:20964489,20965512:20965541,20966718:20966752,20968187:20968200,20968779:20968796,20970176:20970254,20970772:20970825,20971287:20971363,20972467:20972571,20974054:20974087,20974829:20974844,20976058:20976061,20978006:20978013,20978650:20978661,20979676:20979710,20981321:20981360,20982201:20982259,20983052:20983109,20983803:20983809,20984411:20984416,20984700:20984786,20986474:20986485,20987003:20987010,20989548:20989582,21000153:21000162,21001000:21001012,21003272:21003277,21003724:21003733,21004334:21004343,21005496:21005505,21009461:21009474,21010580:21010636,21013935:21013956,21014715:21014726,21017247:21017260,21019955:21019997,21020862:21020863,21022471:21022474,21023862:21023872,21026737:21026740,21027310:21027338,21028005:21028065,21028610:21028640,21030129:21030209,21030842:21030878,21031610:21031669,21033425:21033429,21033980:21034050,21035092:21035129,21036613:21036653,21037191:21037200,21037712:21037742,21038145:21038158,21038910:2103896', 'assoc_mat': '20962794:metal:3726:20962825,20963307:metal:3726:20963344,20963628:metal:3726:20963684,20964476:metal:3726:20964489,20965512:metal:3726:20965541,20966718:metal:3726:20966752,20968187:metal:3726:20968200,20968779:metal:3726:20968796,20970176:metal:3726:20970254,20970772:metal:3726:20970825,20971287:metal:3726:20971363,20972467:metal:3726:20972571,20974054:metal:3726:20974087,20974829:metal:3726:20974844,20976058:metal:3726:20976061,20978006:metal:3726:20978013,20978650:metal:3726:20978661,20979676:metal:3726:20979710,20981321:metal:3726:20981360,20982201:metal:3726:20982259,20983052:metal:3726:20983109,20983803:metal:3726:20983809,20984411:metal:3726:20984416,20984700:metal:3726:20984786,20986474:metal:3726:20986485,20987003:metal:3726:20987010,20989548:metal:3726:20989582,21000153:metal:3726:21000162,21001000:metal:3726:21001012,21003272:metal:3726:21003277,21003724:metal:3726:21003733,21004334:metal:3726:21004343,21005496:metal:3726:21005505,21009461:metal:3726:21009474,21010580:metal:3726:21010636,21013935:'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004497159495204218, 'nb_photo': 10913, 'list_port_cont': '20960320,20960521,20960902,20961077,20961524,20961952,20962446,20962834,20963340,20963691,20964492,20965033,20965552,20966662,20966758,20967397,20967734,20968197,20968798,20969558,20970259,20970830,20971358,20971859,20972564,20973321,20974090,20974834,20976066,20976814,20977096,20977637,20978017,20978655,20979263,20979713,20980384,20980868,20981359,20981999,20982255,20983107,20983812,20984420,20984779,20986052,20986483,20987013,20987523,20988183,20988626,20989068,20989584,20990353,20990944,20991577,20992757,20994604,21000164,21000685,21001006,21002177,21002361,21003278,21003730,21004340,21004949,21005506,21006161,21006708,21008532,21008913,21009468,21009966,21010631,21011247,21011843,21012520,21013002,21013959,21014728,21015639,21015753,21016739,21017256,21017862,21018860,21019993,21020874,21020999,21021918,21022723,21023312,21023869,21024440,21025578,21025965,21026750,21027343,21028069,21028643,21029320,21030205,21030882,21031673,21032415,21033011,21033438,21034053,21034715,21035128,21036230,21036656,2103719', 'assoc_port': '20960307:20960320,20960513:20960521,20960900:20960902,20961064:20961077,20961514:20961524,20961943:20961952,20962435:20962446,20962794:20962834,20963307:20963340,20963628:20963691,20964476:20964492,20965022:20965033,20965512:20965552,20966655:20966662,20966718:20966758,20967368:20967397,20967705:20967734,20968187:20968197,20968779:20968798,20969496:20969558,20970176:20970259,20970772:20970830,20971287:20971358,20971841:20971859,20972467:20972564,20973314:20973321,20974054:20974090,20974829:20974834,20976058:20976066,20976807:20976814,20977087:20977096,20977626:20977637,20978006:20978017,20978650:20978655,20979220:20979263,20979676:20979713,20980311:20980384,20980858:20980868,20981321:20981359,20981988:20981999,20982201:20982255,20983052:20983107,20983803:20983812,20984411:20984420,20984700:20984779,20986044:20986052,20986474:20986483,20987003:20987013,20987472:20987523,20988119:20988183,20988613:20988626,20989064:20989068,20989548:20989584,20990317:20990353,20990909:20990944,20991546:20991577,20992705:2099275', 'assoc_mat': '20960307:plastique:3726:20960320,20960513:plastique:3726:20960521,20960900:plastique:3726:20960902,20961064:plastique:3726:20961077,20961514:plastique:3726:20961524,20961943:plastique:3726:20961952,20962435:plastique:3726:20962446,20962794:plastique:3726:20962834,20963307:plastique:3726:20963340,20963628:plastique:3726:20963691,20964476:plastique:3726:20964492,20965022:plastique:3726:20965033,20965512:plastique:3726:20965552,20966655:plastique:3726:20966662,20966718:plastique:3726:20966758,20967368:plastique:3726:20967397,20967705:plastique:3726:20967734,20968187:plastique:3726:20968197,20968779:plastique:3726:20968798,20969496:plastique:3726:20969558,20970176:plastique:3726:20970259,20970772:plastique:3726:20970830,20971287:plastique:3726:20971358,20971841:plastique:3726:20971859,20972467:plastique:3726:20972564,20973314:plastique:3726:20973321,20974054:plastique:3726:20974090,20974829:plastique:3726:20974834,20976058:plastique:3726:20976066,20976807:plastique:3726:20976814,20977087:plastique:3726:20977096,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.01114949068130545, 'nb_photo': 25337, 'list_port_cont': '20960313,20960527,20960909,20961072,20961527,20961947,20962439,20962829,20963346,20963687,20964488,20965034,20965547,20966671,20966756,20967396,20967732,20968198,20968801,20969559,20970250,20970826,20971359,20971852,20972574,20973323,20974092,20974837,20976069,20976524,20976820,20977100,20977638,20978012,20978660,20979269,20979706,20980379,20980864,20981362,20981993,20982256,20983113,20983810,20984418,20984784,20986054,20986484,20987015,20987516,20988184,20988617,20989073,20989586,20990348,20990948,20991582,20994600,21000157,21000345,21000681,21001004,21002174,21002357,21003283,21003729,21004345,21004947,21005501,21006160,21006700,21008534,21008914,21009467,21009968,21010628,21011250,21011842,21012523,21013008,21013966,21014729,21015642,21015761,21016738,21017252,21017868,21018852,21020000,21020587,21020866,21020998,21021924,21022484,21022717,21023304,21023873,21024435,21025576,21025975,21026744,21027339,21028067,21028646,21029315,21030201,21030872,21031665,21032417,21033016,21033434,21034044,21034716,2103512', 'assoc_port': '20960307:20960313,20960513:20960527,20960900:20960909,20961064:20961072,20961514:20961527,20961943:20961947,20962435:20962439,20962794:20962829,20963307:20963346,20963628:20963687,20964476:20964488,20965022:20965034,20965512:20965547,20966655:20966671,20966718:20966756,20967368:20967396,20967705:20967732,20968187:20968198,20968779:20968801,20969496:20969559,20970176:20970250,20970772:20970826,20971287:20971359,20971841:20971852,20972467:20972574,20973314:20973323,20974054:20974092,20974829:20974837,20976058:20976069,20976515:20976524,20976807:20976820,20977087:20977100,20977626:20977638,20978006:20978012,20978650:20978660,20979220:20979269,20979676:20979706,20980311:20980379,20980858:20980864,20981321:20981362,20981988:20981993,20982201:20982256,20983052:20983113,20983803:20983810,20984411:20984418,20984700:20984784,20986044:20986054,20986474:20986484,20987003:20987015,20987472:20987516,20988119:20988184,20988613:20988617,20989064:20989073,20989548:20989586,20990317:20990348,20990909:20990948,20991546:2099158', 'assoc_mat': '20960307:Teint_Dans_La_Masse:3726:20960313,20960513:Teint_Dans_La_Masse:3726:20960527,20960900:Teint_Dans_La_Masse:3726:20960909,20961064:Teint_Dans_La_Masse:3726:20961072,20961514:Teint_Dans_La_Masse:3726:20961527,20961943:Teint_Dans_La_Masse:3726:20961947,20962435:Teint_Dans_La_Masse:3726:20962439,20962794:Teint_Dans_La_Masse:3726:20962829,20963307:Teint_Dans_La_Masse:3726:20963346,20963628:Teint_Dans_La_Masse:3726:20963687,20964476:Teint_Dans_La_Masse:3726:20964488,20965022:Teint_Dans_La_Masse:3726:20965034,20965512:Teint_Dans_La_Masse:3726:20965547,20966655:Teint_Dans_La_Masse:3726:20966671,20966718:Teint_Dans_La_Masse:3726:20966756,20967368:Teint_Dans_La_Masse:3726:20967396,20967705:Teint_Dans_La_Masse:3726:20967732,20968187:Teint_Dans_La_Masse:3726:20968198,20968779:Teint_Dans_La_Masse:3726:20968801,20969496:Teint_Dans_La_Masse:3726:20969559,20970176:Teint_Dans_La_Masse:3726:20970250,20970772:Teint_Dans_La_Masse:3726:20970826,20971287:Teint_Dans_La_Masse:3726:20971359,20971841:Teint_Dans_La_Masse:3726:2'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(1641258,1644512,1650604,1653750,1657812,1657956,1660674,1668939,1670137,1672759,1675492,1678912,1679935,1680749,1688544,1689885,1694093,1697610,1700517,1704593,1708297,1710028,1714497)); after get_hostname_from_raspi SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______JRM' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=10 and date >='2025-03-01' and date <= '2025-03-31') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((58767,),), 'unwanted_material_monthly_percentage': ((0.06551124071100697,),), 'material_repartition': (('JRM', 55671),), 'material_dict': {'JRM': 55671}, 'coverage_data': (('2025/03/31/', 0.977544), ('2025/03/29/', 0.978665), ('2025/03/28/', 0.977812), ('2025/03/27/', 0.98), ('2025/03/26/', 0.977859), ('2025/03/25/', 0.977384), ('2025/03/24/', 0.977456), ('2025/03/22/', 0.977943), ('2025/03/21/', 0.973669), ('2025/03/20/', 0.975683), ('2025/03/19/', 0.977037), ('2025/03/18/', 0.976574), ('2025/03/17/', 0.976169), ('2025/03/15/', 1.0), ('2025/03/14/', 0.980926), ('2025/03/13/', 0.97772), ('2025/03/12/', 0.977905), ('2025/03/11/', 0.977916), ('2025/03/10/', 0.975029), ('2025/03/08/', 0.980166), ('2025/03/07/', 0.976655), ('2025/03/06/', 0.975706), ('2025/03/05/', 0.975), ('2025/03/04/', 0.980636), ('2025/03/03/', 0.976652), ('2025/03/01/', 1.0)), 'impurety_average_data': ((datetime.date(2025, 3, 3), 0.08103968108821706, 3472), (datetime.date(2025, 3, 4), 0.07718484194814526, 2816), (datetime.date(2025, 3, 5), 0.0709729145785048, 4430), (datetime.date(2025, 3, 6), 0.06508696658540794, 3999), (datetime.date(2025, 3, 7), 0.08013632810736224, 1325), (datetime.date(2025, 3, 10), 0.0757641059553889, 1689), (datetime.date(2025, 3, 11), 0.06777273544278659, 5113), (datetime.date(2025, 3, 12), 0.07994660251358923, 3560), (datetime.date(2025, 3, 13), 0.08389128041395531, 2318), (datetime.date(2025, 3, 14), 0.06759224034197284, 4613), (datetime.date(2025, 3, 15), 0.06179943563868173, 151), (datetime.date(2025, 3, 17), 0.05893312707927494, 86), (datetime.date(2025, 3, 21), 0.077432507106939, 4440), (datetime.date(2025, 3, 24), 0.07415856650041627, 3415), (datetime.date(2025, 3, 25), 0.0566368246413181, 2632), (datetime.date(2025, 3, 26), 0.04236503146251317, 3967), (datetime.date(2025, 3, 27), 0.042522004146255864, 4336), (datetime.date(2025, 3, 28), 0.04479513232481298, 3300), (datetime.date(2025, 3, 29), 0.06767934843635753, 9), (datetime.date(2025, 3, 31), 0.046684644555762995, 2908)), 'impurety_average_data_per_hashtag': {'JRM': ((datetime.date(2025, 3, 3), 0.08103968108821706, 3472), (datetime.date(2025, 3, 4), 0.07718484194814526, 2816), (datetime.date(2025, 3, 5), 0.0709729145785048, 4430), (datetime.date(2025, 3, 6), 0.06508696658540794, 3999), (datetime.date(2025, 3, 7), 0.08013632810736224, 1325), (datetime.date(2025, 3, 10), 0.0757641059553889, 1689), (datetime.date(2025, 3, 11), 0.06777273544278659, 5113), (datetime.date(2025, 3, 12), 0.07994660251358923, 3560), (datetime.date(2025, 3, 13), 0.08389128041395531, 2318), (datetime.date(2025, 3, 14), 0.06759224034197284, 4613), (datetime.date(2025, 3, 15), 0.06179943563868173, 151), (datetime.date(2025, 3, 17), 0.05893312707927494, 86), (datetime.date(2025, 3, 21), 0.077432507106939, 4440), (datetime.date(2025, 3, 24), 0.07415856650041627, 3415), (datetime.date(2025, 3, 25), 0.0566368246413181, 2632), (datetime.date(2025, 3, 26), 0.04236503146251317, 3967), (datetime.date(2025, 3, 27), 0.042522004146255864, 4336), (datetime.date(2025, 3, 28), 0.04479513232481298, 3300), (datetime.date(2025, 3, 29), 0.06767934843635753, 9), (datetime.date(2025, 3, 31), 0.046684644555762995, 2908))}, 'quality_array': [['-4.990500207644674', '03032025'], ['-5.127639810533427', '04032025'], ['-5.049469766826799', '05032025'], ['-5.0035137845458415', '06032025'], ['-5.195118542836372', '07032025'], ['-5.147178350399247', '10032025'], ['-5.036360689919821', '11032025'], ['-5.180982038652899', '12032025'], ['-4.0360598456576495', '13032025'], ['-5.0303642149639165', '14032025'], ['-5.027767717848576', '15032025'], ['-5.151878734204066', '17032025'], ['-4.928089700021768', '21032025'], ['-5.014217868740197', '24032025'], ['-4.720783605187455', '25032025'], ['-4.561124232158677', '26032025'], ['-4.489502006204263', '27032025'], ['-4.7916035685741765', '28032025'], ['-5.736044492282449', '29032025'], ['-4.78890631862895', '31032025']], 'number_of_batch': ((1011,),), 'datou_id_sts': 4878, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.032005809875899925, 'nb_photo': 43415, 'list_port_cont': '20960314,20960526,20960903,20961073,20961525,20961950,20962444,20962826,20963343,20963692,20964484,20965031,20965544,20966667,20966759,20967398,20967737,20968205,20968792,20969555,20970260,20970824,20971360,20971851,20972572,20973320,20974096,20974836,20976068,20976527,20976812,20977094,20977629,20978008,20978656,20979265,20979708,20980386,20980865,20981354,20981997,20982257,20983114,20983813,20984423,20984783,20986047,20986477,20987014,20987517,20988188,20988616,20989070,20989578,20990354,20990945,20991583,20992753,20994607,21000161,21000339,21000686,21001010,21002181,21002354,21003280,21003735,21004339,21004939,21005503,21006158,21006701,21008539,21008905,21009464,21009971,21010626,21011249,21011837,21012519,21013003,21013957,21014730,21015633,21015759,21016742,21017254,21017860,21018855,21019995,21020588,21020864,21021005,21021920,21022480,21022721,21023309,21023875,21024436,21025575,21025970,21026743,21027340,21028058,21028648,21029326,21030204,21030871,21031672,21032407,21033013,21033428,21034049,2103472', 'assoc_port': '20960307:20960314,20960513:20960526,20960900:20960903,20961064:20961073,20961514:20961525,20961943:20961950,20962435:20962444,20962794:20962826,20963307:20963343,20963628:20963692,20964476:20964484,20965022:20965031,20965512:20965544,20966655:20966667,20966718:20966759,20967368:20967398,20967705:20967737,20968187:20968205,20968779:20968792,20969496:20969555,20970176:20970260,20970772:20970824,20971287:20971360,20971841:20971851,20972467:20972572,20973314:20973320,20974054:20974096,20974829:20974836,20976058:20976068,20976515:20976527,20976807:20976812,20977087:20977094,20977626:20977629,20978006:20978008,20978650:20978656,20979220:20979265,20979676:20979708,20980311:20980386,20980858:20980865,20981321:20981354,20981988:20981997,20982201:20982257,20983052:20983114,20983803:20983813,20984411:20984423,20984700:20984783,20986044:20986047,20986474:20986477,20987003:20987014,20987472:20987517,20988119:20988188,20988613:20988616,20989064:20989070,20989548:20989578,20990317:20990354,20990909:20990945,20991546:2099158', 'assoc_mat': '20960307:autre_refus:3726:20960314,20960513:autre_refus:3726:20960526,20960900:autre_refus:3726:20960903,20961064:autre_refus:3726:20961073,20961514:autre_refus:3726:20961525,20961943:autre_refus:3726:20961950,20962435:autre_refus:3726:20962444,20962794:autre_refus:3726:20962826,20963307:autre_refus:3726:20963343,20963628:autre_refus:3726:20963692,20964476:autre_refus:3726:20964484,20965022:autre_refus:3726:20965031,20965512:autre_refus:3726:20965544,20966655:autre_refus:3726:20966667,20966718:autre_refus:3726:20966759,20967368:autre_refus:3726:20967398,20967705:autre_refus:3726:20967737,20968187:autre_refus:3726:20968205,20968779:autre_refus:3726:20968792,20969496:autre_refus:3726:20969555,20970176:autre_refus:3726:20970260,20970772:autre_refus:3726:20970824,20971287:autre_refus:3726:20971360,20971841:autre_refus:3726:20971851,20972467:autre_refus:3726:20972572,20973314:autre_refus:3726:20973320,20974054:autre_refus:3726:20974096,20974829:autre_refus:3726:20974836,20976058:autre_refus:3726:20976068,20976515:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.005814099877437112, 'nb_photo': 15777, 'list_port_cont': '20960316,20960520,20960912,20961070,20961528,20961955,20962443,20962827,20963339,20963694,20964482,20965028,20965549,20966669,20966755,20967406,20967726,20968196,20968790,20969557,20970256,20970833,20971367,20971855,20972566,20973329,20974086,20974843,20976059,20976526,20976819,20977095,20977631,20978011,20978659,20979267,20979707,20980378,20980861,20981352,20981995,20982254,20983103,20983817,20984422,20984782,20986057,20986476,20987011,20987526,20988191,20988620,20989067,20989588,20990349,20990950,20991579,20992758,20994606,21000167,21000335,21000682,21001013,21002182,21002363,21003284,21003728,21004341,21004945,21005509,21006164,21006702,21008531,21008910,21009466,21009962,21010627,21011253,21011841,21012513,21013012,21013965,21014723,21015640,21015754,21016741,21017261,21017859,21018861,21020004,21020590,21020865,21021008,21021926,21022478,21022720,21023314,21023867,21024432,21025573,21025966,21026749,21027336,21028060,21028650,21029316,21030208,21030876,21031667,21032413,21033014,21033430,21034052,2103471', 'assoc_port': '20960307:20960316,20960513:20960520,20960900:20960912,20961064:20961070,20961514:20961528,20961943:20961955,20962435:20962443,20962794:20962827,20963307:20963339,20963628:20963694,20964476:20964482,20965022:20965028,20965512:20965549,20966655:20966669,20966718:20966755,20967368:20967406,20967705:20967726,20968187:20968196,20968779:20968790,20969496:20969557,20970176:20970256,20970772:20970833,20971287:20971367,20971841:20971855,20972467:20972566,20973314:20973329,20974054:20974086,20974829:20974843,20976058:20976059,20976515:20976526,20976807:20976819,20977087:20977095,20977626:20977631,20978006:20978011,20978650:20978659,20979220:20979267,20979676:20979707,20980311:20980378,20980858:20980861,20981321:20981352,20981988:20981995,20982201:20982254,20983052:20983103,20983803:20983817,20984411:20984422,20984700:20984782,20986044:20986057,20986474:20986476,20987003:20987011,20987472:20987526,20988119:20988191,20988613:20988620,20989064:20989067,20989548:20989588,20990317:20990349,20990909:20990950,20991546:2099157', 'assoc_mat': '20960307:cartonnette:3726:20960316,20960513:cartonnette:3726:20960520,20960900:cartonnette:3726:20960912,20961064:cartonnette:3726:20961070,20961514:cartonnette:3726:20961528,20961943:cartonnette:3726:20961955,20962435:cartonnette:3726:20962443,20962794:cartonnette:3726:20962827,20963307:cartonnette:3726:20963339,20963628:cartonnette:3726:20963694,20964476:cartonnette:3726:20964482,20965022:cartonnette:3726:20965028,20965512:cartonnette:3726:20965549,20966655:cartonnette:3726:20966669,20966718:cartonnette:3726:20966755,20967368:cartonnette:3726:20967406,20967705:cartonnette:3726:20967726,20968187:cartonnette:3726:20968196,20968779:cartonnette:3726:20968790,20969496:cartonnette:3726:20969557,20970176:cartonnette:3726:20970256,20970772:cartonnette:3726:20970833,20971287:cartonnette:3726:20971367,20971841:cartonnette:3726:20971855,20972467:cartonnette:3726:20972566,20973314:cartonnette:3726:20973329,20974054:cartonnette:3726:20974086,20974829:cartonnette:3726:20974843,20976058:cartonnette:3726:20976059,20976515:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.012366377022960028, 'nb_photo': 17265, 'list_port_cont': '20960317,20960523,20960906,20961069,20961523,20961957,20962442,20962824,20963341,20963688,20964487,20965030,20965551,20966663,20966757,20967404,20967736,20968199,20968795,20969551,20970258,20970829,20971365,20971853,20972573,20973322,20974093,20974840,20976070,20976523,20977099,20977632,20978015,20978662,20979266,20979712,20980385,20980866,20981353,20981991,20982260,20983104,20983808,20984425,20984790,20986051,20986482,20987017,20987527,20988187,20988619,20989077,20989585,20990347,20990947,20991576,20994605,21000166,21000341,21000687,21001009,21002180,21002355,21003285,21003734,21004346,21004944,21005508,21006163,21006706,21008540,21008915,21009470,21009963,21010632,21011255,21011833,21012515,21013007,21013961,21014731,21015634,21015751,21016740,21017257,21017858,21018859,21019998,21020580,21020873,21021006,21021921,21022719,21023306,21023865,21024441,21025582,21025972,21026746,21027337,21028062,21028644,21029322,21030199,21030877,21031666,21032416,21033020,21033431,21034051,21034719,21035127,21036234,2103665', 'assoc_port': '20960307:20960317,20960513:20960523,20960900:20960906,20961064:20961069,20961514:20961523,20961943:20961957,20962435:20962442,20962794:20962824,20963307:20963341,20963628:20963688,20964476:20964487,20965022:20965030,20965512:20965551,20966655:20966663,20966718:20966757,20967368:20967404,20967705:20967736,20968187:20968199,20968779:20968795,20969496:20969551,20970176:20970258,20970772:20970829,20971287:20971365,20971841:20971853,20972467:20972573,20973314:20973322,20974054:20974093,20974829:20974840,20976058:20976070,20976515:20976523,20977087:20977099,20977626:20977632,20978006:20978015,20978650:20978662,20979220:20979266,20979676:20979712,20980311:20980385,20980858:20980866,20981321:20981353,20981988:20981991,20982201:20982260,20983052:20983104,20983803:20983808,20984411:20984425,20984700:20984790,20986044:20986051,20986474:20986482,20987003:20987017,20987472:20987527,20988119:20988187,20988613:20988619,20989064:20989077,20989548:20989585,20990317:20990347,20990909:20990947,20991546:20991576,20994599:2099460', 'assoc_mat': '20960307:Carton_brun:3726:20960317,20960513:Carton_brun:3726:20960523,20960900:Carton_brun:3726:20960906,20961064:Carton_brun:3726:20961069,20961514:Carton_brun:3726:20961523,20961943:Carton_brun:3726:20961957,20962435:Carton_brun:3726:20962442,20962794:Carton_brun:3726:20962824,20963307:Carton_brun:3726:20963341,20963628:Carton_brun:3726:20963688,20964476:Carton_brun:3726:20964487,20965022:Carton_brun:3726:20965030,20965512:Carton_brun:3726:20965551,20966655:Carton_brun:3726:20966663,20966718:Carton_brun:3726:20966757,20967368:Carton_brun:3726:20967404,20967705:Carton_brun:3726:20967736,20968187:Carton_brun:3726:20968199,20968779:Carton_brun:3726:20968795,20969496:Carton_brun:3726:20969551,20970176:Carton_brun:3726:20970258,20970772:Carton_brun:3726:20970829,20971287:Carton_brun:3726:20971365,20971841:Carton_brun:3726:20971853,20972467:Carton_brun:3726:20972573,20973314:Carton_brun:3726:20973322,20974054:Carton_brun:3726:20974093,20974829:Carton_brun:3726:20974840,20976058:Carton_brun:3726:20976070,20976515:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.008737595416789699, 'nb_photo': 17567, 'list_port_cont': '20960311,20960525,20960907,20961074,20961520,20961953,20962441,20962833,20963345,20963695,20964486,20965036,20965545,20966661,20966754,20967402,20967735,20968204,20968800,20969556,20970257,20970827,20971362,20971857,20972565,20973327,20974088,20974842,20976062,20976521,20976816,20977098,20977636,20978014,20978663,20979259,20979704,20980382,20980870,20981361,20981996,20982261,20983106,20983814,20984414,20984785,20986058,20986480,20987008,20987525,20988186,20988623,20989074,20989583,20990352,20990942,20991581,21000159,21000346,21000678,21001007,21002178,21002352,21003279,21003727,21004342,21004941,21005500,21006157,21006704,21008530,21008911,21009465,21009970,21010629,21011256,21011836,21012514,21013011,21013964,21014721,21015641,21015758,21016733,21017253,21017857,21018856,21020003,21020585,21020867,21020997,21021922,21022473,21022722,21023308,21023864,21024437,21025581,21025967,21026751,21027342,21028059,21028645,21029323,21030203,21030880,21031676,21032409,21033012,21033432,21034054,21034724,21035130,2103623', 'assoc_port': '20960307:20960311,20960513:20960525,20960900:20960907,20961064:20961074,20961514:20961520,20961943:20961953,20962435:20962441,20962794:20962833,20963307:20963345,20963628:20963695,20964476:20964486,20965022:20965036,20965512:20965545,20966655:20966661,20966718:20966754,20967368:20967402,20967705:20967735,20968187:20968204,20968779:20968800,20969496:20969556,20970176:20970257,20970772:20970827,20971287:20971362,20971841:20971857,20972467:20972565,20973314:20973327,20974054:20974088,20974829:20974842,20976058:20976062,20976515:20976521,20976807:20976816,20977087:20977098,20977626:20977636,20978006:20978014,20978650:20978663,20979220:20979259,20979676:20979704,20980311:20980382,20980858:20980870,20981321:20981361,20981988:20981996,20982201:20982261,20983052:20983106,20983803:20983814,20984411:20984414,20984700:20984785,20986044:20986058,20986474:20986480,20987003:20987008,20987472:20987525,20988119:20988186,20988613:20988623,20989064:20989074,20989548:20989583,20990317:20990352,20990909:20990942,20991546:2099158', 'assoc_mat': '20960307:Carton_gris:3726:20960311,20960513:Carton_gris:3726:20960525,20960900:Carton_gris:3726:20960907,20961064:Carton_gris:3726:20961074,20961514:Carton_gris:3726:20961520,20961943:Carton_gris:3726:20961953,20962435:Carton_gris:3726:20962441,20962794:Carton_gris:3726:20962833,20963307:Carton_gris:3726:20963345,20963628:Carton_gris:3726:20963695,20964476:Carton_gris:3726:20964486,20965022:Carton_gris:3726:20965036,20965512:Carton_gris:3726:20965545,20966655:Carton_gris:3726:20966661,20966718:Carton_gris:3726:20966754,20967368:Carton_gris:3726:20967402,20967705:Carton_gris:3726:20967735,20968187:Carton_gris:3726:20968204,20968779:Carton_gris:3726:20968800,20969496:Carton_gris:3726:20969556,20970176:Carton_gris:3726:20970257,20970772:Carton_gris:3726:20970827,20971287:Carton_gris:3726:20971362,20971841:Carton_gris:3726:20971857,20972467:Carton_gris:3726:20972565,20973314:Carton_gris:3726:20973327,20974054:Carton_gris:3726:20974088,20974829:Carton_gris:3726:20974842,20976058:Carton_gris:3726:20976062,20976515:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0017644184725354906, 'nb_photo': 2831, 'list_port_cont': '20960321,20961071,20961521,20961954,20962447,20962835,20963338,20963690,20964491,20965029,20965546,20966753,20968799,20969560,20970261,20970831,20971364,20971856,20972569,20973325,20974085,20976529,20976813,20977090,20977640,20978019,20979268,20979714,20980871,20981351,20982002,20982252,20983108,20984415,20984781,20986056,20986486,20987519,20988182,20988622,20989078,20990343,20990943,20991584,21000342,21000689,21001008,21002184,21003731,21004350,21004940,21006159,21006703,21008529,21008907,21009475,21009967,21010634,21011835,21012512,21013006,21013958,21014727,21015637,21015762,21017258,21017865,21018857,21020001,21022714,21023303,21023871,21025973,21027345,21028061,21028651,21029325,21030210,21031670,21032406,21033010,21033437,21034047,21034720,21035125,21036661,21037201,21037747,21038159,21038960,21039854,21040538,21042335,21042742,21044132,21044564,21045295,21045942,21046575,21047123,21047842,21049550,21050214,21051289,21051457,21052371,21054990,21056061,21056610,21057142,21058611,21060584,21061242,2106184', 'assoc_port': '20960307:20960321,20961064:20961071,20961514:20961521,20961943:20961954,20962435:20962447,20962794:20962835,20963307:20963338,20963628:20963690,20964476:20964491,20965022:20965029,20965512:20965546,20966718:20966753,20968779:20968799,20969496:20969560,20970176:20970261,20970772:20970831,20971287:20971364,20971841:20971856,20972467:20972569,20973314:20973325,20974054:20974085,20976515:20976529,20976807:20976813,20977087:20977090,20977626:20977640,20978006:20978019,20979220:20979268,20979676:20979714,20980858:20980871,20981321:20981351,20981988:20982002,20982201:20982252,20983052:20983108,20984411:20984415,20984700:20984781,20986044:20986056,20986474:20986486,20987472:20987519,20988119:20988182,20988613:20988622,20989064:20989078,20990317:20990343,20990909:20990943,20991546:20991584,21000334:21000342,21000676:21000689,21001000:21001008,21002132:21002184,21003724:21003731,21004334:21004350,21004910:21004940,21006128:21006159,21006668:21006703,21008527:21008529,21008886:21008907,21009461:21009475,21009958:2100996', 'assoc_mat': '20960307:kraft:3726:20960321,20961064:kraft:3726:20961071,20961514:kraft:3726:20961521,20961943:kraft:3726:20961954,20962435:kraft:3726:20962447,20962794:kraft:3726:20962835,20963307:kraft:3726:20963338,20963628:kraft:3726:20963690,20964476:kraft:3726:20964491,20965022:kraft:3726:20965029,20965512:kraft:3726:20965546,20966718:kraft:3726:20966753,20968779:kraft:3726:20968799,20969496:kraft:3726:20969560,20970176:kraft:3726:20970261,20970772:kraft:3726:20970831,20971287:kraft:3726:20971364,20971841:kraft:3726:20971856,20972467:kraft:3726:20972569,20973314:kraft:3726:20973325,20974054:kraft:3726:20974085,20976515:kraft:3726:20976529,20976807:kraft:3726:20976813,20977087:kraft:3726:20977090,20977626:kraft:3726:20977640,20978006:kraft:3726:20978019,20979220:kraft:3726:20979268,20979676:kraft:3726:20979714,20980858:kraft:3726:20980871,20981321:kraft:3726:20981351,20981988:kraft:3726:20982002,20982201:kraft:3726:20982252,20983052:kraft:3726:20983108,20984411:kraft:3726:20984415,20984700:kraft:3726:20984781,20986044:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0005556362152610759, 'nb_photo': 671, 'list_port_cont': '20962825,20963344,20963684,20964489,20965541,20966752,20968200,20968796,20970254,20970825,20971363,20972571,20974087,20974844,20976061,20978013,20978661,20979710,20981360,20982259,20983109,20983809,20984416,20984786,20986485,20987010,20989582,21000162,21001012,21003277,21003733,21004343,21005505,21009474,21010636,21013956,21014726,21017260,21019997,21020863,21022474,21023872,21026740,21027338,21028065,21028640,21030209,21030878,21031669,21033429,21034050,21035129,21036653,21037200,21037742,21038158,21038962,21040534,21042748,21043140,21044565,21045290,21047121,21047844,21048700,21051450,21052362,21059630,21067430,21068865,21069476,21070741,21072057,21075482,21078019,21078694,21079398,21080965,21081726,21085776,21088252,21089231,21089852,21090393,21092982,21093328,21095287,21096727,21098113,21100028,21104333,21104724,21106674,21108367,21111890,21118105,21125087,21126085,21127191,21133341,21133365,21133490,21133520,21144781,21145010,21145725,21146464,21151519,21152732,21153287,21154262,21155600,21156367,2122274', 'assoc_port': '20962794:20962825,20963307:20963344,20963628:20963684,20964476:20964489,20965512:20965541,20966718:20966752,20968187:20968200,20968779:20968796,20970176:20970254,20970772:20970825,20971287:20971363,20972467:20972571,20974054:20974087,20974829:20974844,20976058:20976061,20978006:20978013,20978650:20978661,20979676:20979710,20981321:20981360,20982201:20982259,20983052:20983109,20983803:20983809,20984411:20984416,20984700:20984786,20986474:20986485,20987003:20987010,20989548:20989582,21000153:21000162,21001000:21001012,21003272:21003277,21003724:21003733,21004334:21004343,21005496:21005505,21009461:21009474,21010580:21010636,21013935:21013956,21014715:21014726,21017247:21017260,21019955:21019997,21020862:21020863,21022471:21022474,21023862:21023872,21026737:21026740,21027310:21027338,21028005:21028065,21028610:21028640,21030129:21030209,21030842:21030878,21031610:21031669,21033425:21033429,21033980:21034050,21035092:21035129,21036613:21036653,21037191:21037200,21037712:21037742,21038145:21038158,21038910:2103896', 'assoc_mat': '20962794:metal:3726:20962825,20963307:metal:3726:20963344,20963628:metal:3726:20963684,20964476:metal:3726:20964489,20965512:metal:3726:20965541,20966718:metal:3726:20966752,20968187:metal:3726:20968200,20968779:metal:3726:20968796,20970176:metal:3726:20970254,20970772:metal:3726:20970825,20971287:metal:3726:20971363,20972467:metal:3726:20972571,20974054:metal:3726:20974087,20974829:metal:3726:20974844,20976058:metal:3726:20976061,20978006:metal:3726:20978013,20978650:metal:3726:20978661,20979676:metal:3726:20979710,20981321:metal:3726:20981360,20982201:metal:3726:20982259,20983052:metal:3726:20983109,20983803:metal:3726:20983809,20984411:metal:3726:20984416,20984700:metal:3726:20984786,20986474:metal:3726:20986485,20987003:metal:3726:20987010,20989548:metal:3726:20989582,21000153:metal:3726:21000162,21001000:metal:3726:21001012,21003272:metal:3726:21003277,21003724:metal:3726:21003733,21004334:metal:3726:21004343,21005496:metal:3726:21005505,21009461:metal:3726:21009474,21010580:metal:3726:21010636,21013935:'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004497159495204218, 'nb_photo': 10913, 'list_port_cont': '20960320,20960521,20960902,20961077,20961524,20961952,20962446,20962834,20963340,20963691,20964492,20965033,20965552,20966662,20966758,20967397,20967734,20968197,20968798,20969558,20970259,20970830,20971358,20971859,20972564,20973321,20974090,20974834,20976066,20976814,20977096,20977637,20978017,20978655,20979263,20979713,20980384,20980868,20981359,20981999,20982255,20983107,20983812,20984420,20984779,20986052,20986483,20987013,20987523,20988183,20988626,20989068,20989584,20990353,20990944,20991577,20992757,20994604,21000164,21000685,21001006,21002177,21002361,21003278,21003730,21004340,21004949,21005506,21006161,21006708,21008532,21008913,21009468,21009966,21010631,21011247,21011843,21012520,21013002,21013959,21014728,21015639,21015753,21016739,21017256,21017862,21018860,21019993,21020874,21020999,21021918,21022723,21023312,21023869,21024440,21025578,21025965,21026750,21027343,21028069,21028643,21029320,21030205,21030882,21031673,21032415,21033011,21033438,21034053,21034715,21035128,21036230,21036656,2103719', 'assoc_port': '20960307:20960320,20960513:20960521,20960900:20960902,20961064:20961077,20961514:20961524,20961943:20961952,20962435:20962446,20962794:20962834,20963307:20963340,20963628:20963691,20964476:20964492,20965022:20965033,20965512:20965552,20966655:20966662,20966718:20966758,20967368:20967397,20967705:20967734,20968187:20968197,20968779:20968798,20969496:20969558,20970176:20970259,20970772:20970830,20971287:20971358,20971841:20971859,20972467:20972564,20973314:20973321,20974054:20974090,20974829:20974834,20976058:20976066,20976807:20976814,20977087:20977096,20977626:20977637,20978006:20978017,20978650:20978655,20979220:20979263,20979676:20979713,20980311:20980384,20980858:20980868,20981321:20981359,20981988:20981999,20982201:20982255,20983052:20983107,20983803:20983812,20984411:20984420,20984700:20984779,20986044:20986052,20986474:20986483,20987003:20987013,20987472:20987523,20988119:20988183,20988613:20988626,20989064:20989068,20989548:20989584,20990317:20990353,20990909:20990944,20991546:20991577,20992705:2099275', 'assoc_mat': '20960307:plastique:3726:20960320,20960513:plastique:3726:20960521,20960900:plastique:3726:20960902,20961064:plastique:3726:20961077,20961514:plastique:3726:20961524,20961943:plastique:3726:20961952,20962435:plastique:3726:20962446,20962794:plastique:3726:20962834,20963307:plastique:3726:20963340,20963628:plastique:3726:20963691,20964476:plastique:3726:20964492,20965022:plastique:3726:20965033,20965512:plastique:3726:20965552,20966655:plastique:3726:20966662,20966718:plastique:3726:20966758,20967368:plastique:3726:20967397,20967705:plastique:3726:20967734,20968187:plastique:3726:20968197,20968779:plastique:3726:20968798,20969496:plastique:3726:20969558,20970176:plastique:3726:20970259,20970772:plastique:3726:20970830,20971287:plastique:3726:20971358,20971841:plastique:3726:20971859,20972467:plastique:3726:20972564,20973314:plastique:3726:20973321,20974054:plastique:3726:20974090,20974829:plastique:3726:20974834,20976058:plastique:3726:20976066,20976807:plastique:3726:20976814,20977087:plastique:3726:20977096,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.01114949068130545, 'nb_photo': 25337, 'list_port_cont': '20960313,20960527,20960909,20961072,20961527,20961947,20962439,20962829,20963346,20963687,20964488,20965034,20965547,20966671,20966756,20967396,20967732,20968198,20968801,20969559,20970250,20970826,20971359,20971852,20972574,20973323,20974092,20974837,20976069,20976524,20976820,20977100,20977638,20978012,20978660,20979269,20979706,20980379,20980864,20981362,20981993,20982256,20983113,20983810,20984418,20984784,20986054,20986484,20987015,20987516,20988184,20988617,20989073,20989586,20990348,20990948,20991582,20994600,21000157,21000345,21000681,21001004,21002174,21002357,21003283,21003729,21004345,21004947,21005501,21006160,21006700,21008534,21008914,21009467,21009968,21010628,21011250,21011842,21012523,21013008,21013966,21014729,21015642,21015761,21016738,21017252,21017868,21018852,21020000,21020587,21020866,21020998,21021924,21022484,21022717,21023304,21023873,21024435,21025576,21025975,21026744,21027339,21028067,21028646,21029315,21030201,21030872,21031665,21032417,21033016,21033434,21034044,21034716,2103512', 'assoc_port': '20960307:20960313,20960513:20960527,20960900:20960909,20961064:20961072,20961514:20961527,20961943:20961947,20962435:20962439,20962794:20962829,20963307:20963346,20963628:20963687,20964476:20964488,20965022:20965034,20965512:20965547,20966655:20966671,20966718:20966756,20967368:20967396,20967705:20967732,20968187:20968198,20968779:20968801,20969496:20969559,20970176:20970250,20970772:20970826,20971287:20971359,20971841:20971852,20972467:20972574,20973314:20973323,20974054:20974092,20974829:20974837,20976058:20976069,20976515:20976524,20976807:20976820,20977087:20977100,20977626:20977638,20978006:20978012,20978650:20978660,20979220:20979269,20979676:20979706,20980311:20980379,20980858:20980864,20981321:20981362,20981988:20981993,20982201:20982256,20983052:20983113,20983803:20983810,20984411:20984418,20984700:20984784,20986044:20986054,20986474:20986484,20987003:20987015,20987472:20987516,20988119:20988184,20988613:20988617,20989064:20989073,20989548:20989586,20990317:20990348,20990909:20990948,20991546:2099158', 'assoc_mat': '20960307:Teint_Dans_La_Masse:3726:20960313,20960513:Teint_Dans_La_Masse:3726:20960527,20960900:Teint_Dans_La_Masse:3726:20960909,20961064:Teint_Dans_La_Masse:3726:20961072,20961514:Teint_Dans_La_Masse:3726:20961527,20961943:Teint_Dans_La_Masse:3726:20961947,20962435:Teint_Dans_La_Masse:3726:20962439,20962794:Teint_Dans_La_Masse:3726:20962829,20963307:Teint_Dans_La_Masse:3726:20963346,20963628:Teint_Dans_La_Masse:3726:20963687,20964476:Teint_Dans_La_Masse:3726:20964488,20965022:Teint_Dans_La_Masse:3726:20965034,20965512:Teint_Dans_La_Masse:3726:20965547,20966655:Teint_Dans_La_Masse:3726:20966671,20966718:Teint_Dans_La_Masse:3726:20966756,20967368:Teint_Dans_La_Masse:3726:20967396,20967705:Teint_Dans_La_Masse:3726:20967732,20968187:Teint_Dans_La_Masse:3726:20968198,20968779:Teint_Dans_La_Masse:3726:20968801,20969496:Teint_Dans_La_Masse:3726:20969559,20970176:Teint_Dans_La_Masse:3726:20970250,20970772:Teint_Dans_La_Masse:3726:20970826,20971287:Teint_Dans_La_Masse:3726:20971359,20971841:Teint_Dans_La_Masse:3726:2'}), 'main_stat': {'nb_photos': 58767}}, 'hostname': (('jetson-73',),), 'impurety_average_per_hashtag': [(('JRM', '2025-03', 0.06551124071100697),)]} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4873 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4873 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4873 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4873 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4878 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4878 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4878 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4878 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4302 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4302 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4302 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((58767,),), 'unwanted_material_monthly_percentage': ((0.06551124071100697,),), 'material_repartition': (('JRM', 55671),), 'material_dict': {'JRM': 55671}, 'coverage_data': (('2025/03/31/', 0.977544), ('2025/03/29/', 0.978665), ('2025/03/28/', 0.977812), ('2025/03/27/', 0.98), ('2025/03/26/', 0.977859), ('2025/03/25/', 0.977384), ('2025/03/24/', 0.977456), ('2025/03/22/', 0.977943), ('2025/03/21/', 0.973669), ('2025/03/20/', 0.975683), ('2025/03/19/', 0.977037), ('2025/03/18/', 0.976574), ('2025/03/17/', 0.976169), ('2025/03/15/', 1.0), ('2025/03/14/', 0.980926), ('2025/03/13/', 0.97772), ('2025/03/12/', 0.977905), ('2025/03/11/', 0.977916), ('2025/03/10/', 0.975029), ('2025/03/08/', 0.980166), ('2025/03/07/', 0.976655), ('2025/03/06/', 0.975706), ('2025/03/05/', 0.975), ('2025/03/04/', 0.980636), ('2025/03/03/', 0.976652), ('2025/03/01/', 1.0)), 'impurety_average_data': ((datetime.date(2025, 3, 3), 0.08103968108821706, 3472), (datetime.date(2025, 3, 4), 0.07718484194814526, 2816), (datetime.date(2025, 3, 5), 0.0709729145785048, 4430), (datetime.date(2025, 3, 6), 0.06508696658540794, 3999), (datetime.date(2025, 3, 7), 0.08013632810736224, 1325), (datetime.date(2025, 3, 10), 0.0757641059553889, 1689), (datetime.date(2025, 3, 11), 0.06777273544278659, 5113), (datetime.date(2025, 3, 12), 0.07994660251358923, 3560), (datetime.date(2025, 3, 13), 0.08389128041395531, 2318), (datetime.date(2025, 3, 14), 0.06759224034197284, 4613), (datetime.date(2025, 3, 15), 0.06179943563868173, 151), (datetime.date(2025, 3, 17), 0.05893312707927494, 86), (datetime.date(2025, 3, 21), 0.077432507106939, 4440), (datetime.date(2025, 3, 24), 0.07415856650041627, 3415), (datetime.date(2025, 3, 25), 0.0566368246413181, 2632), (datetime.date(2025, 3, 26), 0.04236503146251317, 3967), (datetime.date(2025, 3, 27), 0.042522004146255864, 4336), (datetime.date(2025, 3, 28), 0.04479513232481298, 3300), (datetime.date(2025, 3, 29), 0.06767934843635753, 9), (datetime.date(2025, 3, 31), 0.046684644555762995, 2908)), 'impurety_average_data_per_hashtag': {'JRM': ((datetime.date(2025, 3, 3), 0.08103968108821706, 3472), (datetime.date(2025, 3, 4), 0.07718484194814526, 2816), (datetime.date(2025, 3, 5), 0.0709729145785048, 4430), (datetime.date(2025, 3, 6), 0.06508696658540794, 3999), (datetime.date(2025, 3, 7), 0.08013632810736224, 1325), (datetime.date(2025, 3, 10), 0.0757641059553889, 1689), (datetime.date(2025, 3, 11), 0.06777273544278659, 5113), (datetime.date(2025, 3, 12), 0.07994660251358923, 3560), (datetime.date(2025, 3, 13), 0.08389128041395531, 2318), (datetime.date(2025, 3, 14), 0.06759224034197284, 4613), (datetime.date(2025, 3, 15), 0.06179943563868173, 151), (datetime.date(2025, 3, 17), 0.05893312707927494, 86), (datetime.date(2025, 3, 21), 0.077432507106939, 4440), (datetime.date(2025, 3, 24), 0.07415856650041627, 3415), (datetime.date(2025, 3, 25), 0.0566368246413181, 2632), (datetime.date(2025, 3, 26), 0.04236503146251317, 3967), (datetime.date(2025, 3, 27), 0.042522004146255864, 4336), (datetime.date(2025, 3, 28), 0.04479513232481298, 3300), (datetime.date(2025, 3, 29), 0.06767934843635753, 9), (datetime.date(2025, 3, 31), 0.046684644555762995, 2908))}, 'quality_array': [['-4.990500207644674', '03032025'], ['-5.127639810533427', '04032025'], ['-5.049469766826799', '05032025'], ['-5.0035137845458415', '06032025'], ['-5.195118542836372', '07032025'], ['-5.147178350399247', '10032025'], ['-5.036360689919821', '11032025'], ['-5.180982038652899', '12032025'], ['-4.0360598456576495', '13032025'], ['-5.0303642149639165', '14032025'], ['-5.027767717848576', '15032025'], ['-5.151878734204066', '17032025'], ['-4.928089700021768', '21032025'], ['-5.014217868740197', '24032025'], ['-4.720783605187455', '25032025'], ['-4.561124232158677', '26032025'], ['-4.489502006204263', '27032025'], ['-4.7916035685741765', '28032025'], ['-5.736044492282449', '29032025'], ['-4.78890631862895', '31032025']], 'number_of_batch': ((1011,),), 'datou_id_sts': 4878, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.032005809875899925, 'nb_photo': 43415, 'list_port_cont': '20960314,20960526,20960903,20961073,20961525,20961950,20962444,20962826,20963343,20963692,20964484,20965031,20965544,20966667,20966759,20967398,20967737,20968205,20968792,20969555,20970260,20970824,20971360,20971851,20972572,20973320,20974096,20974836,20976068,20976527,20976812,20977094,20977629,20978008,20978656,20979265,20979708,20980386,20980865,20981354,20981997,20982257,20983114,20983813,20984423,20984783,20986047,20986477,20987014,20987517,20988188,20988616,20989070,20989578,20990354,20990945,20991583,20992753,20994607,21000161,21000339,21000686,21001010,21002181,21002354,21003280,21003735,21004339,21004939,21005503,21006158,21006701,21008539,21008905,21009464,21009971,21010626,21011249,21011837,21012519,21013003,21013957,21014730,21015633,21015759,21016742,21017254,21017860,21018855,21019995,21020588,21020864,21021005,21021920,21022480,21022721,21023309,21023875,21024436,21025575,21025970,21026743,21027340,21028058,21028648,21029326,21030204,21030871,21031672,21032407,21033013,21033428,21034049,2103472', 'assoc_port': '20960307:20960314,20960513:20960526,20960900:20960903,20961064:20961073,20961514:20961525,20961943:20961950,20962435:20962444,20962794:20962826,20963307:20963343,20963628:20963692,20964476:20964484,20965022:20965031,20965512:20965544,20966655:20966667,20966718:20966759,20967368:20967398,20967705:20967737,20968187:20968205,20968779:20968792,20969496:20969555,20970176:20970260,20970772:20970824,20971287:20971360,20971841:20971851,20972467:20972572,20973314:20973320,20974054:20974096,20974829:20974836,20976058:20976068,20976515:20976527,20976807:20976812,20977087:20977094,20977626:20977629,20978006:20978008,20978650:20978656,20979220:20979265,20979676:20979708,20980311:20980386,20980858:20980865,20981321:20981354,20981988:20981997,20982201:20982257,20983052:20983114,20983803:20983813,20984411:20984423,20984700:20984783,20986044:20986047,20986474:20986477,20987003:20987014,20987472:20987517,20988119:20988188,20988613:20988616,20989064:20989070,20989548:20989578,20990317:20990354,20990909:20990945,20991546:2099158', 'assoc_mat': '20960307:autre_refus:3726:20960314,20960513:autre_refus:3726:20960526,20960900:autre_refus:3726:20960903,20961064:autre_refus:3726:20961073,20961514:autre_refus:3726:20961525,20961943:autre_refus:3726:20961950,20962435:autre_refus:3726:20962444,20962794:autre_refus:3726:20962826,20963307:autre_refus:3726:20963343,20963628:autre_refus:3726:20963692,20964476:autre_refus:3726:20964484,20965022:autre_refus:3726:20965031,20965512:autre_refus:3726:20965544,20966655:autre_refus:3726:20966667,20966718:autre_refus:3726:20966759,20967368:autre_refus:3726:20967398,20967705:autre_refus:3726:20967737,20968187:autre_refus:3726:20968205,20968779:autre_refus:3726:20968792,20969496:autre_refus:3726:20969555,20970176:autre_refus:3726:20970260,20970772:autre_refus:3726:20970824,20971287:autre_refus:3726:20971360,20971841:autre_refus:3726:20971851,20972467:autre_refus:3726:20972572,20973314:autre_refus:3726:20973320,20974054:autre_refus:3726:20974096,20974829:autre_refus:3726:20974836,20976058:autre_refus:3726:20976068,20976515:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.005814099877437112, 'nb_photo': 15777, 'list_port_cont': '20960316,20960520,20960912,20961070,20961528,20961955,20962443,20962827,20963339,20963694,20964482,20965028,20965549,20966669,20966755,20967406,20967726,20968196,20968790,20969557,20970256,20970833,20971367,20971855,20972566,20973329,20974086,20974843,20976059,20976526,20976819,20977095,20977631,20978011,20978659,20979267,20979707,20980378,20980861,20981352,20981995,20982254,20983103,20983817,20984422,20984782,20986057,20986476,20987011,20987526,20988191,20988620,20989067,20989588,20990349,20990950,20991579,20992758,20994606,21000167,21000335,21000682,21001013,21002182,21002363,21003284,21003728,21004341,21004945,21005509,21006164,21006702,21008531,21008910,21009466,21009962,21010627,21011253,21011841,21012513,21013012,21013965,21014723,21015640,21015754,21016741,21017261,21017859,21018861,21020004,21020590,21020865,21021008,21021926,21022478,21022720,21023314,21023867,21024432,21025573,21025966,21026749,21027336,21028060,21028650,21029316,21030208,21030876,21031667,21032413,21033014,21033430,21034052,2103471', 'assoc_port': '20960307:20960316,20960513:20960520,20960900:20960912,20961064:20961070,20961514:20961528,20961943:20961955,20962435:20962443,20962794:20962827,20963307:20963339,20963628:20963694,20964476:20964482,20965022:20965028,20965512:20965549,20966655:20966669,20966718:20966755,20967368:20967406,20967705:20967726,20968187:20968196,20968779:20968790,20969496:20969557,20970176:20970256,20970772:20970833,20971287:20971367,20971841:20971855,20972467:20972566,20973314:20973329,20974054:20974086,20974829:20974843,20976058:20976059,20976515:20976526,20976807:20976819,20977087:20977095,20977626:20977631,20978006:20978011,20978650:20978659,20979220:20979267,20979676:20979707,20980311:20980378,20980858:20980861,20981321:20981352,20981988:20981995,20982201:20982254,20983052:20983103,20983803:20983817,20984411:20984422,20984700:20984782,20986044:20986057,20986474:20986476,20987003:20987011,20987472:20987526,20988119:20988191,20988613:20988620,20989064:20989067,20989548:20989588,20990317:20990349,20990909:20990950,20991546:2099157', 'assoc_mat': '20960307:cartonnette:3726:20960316,20960513:cartonnette:3726:20960520,20960900:cartonnette:3726:20960912,20961064:cartonnette:3726:20961070,20961514:cartonnette:3726:20961528,20961943:cartonnette:3726:20961955,20962435:cartonnette:3726:20962443,20962794:cartonnette:3726:20962827,20963307:cartonnette:3726:20963339,20963628:cartonnette:3726:20963694,20964476:cartonnette:3726:20964482,20965022:cartonnette:3726:20965028,20965512:cartonnette:3726:20965549,20966655:cartonnette:3726:20966669,20966718:cartonnette:3726:20966755,20967368:cartonnette:3726:20967406,20967705:cartonnette:3726:20967726,20968187:cartonnette:3726:20968196,20968779:cartonnette:3726:20968790,20969496:cartonnette:3726:20969557,20970176:cartonnette:3726:20970256,20970772:cartonnette:3726:20970833,20971287:cartonnette:3726:20971367,20971841:cartonnette:3726:20971855,20972467:cartonnette:3726:20972566,20973314:cartonnette:3726:20973329,20974054:cartonnette:3726:20974086,20974829:cartonnette:3726:20974843,20976058:cartonnette:3726:20976059,20976515:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.012366377022960028, 'nb_photo': 17265, 'list_port_cont': '20960317,20960523,20960906,20961069,20961523,20961957,20962442,20962824,20963341,20963688,20964487,20965030,20965551,20966663,20966757,20967404,20967736,20968199,20968795,20969551,20970258,20970829,20971365,20971853,20972573,20973322,20974093,20974840,20976070,20976523,20977099,20977632,20978015,20978662,20979266,20979712,20980385,20980866,20981353,20981991,20982260,20983104,20983808,20984425,20984790,20986051,20986482,20987017,20987527,20988187,20988619,20989077,20989585,20990347,20990947,20991576,20994605,21000166,21000341,21000687,21001009,21002180,21002355,21003285,21003734,21004346,21004944,21005508,21006163,21006706,21008540,21008915,21009470,21009963,21010632,21011255,21011833,21012515,21013007,21013961,21014731,21015634,21015751,21016740,21017257,21017858,21018859,21019998,21020580,21020873,21021006,21021921,21022719,21023306,21023865,21024441,21025582,21025972,21026746,21027337,21028062,21028644,21029322,21030199,21030877,21031666,21032416,21033020,21033431,21034051,21034719,21035127,21036234,2103665', 'assoc_port': '20960307:20960317,20960513:20960523,20960900:20960906,20961064:20961069,20961514:20961523,20961943:20961957,20962435:20962442,20962794:20962824,20963307:20963341,20963628:20963688,20964476:20964487,20965022:20965030,20965512:20965551,20966655:20966663,20966718:20966757,20967368:20967404,20967705:20967736,20968187:20968199,20968779:20968795,20969496:20969551,20970176:20970258,20970772:20970829,20971287:20971365,20971841:20971853,20972467:20972573,20973314:20973322,20974054:20974093,20974829:20974840,20976058:20976070,20976515:20976523,20977087:20977099,20977626:20977632,20978006:20978015,20978650:20978662,20979220:20979266,20979676:20979712,20980311:20980385,20980858:20980866,20981321:20981353,20981988:20981991,20982201:20982260,20983052:20983104,20983803:20983808,20984411:20984425,20984700:20984790,20986044:20986051,20986474:20986482,20987003:20987017,20987472:20987527,20988119:20988187,20988613:20988619,20989064:20989077,20989548:20989585,20990317:20990347,20990909:20990947,20991546:20991576,20994599:2099460', 'assoc_mat': '20960307:Carton_brun:3726:20960317,20960513:Carton_brun:3726:20960523,20960900:Carton_brun:3726:20960906,20961064:Carton_brun:3726:20961069,20961514:Carton_brun:3726:20961523,20961943:Carton_brun:3726:20961957,20962435:Carton_brun:3726:20962442,20962794:Carton_brun:3726:20962824,20963307:Carton_brun:3726:20963341,20963628:Carton_brun:3726:20963688,20964476:Carton_brun:3726:20964487,20965022:Carton_brun:3726:20965030,20965512:Carton_brun:3726:20965551,20966655:Carton_brun:3726:20966663,20966718:Carton_brun:3726:20966757,20967368:Carton_brun:3726:20967404,20967705:Carton_brun:3726:20967736,20968187:Carton_brun:3726:20968199,20968779:Carton_brun:3726:20968795,20969496:Carton_brun:3726:20969551,20970176:Carton_brun:3726:20970258,20970772:Carton_brun:3726:20970829,20971287:Carton_brun:3726:20971365,20971841:Carton_brun:3726:20971853,20972467:Carton_brun:3726:20972573,20973314:Carton_brun:3726:20973322,20974054:Carton_brun:3726:20974093,20974829:Carton_brun:3726:20974840,20976058:Carton_brun:3726:20976070,20976515:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.008737595416789699, 'nb_photo': 17567, 'list_port_cont': '20960311,20960525,20960907,20961074,20961520,20961953,20962441,20962833,20963345,20963695,20964486,20965036,20965545,20966661,20966754,20967402,20967735,20968204,20968800,20969556,20970257,20970827,20971362,20971857,20972565,20973327,20974088,20974842,20976062,20976521,20976816,20977098,20977636,20978014,20978663,20979259,20979704,20980382,20980870,20981361,20981996,20982261,20983106,20983814,20984414,20984785,20986058,20986480,20987008,20987525,20988186,20988623,20989074,20989583,20990352,20990942,20991581,21000159,21000346,21000678,21001007,21002178,21002352,21003279,21003727,21004342,21004941,21005500,21006157,21006704,21008530,21008911,21009465,21009970,21010629,21011256,21011836,21012514,21013011,21013964,21014721,21015641,21015758,21016733,21017253,21017857,21018856,21020003,21020585,21020867,21020997,21021922,21022473,21022722,21023308,21023864,21024437,21025581,21025967,21026751,21027342,21028059,21028645,21029323,21030203,21030880,21031676,21032409,21033012,21033432,21034054,21034724,21035130,2103623', 'assoc_port': '20960307:20960311,20960513:20960525,20960900:20960907,20961064:20961074,20961514:20961520,20961943:20961953,20962435:20962441,20962794:20962833,20963307:20963345,20963628:20963695,20964476:20964486,20965022:20965036,20965512:20965545,20966655:20966661,20966718:20966754,20967368:20967402,20967705:20967735,20968187:20968204,20968779:20968800,20969496:20969556,20970176:20970257,20970772:20970827,20971287:20971362,20971841:20971857,20972467:20972565,20973314:20973327,20974054:20974088,20974829:20974842,20976058:20976062,20976515:20976521,20976807:20976816,20977087:20977098,20977626:20977636,20978006:20978014,20978650:20978663,20979220:20979259,20979676:20979704,20980311:20980382,20980858:20980870,20981321:20981361,20981988:20981996,20982201:20982261,20983052:20983106,20983803:20983814,20984411:20984414,20984700:20984785,20986044:20986058,20986474:20986480,20987003:20987008,20987472:20987525,20988119:20988186,20988613:20988623,20989064:20989074,20989548:20989583,20990317:20990352,20990909:20990942,20991546:2099158', 'assoc_mat': '20960307:Carton_gris:3726:20960311,20960513:Carton_gris:3726:20960525,20960900:Carton_gris:3726:20960907,20961064:Carton_gris:3726:20961074,20961514:Carton_gris:3726:20961520,20961943:Carton_gris:3726:20961953,20962435:Carton_gris:3726:20962441,20962794:Carton_gris:3726:20962833,20963307:Carton_gris:3726:20963345,20963628:Carton_gris:3726:20963695,20964476:Carton_gris:3726:20964486,20965022:Carton_gris:3726:20965036,20965512:Carton_gris:3726:20965545,20966655:Carton_gris:3726:20966661,20966718:Carton_gris:3726:20966754,20967368:Carton_gris:3726:20967402,20967705:Carton_gris:3726:20967735,20968187:Carton_gris:3726:20968204,20968779:Carton_gris:3726:20968800,20969496:Carton_gris:3726:20969556,20970176:Carton_gris:3726:20970257,20970772:Carton_gris:3726:20970827,20971287:Carton_gris:3726:20971362,20971841:Carton_gris:3726:20971857,20972467:Carton_gris:3726:20972565,20973314:Carton_gris:3726:20973327,20974054:Carton_gris:3726:20974088,20974829:Carton_gris:3726:20974842,20976058:Carton_gris:3726:20976062,20976515:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0017644184725354906, 'nb_photo': 2831, 'list_port_cont': '20960321,20961071,20961521,20961954,20962447,20962835,20963338,20963690,20964491,20965029,20965546,20966753,20968799,20969560,20970261,20970831,20971364,20971856,20972569,20973325,20974085,20976529,20976813,20977090,20977640,20978019,20979268,20979714,20980871,20981351,20982002,20982252,20983108,20984415,20984781,20986056,20986486,20987519,20988182,20988622,20989078,20990343,20990943,20991584,21000342,21000689,21001008,21002184,21003731,21004350,21004940,21006159,21006703,21008529,21008907,21009475,21009967,21010634,21011835,21012512,21013006,21013958,21014727,21015637,21015762,21017258,21017865,21018857,21020001,21022714,21023303,21023871,21025973,21027345,21028061,21028651,21029325,21030210,21031670,21032406,21033010,21033437,21034047,21034720,21035125,21036661,21037201,21037747,21038159,21038960,21039854,21040538,21042335,21042742,21044132,21044564,21045295,21045942,21046575,21047123,21047842,21049550,21050214,21051289,21051457,21052371,21054990,21056061,21056610,21057142,21058611,21060584,21061242,2106184', 'assoc_port': '20960307:20960321,20961064:20961071,20961514:20961521,20961943:20961954,20962435:20962447,20962794:20962835,20963307:20963338,20963628:20963690,20964476:20964491,20965022:20965029,20965512:20965546,20966718:20966753,20968779:20968799,20969496:20969560,20970176:20970261,20970772:20970831,20971287:20971364,20971841:20971856,20972467:20972569,20973314:20973325,20974054:20974085,20976515:20976529,20976807:20976813,20977087:20977090,20977626:20977640,20978006:20978019,20979220:20979268,20979676:20979714,20980858:20980871,20981321:20981351,20981988:20982002,20982201:20982252,20983052:20983108,20984411:20984415,20984700:20984781,20986044:20986056,20986474:20986486,20987472:20987519,20988119:20988182,20988613:20988622,20989064:20989078,20990317:20990343,20990909:20990943,20991546:20991584,21000334:21000342,21000676:21000689,21001000:21001008,21002132:21002184,21003724:21003731,21004334:21004350,21004910:21004940,21006128:21006159,21006668:21006703,21008527:21008529,21008886:21008907,21009461:21009475,21009958:2100996', 'assoc_mat': '20960307:kraft:3726:20960321,20961064:kraft:3726:20961071,20961514:kraft:3726:20961521,20961943:kraft:3726:20961954,20962435:kraft:3726:20962447,20962794:kraft:3726:20962835,20963307:kraft:3726:20963338,20963628:kraft:3726:20963690,20964476:kraft:3726:20964491,20965022:kraft:3726:20965029,20965512:kraft:3726:20965546,20966718:kraft:3726:20966753,20968779:kraft:3726:20968799,20969496:kraft:3726:20969560,20970176:kraft:3726:20970261,20970772:kraft:3726:20970831,20971287:kraft:3726:20971364,20971841:kraft:3726:20971856,20972467:kraft:3726:20972569,20973314:kraft:3726:20973325,20974054:kraft:3726:20974085,20976515:kraft:3726:20976529,20976807:kraft:3726:20976813,20977087:kraft:3726:20977090,20977626:kraft:3726:20977640,20978006:kraft:3726:20978019,20979220:kraft:3726:20979268,20979676:kraft:3726:20979714,20980858:kraft:3726:20980871,20981321:kraft:3726:20981351,20981988:kraft:3726:20982002,20982201:kraft:3726:20982252,20983052:kraft:3726:20983108,20984411:kraft:3726:20984415,20984700:kraft:3726:20984781,20986044:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0005556362152610759, 'nb_photo': 671, 'list_port_cont': '20962825,20963344,20963684,20964489,20965541,20966752,20968200,20968796,20970254,20970825,20971363,20972571,20974087,20974844,20976061,20978013,20978661,20979710,20981360,20982259,20983109,20983809,20984416,20984786,20986485,20987010,20989582,21000162,21001012,21003277,21003733,21004343,21005505,21009474,21010636,21013956,21014726,21017260,21019997,21020863,21022474,21023872,21026740,21027338,21028065,21028640,21030209,21030878,21031669,21033429,21034050,21035129,21036653,21037200,21037742,21038158,21038962,21040534,21042748,21043140,21044565,21045290,21047121,21047844,21048700,21051450,21052362,21059630,21067430,21068865,21069476,21070741,21072057,21075482,21078019,21078694,21079398,21080965,21081726,21085776,21088252,21089231,21089852,21090393,21092982,21093328,21095287,21096727,21098113,21100028,21104333,21104724,21106674,21108367,21111890,21118105,21125087,21126085,21127191,21133341,21133365,21133490,21133520,21144781,21145010,21145725,21146464,21151519,21152732,21153287,21154262,21155600,21156367,2122274', 'assoc_port': '20962794:20962825,20963307:20963344,20963628:20963684,20964476:20964489,20965512:20965541,20966718:20966752,20968187:20968200,20968779:20968796,20970176:20970254,20970772:20970825,20971287:20971363,20972467:20972571,20974054:20974087,20974829:20974844,20976058:20976061,20978006:20978013,20978650:20978661,20979676:20979710,20981321:20981360,20982201:20982259,20983052:20983109,20983803:20983809,20984411:20984416,20984700:20984786,20986474:20986485,20987003:20987010,20989548:20989582,21000153:21000162,21001000:21001012,21003272:21003277,21003724:21003733,21004334:21004343,21005496:21005505,21009461:21009474,21010580:21010636,21013935:21013956,21014715:21014726,21017247:21017260,21019955:21019997,21020862:21020863,21022471:21022474,21023862:21023872,21026737:21026740,21027310:21027338,21028005:21028065,21028610:21028640,21030129:21030209,21030842:21030878,21031610:21031669,21033425:21033429,21033980:21034050,21035092:21035129,21036613:21036653,21037191:21037200,21037712:21037742,21038145:21038158,21038910:2103896', 'assoc_mat': '20962794:metal:3726:20962825,20963307:metal:3726:20963344,20963628:metal:3726:20963684,20964476:metal:3726:20964489,20965512:metal:3726:20965541,20966718:metal:3726:20966752,20968187:metal:3726:20968200,20968779:metal:3726:20968796,20970176:metal:3726:20970254,20970772:metal:3726:20970825,20971287:metal:3726:20971363,20972467:metal:3726:20972571,20974054:metal:3726:20974087,20974829:metal:3726:20974844,20976058:metal:3726:20976061,20978006:metal:3726:20978013,20978650:metal:3726:20978661,20979676:metal:3726:20979710,20981321:metal:3726:20981360,20982201:metal:3726:20982259,20983052:metal:3726:20983109,20983803:metal:3726:20983809,20984411:metal:3726:20984416,20984700:metal:3726:20984786,20986474:metal:3726:20986485,20987003:metal:3726:20987010,20989548:metal:3726:20989582,21000153:metal:3726:21000162,21001000:metal:3726:21001012,21003272:metal:3726:21003277,21003724:metal:3726:21003733,21004334:metal:3726:21004343,21005496:metal:3726:21005505,21009461:metal:3726:21009474,21010580:metal:3726:21010636,21013935:'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004497159495204218, 'nb_photo': 10913, 'list_port_cont': '20960320,20960521,20960902,20961077,20961524,20961952,20962446,20962834,20963340,20963691,20964492,20965033,20965552,20966662,20966758,20967397,20967734,20968197,20968798,20969558,20970259,20970830,20971358,20971859,20972564,20973321,20974090,20974834,20976066,20976814,20977096,20977637,20978017,20978655,20979263,20979713,20980384,20980868,20981359,20981999,20982255,20983107,20983812,20984420,20984779,20986052,20986483,20987013,20987523,20988183,20988626,20989068,20989584,20990353,20990944,20991577,20992757,20994604,21000164,21000685,21001006,21002177,21002361,21003278,21003730,21004340,21004949,21005506,21006161,21006708,21008532,21008913,21009468,21009966,21010631,21011247,21011843,21012520,21013002,21013959,21014728,21015639,21015753,21016739,21017256,21017862,21018860,21019993,21020874,21020999,21021918,21022723,21023312,21023869,21024440,21025578,21025965,21026750,21027343,21028069,21028643,21029320,21030205,21030882,21031673,21032415,21033011,21033438,21034053,21034715,21035128,21036230,21036656,2103719', 'assoc_port': '20960307:20960320,20960513:20960521,20960900:20960902,20961064:20961077,20961514:20961524,20961943:20961952,20962435:20962446,20962794:20962834,20963307:20963340,20963628:20963691,20964476:20964492,20965022:20965033,20965512:20965552,20966655:20966662,20966718:20966758,20967368:20967397,20967705:20967734,20968187:20968197,20968779:20968798,20969496:20969558,20970176:20970259,20970772:20970830,20971287:20971358,20971841:20971859,20972467:20972564,20973314:20973321,20974054:20974090,20974829:20974834,20976058:20976066,20976807:20976814,20977087:20977096,20977626:20977637,20978006:20978017,20978650:20978655,20979220:20979263,20979676:20979713,20980311:20980384,20980858:20980868,20981321:20981359,20981988:20981999,20982201:20982255,20983052:20983107,20983803:20983812,20984411:20984420,20984700:20984779,20986044:20986052,20986474:20986483,20987003:20987013,20987472:20987523,20988119:20988183,20988613:20988626,20989064:20989068,20989548:20989584,20990317:20990353,20990909:20990944,20991546:20991577,20992705:2099275', 'assoc_mat': '20960307:plastique:3726:20960320,20960513:plastique:3726:20960521,20960900:plastique:3726:20960902,20961064:plastique:3726:20961077,20961514:plastique:3726:20961524,20961943:plastique:3726:20961952,20962435:plastique:3726:20962446,20962794:plastique:3726:20962834,20963307:plastique:3726:20963340,20963628:plastique:3726:20963691,20964476:plastique:3726:20964492,20965022:plastique:3726:20965033,20965512:plastique:3726:20965552,20966655:plastique:3726:20966662,20966718:plastique:3726:20966758,20967368:plastique:3726:20967397,20967705:plastique:3726:20967734,20968187:plastique:3726:20968197,20968779:plastique:3726:20968798,20969496:plastique:3726:20969558,20970176:plastique:3726:20970259,20970772:plastique:3726:20970830,20971287:plastique:3726:20971358,20971841:plastique:3726:20971859,20972467:plastique:3726:20972564,20973314:plastique:3726:20973321,20974054:plastique:3726:20974090,20974829:plastique:3726:20974834,20976058:plastique:3726:20976066,20976807:plastique:3726:20976814,20977087:plastique:3726:20977096,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.01114949068130545, 'nb_photo': 25337, 'list_port_cont': '20960313,20960527,20960909,20961072,20961527,20961947,20962439,20962829,20963346,20963687,20964488,20965034,20965547,20966671,20966756,20967396,20967732,20968198,20968801,20969559,20970250,20970826,20971359,20971852,20972574,20973323,20974092,20974837,20976069,20976524,20976820,20977100,20977638,20978012,20978660,20979269,20979706,20980379,20980864,20981362,20981993,20982256,20983113,20983810,20984418,20984784,20986054,20986484,20987015,20987516,20988184,20988617,20989073,20989586,20990348,20990948,20991582,20994600,21000157,21000345,21000681,21001004,21002174,21002357,21003283,21003729,21004345,21004947,21005501,21006160,21006700,21008534,21008914,21009467,21009968,21010628,21011250,21011842,21012523,21013008,21013966,21014729,21015642,21015761,21016738,21017252,21017868,21018852,21020000,21020587,21020866,21020998,21021924,21022484,21022717,21023304,21023873,21024435,21025576,21025975,21026744,21027339,21028067,21028646,21029315,21030201,21030872,21031665,21032417,21033016,21033434,21034044,21034716,2103512', 'assoc_port': '20960307:20960313,20960513:20960527,20960900:20960909,20961064:20961072,20961514:20961527,20961943:20961947,20962435:20962439,20962794:20962829,20963307:20963346,20963628:20963687,20964476:20964488,20965022:20965034,20965512:20965547,20966655:20966671,20966718:20966756,20967368:20967396,20967705:20967732,20968187:20968198,20968779:20968801,20969496:20969559,20970176:20970250,20970772:20970826,20971287:20971359,20971841:20971852,20972467:20972574,20973314:20973323,20974054:20974092,20974829:20974837,20976058:20976069,20976515:20976524,20976807:20976820,20977087:20977100,20977626:20977638,20978006:20978012,20978650:20978660,20979220:20979269,20979676:20979706,20980311:20980379,20980858:20980864,20981321:20981362,20981988:20981993,20982201:20982256,20983052:20983113,20983803:20983810,20984411:20984418,20984700:20984784,20986044:20986054,20986474:20986484,20987003:20987015,20987472:20987516,20988119:20988184,20988613:20988617,20989064:20989073,20989548:20989586,20990317:20990348,20990909:20990948,20991546:2099158', 'assoc_mat': '20960307:Teint_Dans_La_Masse:3726:20960313,20960513:Teint_Dans_La_Masse:3726:20960527,20960900:Teint_Dans_La_Masse:3726:20960909,20961064:Teint_Dans_La_Masse:3726:20961072,20961514:Teint_Dans_La_Masse:3726:20961527,20961943:Teint_Dans_La_Masse:3726:20961947,20962435:Teint_Dans_La_Masse:3726:20962439,20962794:Teint_Dans_La_Masse:3726:20962829,20963307:Teint_Dans_La_Masse:3726:20963346,20963628:Teint_Dans_La_Masse:3726:20963687,20964476:Teint_Dans_La_Masse:3726:20964488,20965022:Teint_Dans_La_Masse:3726:20965034,20965512:Teint_Dans_La_Masse:3726:20965547,20966655:Teint_Dans_La_Masse:3726:20966671,20966718:Teint_Dans_La_Masse:3726:20966756,20967368:Teint_Dans_La_Masse:3726:20967396,20967705:Teint_Dans_La_Masse:3726:20967732,20968187:Teint_Dans_La_Masse:3726:20968198,20968779:Teint_Dans_La_Masse:3726:20968801,20969496:Teint_Dans_La_Masse:3726:20969559,20970176:Teint_Dans_La_Masse:3726:20970250,20970772:Teint_Dans_La_Masse:3726:20970826,20971287:Teint_Dans_La_Masse:3726:20971359,20971841:Teint_Dans_La_Masse:3726:2'}), 'main_stat': {'nb_photos': 58767}}, 'hostname': (('jetson-73',),), 'impurety_average_per_hashtag': [(('JRM', '2025-03', 0.06551124071100697),)]} filepath : /data_2/data_log/job/memo/arc_en_ciel_jrm/sla_mensuel_arc_en_ciel_jrm_mois_03_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'JRM': {'autre_refus': ['autre_refus', '3.2%', 43415], 'cartonnette': ['cartonnette', '0.58%', 15777], 'Carton_brun': ['Carton_brun', '1.24%', 17265], 'Carton_gris': ['Carton_gris', '0.87%', 17567], 'kraft': ['kraft', '0.18%', 2831], 'metal': ['metal', '0.06%', 671], 'plastique': ['plastique', '0.45%', 10913], 'Teint_Dans_La_Masse': ['Teint_Dans_La_Masse', '1.11%', 25337]}} before organize_and_plot_coverage_data before organize_and_plot_impurety_average_data before organize_and_plot_quality_photo_data finish generating filepath : /data_2/data_log/job/memo/arc_en_ciel_jrm/sla_mensuel_arc_en_ciel_jrm_mois_03_annee_2025.pdf le fichier se trouve ici : /data_2/data_log/job/memo/arc_en_ciel_jrm 2.86user 3.37system 8:31.26elapsed 1%CPU (0avgtext+0avgdata 175408maxresident)k 440392inputs+624outputs (9788major+94083minor)pagefaults 0swaps