python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=20062 --dashboard_places=arc_en_ciel_jrm_peu_dense --rootfolder_sla=/data_2/data_log/job/memo/arc_en_ciel_jrm_peu_dense -v --mtr_id=979 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 20062, Date : 2025-01 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (2, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3385 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3385 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3385 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3385 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm_peu_dense"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3385 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3385 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3385 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3385 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (2, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3385 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3385 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3385 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3385 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm_peu_dense"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3385 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3385 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3385 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3385 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 25 month : 01 mtr_id : 979 dashboard_places : arc_en_ciel_jrm_peu_dense date : 2025-01 year : 2025 raspi : 20062 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'arc_en_ciel_jrm_peu_dense' and date like '%2025-01%') and created_at like '%2025-01%'))); nb_day : (2, 31) after unwanted_material_data nb_day : (2, 31) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%20062%' AND ms.result_str like '%2025/01%'ORDER BY ms.id desc LIMIT 0, 1000000; Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-01-01 00:00:00,2025-01-02 00:00:00,2025-01-03 00:00:00,2025-01-04 00:00:00,2025-01-06 00:00:00,2025-01-07 00:00:00,2025-01-08 00:00:00,2025-01-09 00:00:00,2025-01-10 00:00:00,2025-01-11 00:00:00,2025-01-13 00:00:00,2025-01-14 00:00:00,2025-01-15 00:00:00,2025-01-16 00:00:00,2025-01-17 00:00:00,2025-01-18 00:00:00,2025-01-20 00:00:00,2025-01-21 00:00:00,2025-01-22 00:00:00,2025-01-23 00:00:00,2025-01-24 00:00:00,2025-01-25 00:00:00,2025-01-27 00:00:00,2025-01-28 00:00:00,2025-01-29 00:00:00,2025-01-30 00:00:00,2025-01-31 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and ded.dashboard_place_id = 25 and month(ded.date) = 01 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______JRM' and ded.dashboard_place_id = 25 and month(ded.date) = 01 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 25 and mp.name like '%012025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-01-01 : dt_date_just_month_year : 2025-01-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! Error parsing crontab ! [Errno 2] No such file or directory: '' You better check your LOGRASPI env !!! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "arc_en_ciel_jrm_peu_dense" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-01-01" AND ded.date <= "2025-01-31" apple3 {'JRM': {'mat': 'JRM', 'pht': 3726, 'datou_carac_id': 3459, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (1563116,1566504,1566497,1566440,1566432,1566362,1566352,1570373,1575992,1578662,1578659) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.00682025997537629, 'nb_photo': 348, 'list_port_cont': '19778906,19779459,19781331,19783095,19785196,19787744,19792259,19797624,19801411,19802236,19810444,19811528,19816105,19824368,19839511,19841228,19847800,19859910,19868334,19879543,19881282,19881641,19889449,19896771,19905864,19906634,19907209,19907360,19908735,19908952,19909549,19910599,19911565,19911910,19912685,19913241,19914269,19917894,19918116,19919059,19919404,19919825,19921511,19922130,19922491,19922696,19923600,19923863,19924073,19924643,19925115,19926202,19926812,19927458,19927725,19927938,19928099,19928405,19928582,19932740,19933057,19933117,19933210,19933389,19933964,19934957,19935143,19935623,19936133,19936204,19936325,19936733,19936800,19937044,19937315,19937475,19937613,19937758,19938437,19938638,19939118,19939329,19939489,19940722,19941178,19942506,19942999,19943923,19944226,19944755,19945403,19946131,19946416,19953100,19954540,19954990,19955776,19956248,19958858,19965176,19965474,19966097,19976807,19977535,19978847,19982081,19984259,19987197,19988449,19990216,19990388,19995975,20006565,2001550', 'assoc_port': '19774387:19785196,19774388:19787744,19775226:19783095,19775228:19781331,19776431:19779459,19777262:19778906,19791645:19792259,19797271:19797624,19800775:19802236,19801172:19801411,19809800:19810444,19811171:19811528,19815790:19816105,19822802:19824368,19835245:19946131,19835246:19946416,19837807:19945403,19837810:19841228,19839124:19839511,19843224:19942999,19843443:19944755,19844025:19944226,19844026:19943923,19845102:19942506,19845212:19847800,19850914:19941178,19852639:19940722,19856757:19939489,19856758:19939329,19856759:19939118,19858207:19938437,19858208:19938638,19859639:19937475,19859640:19937613,19859641:19937758,19859643:19937315,19859646:19936800,19859647:19937044,19859649:19859910,19861033:19936733,19861034:19936325,19861037:19936204,19861038:19936133,19862306:19935623,19862564:19868334,19878529:19934957,19878531:19935143,19878532:19879543,19880737:19881282,19881500:19881641,19883747:19933964,19884961:19933210,19884962:19933389,19886206:19933117,19888952:19932740,19888954:19933057,19888955:1988944', 'assoc_mat': '19774387:autre_refus:3726:19785196,19774388:autre_refus:3726:19787744,19775226:autre_refus:3726:19783095,19775228:autre_refus:3726:19781331,19776431:autre_refus:3726:19779459,19777262:autre_refus:3726:19778906,19791645:autre_refus:3726:19792259,19797271:autre_refus:3726:19797624,19800775:autre_refus:3726:19802236,19801172:autre_refus:3726:19801411,19809800:autre_refus:3726:19810444,19811171:autre_refus:3726:19811528,19815790:autre_refus:3726:19816105,19822802:autre_refus:3726:19824368,19835245:autre_refus:3726:19946131,19835246:autre_refus:3726:19946416,19837807:autre_refus:3726:19945403,19837810:autre_refus:3726:19841228,19839124:autre_refus:3726:19839511,19843224:autre_refus:3726:19942999,19843443:autre_refus:3726:19944755,19844025:autre_refus:3726:19944226,19844026:autre_refus:3726:19943923,19845102:autre_refus:3726:19942506,19845212:autre_refus:3726:19847800,19850914:autre_refus:3726:19941178,19852639:autre_refus:3726:19940722,19856757:autre_refus:3726:19939489,19856758:autre_refus:3726:19939329,19856759:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.006017436286858156, 'nb_photo': 666, 'list_port_cont': '19762928,19765220,19771735,19772771,19773074,19778896,19779457,19779964,19781313,19783094,19785200,19787752,19789745,19792260,19792819,19797614,19798219,19802233,19806889,19808734,19810440,19811527,19816100,19820148,19824364,19834074,19838049,19839507,19840795,19841225,19843454,19844097,19847488,19847801,19854101,19859902,19879549,19881284,19881638,19896766,19898104,19905859,19906628,19907216,19907368,19908730,19908950,19909552,19910598,19911564,19911913,19912686,19913245,19913264,19914264,19916860,19917220,19917463,19917893,19918120,19919400,19919816,19920083,19921921,19922493,19923027,19923306,19923604,19924075,19924646,19925733,19926201,19926560,19926813,19927468,19927724,19927937,19928098,19928406,19928585,19932734,19932832,19933051,19933208,19933386,19933581,19934953,19935147,19935829,19936024,19936126,19936330,19936533,19936740,19936802,19937035,19937231,19937311,19937608,19937763,19937890,19938438,19938635,19938731,19938941,19939119,19939327,19939492,19940720,19941174,19942512,19942722,19942997,1994391', 'assoc_port': '19762412:19762928,19764222:19765220,19771181:19771735,19772146:19772771,19772147:19773074,19773097:19789745,19774387:19785200,19774388:19787752,19775226:19783094,19775229:19781313,19776428:19779964,19776431:19779457,19777262:19778896,19791645:19792260,19792450:19792819,19797271:19797614,19797272:19798219,19800775:19802233,19806030:19806889,19808594:19808734,19809800:19810440,19811171:19811527,19815788:20073040,19815790:19816100,19819257:19820148,19821719:19840795,19822802:19824364,19833807:19948251,19833809:19947593,19833810:19834074,19835245:19946135,19835246:19946423,19835506:19945861,19837806:19945687,19837807:19945405,19837808:19945219,19837809:19838049,19837810:19841225,19839124:19839507,19843224:19942997,19843226:19843454,19843443:19944758,19843745:19944464,19844025:19944227,19844026:19943914,19844027:19844097,19845102:19942512,19845103:19942722,19845212:19847801,19845523:19847488,19850914:19941174,19852639:19940720,19852640:19854101,19856757:19939492,19856758:19939327,19856759:19939119,19858205:1993894', 'assoc_mat': '19762412:cartonnette:3726:19762928,19764222:cartonnette:3726:19765220,19771181:cartonnette:3726:19771735,19772146:cartonnette:3726:19772771,19772147:cartonnette:3726:19773074,19773097:cartonnette:3726:19789745,19774387:cartonnette:3726:19785200,19774388:cartonnette:3726:19787752,19775226:cartonnette:3726:19783094,19775229:cartonnette:3726:19781313,19776428:cartonnette:3726:19779964,19776431:cartonnette:3726:19779457,19777262:cartonnette:3726:19778896,19791645:cartonnette:3726:19792260,19792450:cartonnette:3726:19792819,19797271:cartonnette:3726:19797614,19797272:cartonnette:3726:19798219,19800775:cartonnette:3726:19802233,19806030:cartonnette:3726:19806889,19808594:cartonnette:3726:19808734,19809800:cartonnette:3726:19810440,19811171:cartonnette:3726:19811527,19815788:cartonnette:3726:20073040,19815790:cartonnette:3726:19816100,19819257:cartonnette:3726:19820148,19821719:cartonnette:3726:19840795,19822802:cartonnette:3726:19824364,19833807:cartonnette:3726:19948251,19833809:cartonnette:3726:19947593,19833810:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.008400345440782024, 'nb_photo': 615, 'list_port_cont': '19765228,19781328,19783096,19785191,19792261,19793047,19798214,19806892,19816109,19820142,19834069,19838058,19839506,19841218,19843445,19847483,19854102,19859901,19879542,19881647,19887795,19889439,19896768,19898105,19905869,19906635,19907210,19907363,19908729,19908946,19909551,19910590,19911562,19911909,19912679,19913248,19913262,19914266,19916857,19917218,19920080,19922698,19923309,19923864,19924640,19925742,19926005,19926198,19927469,19927722,19927936,19928101,19928401,19928583,19932738,19932827,19933059,19933213,19933395,19933587,19933961,19934952,19935145,19935628,19936018,19936198,19936539,19936735,19937313,19937476,19937755,19937884,19938307,19938447,19938637,19938734,19938949,19939114,19939321,19940715,19941169,19942508,19942716,19942993,19943918,19944235,19944473,19944751,19945404,19945688,19945858,19947587,19953095,19953655,19954535,19954992,19956254,19958857,19964563,19965172,19965476,19966088,19967549,19976804,19977536,19978856,19981009,19982082,19984262,19987191,19989705,19990210,19995974,2000655', 'assoc_port': '19764222:19765228,19774387:19785191,19775226:19783096,19775228:19781328,19791644:19793047,19791645:19792261,19797272:19798214,19806030:19806892,19815790:19816109,19819257:19820142,19833809:19947587,19833810:19834069,19835506:19945858,19837806:19945688,19837807:19945404,19837809:19838058,19837810:19841218,19839124:19839506,19843224:19942993,19843226:19843445,19843443:19944751,19843745:19944473,19844025:19944235,19844026:19943918,19845102:19942508,19845103:19942716,19845523:19847483,19850914:19941169,19852639:19940715,19852640:19854102,19856758:19939321,19856759:19939114,19858205:19938949,19858206:19938734,19858207:19938447,19858208:19938637,19858209:19938307,19859638:19937884,19859639:19937476,19859641:19937755,19859643:19937313,19859649:19859901,19861033:19936735,19861035:19936539,19861037:19936198,19861878:19936018,19862306:19935628,19878529:19934952,19878531:19935145,19878532:19879542,19881500:19881647,19883747:19933961,19884960:19933587,19884961:19933213,19884962:19933395,19886208:19887795,19888952:1993273', 'assoc_mat': '19764222:Carton_brun:3726:19765228,19774387:Carton_brun:3726:19785191,19775226:Carton_brun:3726:19783096,19775228:Carton_brun:3726:19781328,19791644:Carton_brun:3726:19793047,19791645:Carton_brun:3726:19792261,19797272:Carton_brun:3726:19798214,19806030:Carton_brun:3726:19806892,19815790:Carton_brun:3726:19816109,19819257:Carton_brun:3726:19820142,19833809:Carton_brun:3726:19947587,19833810:Carton_brun:3726:19834069,19835506:Carton_brun:3726:19945858,19837806:Carton_brun:3726:19945688,19837807:Carton_brun:3726:19945404,19837809:Carton_brun:3726:19838058,19837810:Carton_brun:3726:19841218,19839124:Carton_brun:3726:19839506,19843224:Carton_brun:3726:19942993,19843226:Carton_brun:3726:19843445,19843443:Carton_brun:3726:19944751,19843745:Carton_brun:3726:19944473,19844025:Carton_brun:3726:19944235,19844026:Carton_brun:3726:19943918,19845102:Carton_brun:3726:19942508,19845103:Carton_brun:3726:19942716,19845523:Carton_brun:3726:19847483,19850914:Carton_brun:3726:19941169,19852639:Carton_brun:3726:19940715,19852640:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.006848061334926263, 'nb_photo': 422, 'list_port_cont': '19765226,19773084,19779462,19781314,19781334,19783103,19785192,19787746,19788848,19789747,19792256,19792816,19797636,19798209,19801408,19802243,19805469,19808740,19810436,19811517,19816106,19820149,19824362,19834070,19838060,19839502,19841220,19843451,19844095,19847793,19859903,19868328,19879546,19881283,19881637,19896773,19898113,19907213,19907369,19909553,19910594,19911561,19911919,19912680,19913240,19913254,19914270,19917214,19917416,19917885,19918117,19919061,19919410,19919817,19920077,19921516,19921927,19922121,19922700,19923303,19924074,19924638,19925117,19925740,19926207,19926564,19926819,19927459,19927935,19928091,19928399,19928584,19932742,19932826,19933050,19933123,19933215,19933393,19933582,19934956,19935619,19935831,19936127,19936202,19936320,19936538,19936730,19936799,19937038,19937221,19937314,19937482,19937611,19937753,19938633,19938738,19938948,19939121,19939318,19939494,19940724,19941170,19942514,19942996,19944236,19944465,19945225,19945406,19945853,19946132,19946421,19947594,19948245,1995022', 'assoc_port': '19764222:19765226,19772147:19773084,19773097:19789747,19774386:19788848,19774387:19785192,19774388:19787746,19775226:19783103,19775228:19781334,19775229:19781314,19776431:19779462,19791645:19792256,19792450:19792816,19797271:19797636,19797272:19798209,19800775:19802243,19801172:19801408,19804718:19805469,19808594:19808740,19809800:19810436,19811171:19811517,19815788:20073038,19815790:19816106,19819257:19820149,19822802:19824362,19831693:19951096,19832669:19950221,19833807:19948245,19833809:19947594,19833810:19834070,19835245:19946132,19835246:19946421,19835506:19945853,19837807:19945406,19837808:19945225,19837809:19838060,19837810:19841220,19839124:19839502,19843224:19942996,19843226:19843451,19843745:19944465,19844025:19944236,19844027:19844095,19845102:19942514,19845212:19847793,19850914:19941170,19852639:19940724,19856757:19939494,19856758:19939318,19856759:19939121,19858205:19938948,19858206:19938738,19858208:19938633,19859639:19937482,19859640:19937611,19859641:19937753,19859643:19937314,19859644:1993722', 'assoc_mat': '19764222:Carton_gris:3726:19765226,19772147:Carton_gris:3726:19773084,19773097:Carton_gris:3726:19789747,19774386:Carton_gris:3726:19788848,19774387:Carton_gris:3726:19785192,19774388:Carton_gris:3726:19787746,19775226:Carton_gris:3726:19783103,19775228:Carton_gris:3726:19781334,19775229:Carton_gris:3726:19781314,19776431:Carton_gris:3726:19779462,19791645:Carton_gris:3726:19792256,19792450:Carton_gris:3726:19792816,19797271:Carton_gris:3726:19797636,19797272:Carton_gris:3726:19798209,19800775:Carton_gris:3726:19802243,19801172:Carton_gris:3726:19801408,19804718:Carton_gris:3726:19805469,19808594:Carton_gris:3726:19808740,19809800:Carton_gris:3726:19810436,19811171:Carton_gris:3726:19811517,19815788:Carton_gris:3726:20073038,19815790:Carton_gris:3726:19816106,19819257:Carton_gris:3726:19820149,19822802:Carton_gris:3726:19824362,19831693:Carton_gris:3726:19951096,19832669:Carton_gris:3726:19950221,19833807:Carton_gris:3726:19948245,19833809:Carton_gris:3726:19947594,19833810:Carton_gris:3726:19834070,19835245:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0018241158556058662, 'nb_photo': 63, 'list_port_cont': '19805466,19808733,19859907,19879545,19881290,19906633,19908731,19909550,19910588,19912683,19913239,19913259,19925743,19927465,19928095,19928577,19933124,19933591,19934959,19937881,19942989,19944467,19956245,19965179,19966092,19978850,19982079,20006564,20015509,20021724,20022318,20022770,20024910,20028068,20037659,20038437,20042898,20044609,20044681,20046361,20072051,20073654,20105470,20144824,20146073,20146746,20147503,20148874,20150037,20150550', 'assoc_port': '19804718:19805466,19808594:19808733,19843224:19942989,19843745:19944467,19859638:19937881,19859649:19859907,19878529:19934959,19878532:19879545,19880737:19881290,19884960:19933591,19886206:19933124,19895834:19928577,19895835:19928095,19895838:19927465,19897921:19913259,19897923:19913239,19900689:19912683,19902026:19910588,19903472:19909550,19904777:19908731,19906565:19906633,19917530:19925743,19955913:19956245,19964113:19965179,19965675:19966092,19978229:19978850,19980747:19982079,20006552:20006564,20013865:20024910,20015245:20015509,20019542:20021724,20021858:20022318,20022723:20022770,20028041:20028068,20037597:20037659,20038304:20038437,20042812:20042898,20044107:20044609,20044671:20044681,20046299:20046361,20071972:20072051,20073646:20073654,20105216:20105470,20122301:20150550,20122302:20150037,20138072:20148874,20138073:20147503,20138074:20146746,20138075:20146073,20138076:20144824', 'assoc_mat': '19804718:kraft:3726:19805466,19808594:kraft:3726:19808733,19843224:kraft:3726:19942989,19843745:kraft:3726:19944467,19859638:kraft:3726:19937881,19859649:kraft:3726:19859907,19878529:kraft:3726:19934959,19878532:kraft:3726:19879545,19880737:kraft:3726:19881290,19884960:kraft:3726:19933591,19886206:kraft:3726:19933124,19895834:kraft:3726:19928577,19895835:kraft:3726:19928095,19895838:kraft:3726:19927465,19897921:kraft:3726:19913259,19897923:kraft:3726:19913239,19900689:kraft:3726:19912683,19902026:kraft:3726:19910588,19903472:kraft:3726:19909550,19904777:kraft:3726:19908731,19906565:kraft:3726:19906633,19917530:kraft:3726:19925743,19955913:kraft:3726:19956245,19964113:kraft:3726:19965179,19965675:kraft:3726:19966092,19978229:kraft:3726:19978850,19980747:kraft:3726:19982079,20006552:kraft:3726:20006564,20013865:kraft:3726:20024910,20015245:kraft:3726:20015509,20019542:kraft:3726:20021724,20021858:kraft:3726:20022318,20022723:kraft:3726:20022770,20028041:kraft:3726:20028068,20037597:kraft:3726:20037659,20038304:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0017509069615176415, 'nb_photo': 33, 'list_port_cont': '19781312,19824369,19896775,19909554,19911911,19923860,19926563,19927732,19953099,19964564,19987195,20027941,20038433,20042900,20046078,20046362,20048204,20082923,20115358,20128951,20137163,20138088,20144826,20146066,20146744,20148871,20150042', 'assoc_port': '19775229:19781312,19822802:19824369,19895840:19927732,19895841:19896775,19902028:19911911,19903472:19909554,19916734:19926563,19921578:19923860,19951810:19953099,19964114:19964564,19986537:19987195,20027882:20027941,20038304:20038433,20042812:20042900,20045933:20046078,20046299:20046362,20048159:20048204,20081910:20082923,20115261:20115358,20122302:20150042,20122303:20137163,20125012:20128951,20138072:20148871,20138074:20146744,20138075:20146066,20138076:20144826,20138078:20138088', 'assoc_mat': '19775229:metal:3726:19781312,19822802:metal:3726:19824369,19895840:metal:3726:19927732,19895841:metal:3726:19896775,19902028:metal:3726:19911911,19903472:metal:3726:19909554,19916734:metal:3726:19926563,19921578:metal:3726:19923860,19951810:metal:3726:19953099,19964114:metal:3726:19964564,19986537:metal:3726:19987195,20027882:metal:3726:20027941,20038304:metal:3726:20038433,20042812:metal:3726:20042900,20045933:metal:3726:20046078,20046299:metal:3726:20046362,20048159:metal:3726:20048204,20081910:metal:3726:20082923,20115261:metal:3726:20115358,20122302:metal:3726:20150042,20122303:metal:3726:20137163,20125012:metal:3726:20128951,20138072:metal:3726:20148871,20138074:metal:3726:20146744,20138075:metal:3726:20146066,20138076:metal:3726:20144826,20138078:metal:3726:20138088'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004858323947006404, 'nb_photo': 559, 'list_port_cont': '19762932,19765217,19771738,19776668,19778902,19781307,19785195,19787749,19788853,19789750,19792251,19792815,19793046,19797622,19798217,19801404,19802238,19805471,19808729,19810438,19811525,19816110,19820143,19824370,19834071,19838051,19839509,19841226,19843447,19844103,19847481,19847796,19850869,19854106,19859905,19879541,19881640,19887792,19896774,19898108,19905867,19906627,19907211,19907370,19908740,19908953,19909558,19910591,19911566,19911918,19912688,19913244,19913255,19914273,19916853,19917217,19917887,19918115,19919052,19919399,19919823,19920079,19921512,19921923,19922122,19922489,19922693,19923028,19923302,19923603,19923865,19924068,19924649,19925113,19926566,19926815,19927466,19927727,19927945,19928102,19928403,19928579,19932735,19933055,19933217,19933586,19933970,19934948,19935142,19935620,19935824,19936199,19936323,19936542,19936797,19937039,19937483,19937615,19938302,19938444,19938640,19938946,19939113,19939324,19939500,19940718,19941173,19942990,19943922,19944232,19944469,19944757,19946418,1994825', 'assoc_port': '19762412:19762932,19764222:19765217,19771181:19771738,19773097:19789750,19774386:19788853,19774387:19785195,19774388:19787749,19775229:19781307,19776429:19776668,19777262:19778902,19791644:19793046,19791645:19792251,19792450:19792815,19797271:19797622,19797272:19798217,19800775:19802238,19801172:19801404,19804718:19805471,19808594:19808729,19809800:19810438,19811171:19811525,19815788:20073046,19815790:19816110,19819257:19820143,19822802:19824370,19831693:19951095,19833807:19948255,19833810:19834071,19835246:19946418,19837809:19838051,19837810:19841226,19839124:19839509,19843224:19942990,19843226:19843447,19843443:19944757,19843745:19944469,19844025:19944232,19844026:19943922,19844027:19844103,19845212:19847796,19845523:19847481,19849898:19850869,19850914:19941173,19852639:19940718,19852640:19854106,19856757:19939500,19856758:19939324,19856759:19939113,19858205:19938946,19858207:19938444,19858208:19938640,19858209:19938302,19859639:19937483,19859640:19937615,19859646:19936797,19859647:19937039,19859649:1985990', 'assoc_mat': '19762412:plastique:3726:19762932,19764222:plastique:3726:19765217,19771181:plastique:3726:19771738,19773097:plastique:3726:19789750,19774386:plastique:3726:19788853,19774387:plastique:3726:19785195,19774388:plastique:3726:19787749,19775229:plastique:3726:19781307,19776429:plastique:3726:19776668,19777262:plastique:3726:19778902,19791644:plastique:3726:19793046,19791645:plastique:3726:19792251,19792450:plastique:3726:19792815,19797271:plastique:3726:19797622,19797272:plastique:3726:19798217,19800775:plastique:3726:19802238,19801172:plastique:3726:19801404,19804718:plastique:3726:19805471,19808594:plastique:3726:19808729,19809800:plastique:3726:19810438,19811171:plastique:3726:19811525,19815788:plastique:3726:20073046,19815790:plastique:3726:19816110,19819257:plastique:3726:19820143,19822802:plastique:3726:19824370,19831693:plastique:3726:19951095,19833807:plastique:3726:19948255,19833810:plastique:3726:19834071,19835246:plastique:3726:19946418,19837809:plastique:3726:19838051,19837810:plastique:3726:19841226,1'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007494943126820162, 'nb_photo': 990, 'list_port_cont': '19762927,19765225,19771732,19773081,19778901,19779463,19779956,19781308,19781332,19783093,19785193,19789751,19792252,19792817,19793050,19797632,19798212,19801407,19802244,19805467,19806888,19808737,19810439,19811521,19816102,19819478,19820144,19834068,19839508,19841223,19843446,19844102,19847484,19847799,19850874,19854099,19859909,19879548,19881287,19881646,19887799,19889441,19896767,19898103,19905861,19906637,19907215,19907365,19908739,19908947,19909557,19910597,19911557,19911914,19912678,19913247,19913260,19914275,19916854,19917221,19917421,19917461,19917889,19918121,19919062,19919401,19919826,19920074,19921514,19921919,19922126,19922494,19922691,19923031,19923301,19923608,19923870,19924067,19924645,19925108,19925734,19925998,19926204,19926570,19926811,19927467,19927729,19927940,19928100,19928410,19928578,19932731,19932830,19933060,19933128,19933206,19933388,19933585,19933834,19933963,19934791,19934949,19935146,19935624,19935828,19936203,19936324,19936537,19936737,19936804,19937036,19937220,19937316,1993748', 'assoc_port': '19762412:19762927,19764222:19765225,19771181:19771732,19772147:19773081,19773097:19789751,19774387:19785193,19775226:19783093,19775228:19781332,19775229:19781308,19776428:19779956,19776431:19779463,19777262:19778901,19791644:19793050,19791645:19792252,19792450:19792817,19797271:19797632,19797272:19798212,19800775:19802244,19801172:19801407,19804718:19805467,19806030:19806888,19808594:19808737,19809800:19810439,19811171:19811521,19815788:20073037,19815790:19816102,19819257:19820144,19819258:19819478,19831693:19951103,19833807:19948247,19833809:19947597,19833810:19834068,19835245:19946137,19835246:19946419,19837806:19945686,19837807:19945401,19837808:19945220,19837810:19841223,19839124:19839508,19843224:19943000,19843226:19843446,19843443:19944748,19843745:19944462,19844025:19944229,19844026:19943915,19844027:19844102,19845102:19942513,19845103:19942713,19845212:19847799,19845523:19847484,19849898:19850874,19850914:19941168,19852639:19940719,19852640:19854099,19856757:19939491,19856758:19939319,19856759:1993912', 'assoc_mat': '19762412:Teint_Dans_La_Masse:3726:19762927,19764222:Teint_Dans_La_Masse:3726:19765225,19771181:Teint_Dans_La_Masse:3726:19771732,19772147:Teint_Dans_La_Masse:3726:19773081,19773097:Teint_Dans_La_Masse:3726:19789751,19774387:Teint_Dans_La_Masse:3726:19785193,19775226:Teint_Dans_La_Masse:3726:19783093,19775228:Teint_Dans_La_Masse:3726:19781332,19775229:Teint_Dans_La_Masse:3726:19781308,19776428:Teint_Dans_La_Masse:3726:19779956,19776431:Teint_Dans_La_Masse:3726:19779463,19777262:Teint_Dans_La_Masse:3726:19778901,19791644:Teint_Dans_La_Masse:3726:19793050,19791645:Teint_Dans_La_Masse:3726:19792252,19792450:Teint_Dans_La_Masse:3726:19792817,19797271:Teint_Dans_La_Masse:3726:19797632,19797272:Teint_Dans_La_Masse:3726:19798212,19800775:Teint_Dans_La_Masse:3726:19802244,19801172:Teint_Dans_La_Masse:3726:19801407,19804718:Teint_Dans_La_Masse:3726:19805467,19806030:Teint_Dans_La_Masse:3726:19806888,19808594:Teint_Dans_La_Masse:3726:19808737,19809800:Teint_Dans_La_Masse:3726:19810439,19811171:Teint_Dans_La_Masse:3726:1'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(1563116,1566504,1566497,1566440,1566432,1566362,1566352,1570373,1575992,1578662,1578659)); after get_hostname_from_raspi SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______JRM' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=25 and date >='2025-01-01' and date <= '2025-01-31') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((28976,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('JRM', 6115),), 'material_dict': {'JRM': 6115}, 'coverage_data': (), 'impurety_average_data': ((datetime.date(2025, 1, 20), 0.02873942363667511, 390), (datetime.date(2025, 1, 21), 0.0357822721680053, 254), (datetime.date(2025, 1, 22), 0.027896008993662597, 500), (datetime.date(2025, 1, 23), 0.03405910498759631, 1097), (datetime.date(2025, 1, 24), 0.04364138551962661, 975), (datetime.date(2025, 1, 25), 0.029493231696974844, 699), (datetime.date(2025, 1, 27), 0.04057961801371549, 555), (datetime.date(2025, 1, 28), 0.03883234141127869, 596), (datetime.date(2025, 1, 29), 0.048785972715964084, 1049), (datetime.date(2025, 1, 30), 0.03000687384049057, 2975), (datetime.date(2025, 1, 31), 0.0299705361586603, 2331)), 'impurety_average_data_per_hashtag': {'JRM': ((datetime.date(2025, 1, 20), 0.02873942363667511, 390), (datetime.date(2025, 1, 21), 0.0357822721680053, 254), (datetime.date(2025, 1, 22), 0.027896008993662597, 500), (datetime.date(2025, 1, 23), 0.03405910498759631, 1097), (datetime.date(2025, 1, 24), 0.04364138551962661, 975), (datetime.date(2025, 1, 25), 0.029493231696974844, 699), (datetime.date(2025, 1, 27), 0.04057961801371549, 555), (datetime.date(2025, 1, 28), 0.03883234141127869, 596), (datetime.date(2025, 1, 29), 0.048785972715964084, 1049), (datetime.date(2025, 1, 30), 0.03000687384049057, 2975), (datetime.date(2025, 1, 31), 0.0299705361586603, 2331))}, 'quality_array': [], 'number_of_batch': ((500,),), 'datou_id_sts': 3385, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.00682025997537629, 'nb_photo': 348, 'list_port_cont': '19778906,19779459,19781331,19783095,19785196,19787744,19792259,19797624,19801411,19802236,19810444,19811528,19816105,19824368,19839511,19841228,19847800,19859910,19868334,19879543,19881282,19881641,19889449,19896771,19905864,19906634,19907209,19907360,19908735,19908952,19909549,19910599,19911565,19911910,19912685,19913241,19914269,19917894,19918116,19919059,19919404,19919825,19921511,19922130,19922491,19922696,19923600,19923863,19924073,19924643,19925115,19926202,19926812,19927458,19927725,19927938,19928099,19928405,19928582,19932740,19933057,19933117,19933210,19933389,19933964,19934957,19935143,19935623,19936133,19936204,19936325,19936733,19936800,19937044,19937315,19937475,19937613,19937758,19938437,19938638,19939118,19939329,19939489,19940722,19941178,19942506,19942999,19943923,19944226,19944755,19945403,19946131,19946416,19953100,19954540,19954990,19955776,19956248,19958858,19965176,19965474,19966097,19976807,19977535,19978847,19982081,19984259,19987197,19988449,19990216,19990388,19995975,20006565,2001550', 'assoc_port': '19774387:19785196,19774388:19787744,19775226:19783095,19775228:19781331,19776431:19779459,19777262:19778906,19791645:19792259,19797271:19797624,19800775:19802236,19801172:19801411,19809800:19810444,19811171:19811528,19815790:19816105,19822802:19824368,19835245:19946131,19835246:19946416,19837807:19945403,19837810:19841228,19839124:19839511,19843224:19942999,19843443:19944755,19844025:19944226,19844026:19943923,19845102:19942506,19845212:19847800,19850914:19941178,19852639:19940722,19856757:19939489,19856758:19939329,19856759:19939118,19858207:19938437,19858208:19938638,19859639:19937475,19859640:19937613,19859641:19937758,19859643:19937315,19859646:19936800,19859647:19937044,19859649:19859910,19861033:19936733,19861034:19936325,19861037:19936204,19861038:19936133,19862306:19935623,19862564:19868334,19878529:19934957,19878531:19935143,19878532:19879543,19880737:19881282,19881500:19881641,19883747:19933964,19884961:19933210,19884962:19933389,19886206:19933117,19888952:19932740,19888954:19933057,19888955:1988944', 'assoc_mat': '19774387:autre_refus:3726:19785196,19774388:autre_refus:3726:19787744,19775226:autre_refus:3726:19783095,19775228:autre_refus:3726:19781331,19776431:autre_refus:3726:19779459,19777262:autre_refus:3726:19778906,19791645:autre_refus:3726:19792259,19797271:autre_refus:3726:19797624,19800775:autre_refus:3726:19802236,19801172:autre_refus:3726:19801411,19809800:autre_refus:3726:19810444,19811171:autre_refus:3726:19811528,19815790:autre_refus:3726:19816105,19822802:autre_refus:3726:19824368,19835245:autre_refus:3726:19946131,19835246:autre_refus:3726:19946416,19837807:autre_refus:3726:19945403,19837810:autre_refus:3726:19841228,19839124:autre_refus:3726:19839511,19843224:autre_refus:3726:19942999,19843443:autre_refus:3726:19944755,19844025:autre_refus:3726:19944226,19844026:autre_refus:3726:19943923,19845102:autre_refus:3726:19942506,19845212:autre_refus:3726:19847800,19850914:autre_refus:3726:19941178,19852639:autre_refus:3726:19940722,19856757:autre_refus:3726:19939489,19856758:autre_refus:3726:19939329,19856759:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.006017436286858156, 'nb_photo': 666, 'list_port_cont': '19762928,19765220,19771735,19772771,19773074,19778896,19779457,19779964,19781313,19783094,19785200,19787752,19789745,19792260,19792819,19797614,19798219,19802233,19806889,19808734,19810440,19811527,19816100,19820148,19824364,19834074,19838049,19839507,19840795,19841225,19843454,19844097,19847488,19847801,19854101,19859902,19879549,19881284,19881638,19896766,19898104,19905859,19906628,19907216,19907368,19908730,19908950,19909552,19910598,19911564,19911913,19912686,19913245,19913264,19914264,19916860,19917220,19917463,19917893,19918120,19919400,19919816,19920083,19921921,19922493,19923027,19923306,19923604,19924075,19924646,19925733,19926201,19926560,19926813,19927468,19927724,19927937,19928098,19928406,19928585,19932734,19932832,19933051,19933208,19933386,19933581,19934953,19935147,19935829,19936024,19936126,19936330,19936533,19936740,19936802,19937035,19937231,19937311,19937608,19937763,19937890,19938438,19938635,19938731,19938941,19939119,19939327,19939492,19940720,19941174,19942512,19942722,19942997,1994391', 'assoc_port': '19762412:19762928,19764222:19765220,19771181:19771735,19772146:19772771,19772147:19773074,19773097:19789745,19774387:19785200,19774388:19787752,19775226:19783094,19775229:19781313,19776428:19779964,19776431:19779457,19777262:19778896,19791645:19792260,19792450:19792819,19797271:19797614,19797272:19798219,19800775:19802233,19806030:19806889,19808594:19808734,19809800:19810440,19811171:19811527,19815788:20073040,19815790:19816100,19819257:19820148,19821719:19840795,19822802:19824364,19833807:19948251,19833809:19947593,19833810:19834074,19835245:19946135,19835246:19946423,19835506:19945861,19837806:19945687,19837807:19945405,19837808:19945219,19837809:19838049,19837810:19841225,19839124:19839507,19843224:19942997,19843226:19843454,19843443:19944758,19843745:19944464,19844025:19944227,19844026:19943914,19844027:19844097,19845102:19942512,19845103:19942722,19845212:19847801,19845523:19847488,19850914:19941174,19852639:19940720,19852640:19854101,19856757:19939492,19856758:19939327,19856759:19939119,19858205:1993894', 'assoc_mat': '19762412:cartonnette:3726:19762928,19764222:cartonnette:3726:19765220,19771181:cartonnette:3726:19771735,19772146:cartonnette:3726:19772771,19772147:cartonnette:3726:19773074,19773097:cartonnette:3726:19789745,19774387:cartonnette:3726:19785200,19774388:cartonnette:3726:19787752,19775226:cartonnette:3726:19783094,19775229:cartonnette:3726:19781313,19776428:cartonnette:3726:19779964,19776431:cartonnette:3726:19779457,19777262:cartonnette:3726:19778896,19791645:cartonnette:3726:19792260,19792450:cartonnette:3726:19792819,19797271:cartonnette:3726:19797614,19797272:cartonnette:3726:19798219,19800775:cartonnette:3726:19802233,19806030:cartonnette:3726:19806889,19808594:cartonnette:3726:19808734,19809800:cartonnette:3726:19810440,19811171:cartonnette:3726:19811527,19815788:cartonnette:3726:20073040,19815790:cartonnette:3726:19816100,19819257:cartonnette:3726:19820148,19821719:cartonnette:3726:19840795,19822802:cartonnette:3726:19824364,19833807:cartonnette:3726:19948251,19833809:cartonnette:3726:19947593,19833810:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.008400345440782024, 'nb_photo': 615, 'list_port_cont': '19765228,19781328,19783096,19785191,19792261,19793047,19798214,19806892,19816109,19820142,19834069,19838058,19839506,19841218,19843445,19847483,19854102,19859901,19879542,19881647,19887795,19889439,19896768,19898105,19905869,19906635,19907210,19907363,19908729,19908946,19909551,19910590,19911562,19911909,19912679,19913248,19913262,19914266,19916857,19917218,19920080,19922698,19923309,19923864,19924640,19925742,19926005,19926198,19927469,19927722,19927936,19928101,19928401,19928583,19932738,19932827,19933059,19933213,19933395,19933587,19933961,19934952,19935145,19935628,19936018,19936198,19936539,19936735,19937313,19937476,19937755,19937884,19938307,19938447,19938637,19938734,19938949,19939114,19939321,19940715,19941169,19942508,19942716,19942993,19943918,19944235,19944473,19944751,19945404,19945688,19945858,19947587,19953095,19953655,19954535,19954992,19956254,19958857,19964563,19965172,19965476,19966088,19967549,19976804,19977536,19978856,19981009,19982082,19984262,19987191,19989705,19990210,19995974,2000655', 'assoc_port': '19764222:19765228,19774387:19785191,19775226:19783096,19775228:19781328,19791644:19793047,19791645:19792261,19797272:19798214,19806030:19806892,19815790:19816109,19819257:19820142,19833809:19947587,19833810:19834069,19835506:19945858,19837806:19945688,19837807:19945404,19837809:19838058,19837810:19841218,19839124:19839506,19843224:19942993,19843226:19843445,19843443:19944751,19843745:19944473,19844025:19944235,19844026:19943918,19845102:19942508,19845103:19942716,19845523:19847483,19850914:19941169,19852639:19940715,19852640:19854102,19856758:19939321,19856759:19939114,19858205:19938949,19858206:19938734,19858207:19938447,19858208:19938637,19858209:19938307,19859638:19937884,19859639:19937476,19859641:19937755,19859643:19937313,19859649:19859901,19861033:19936735,19861035:19936539,19861037:19936198,19861878:19936018,19862306:19935628,19878529:19934952,19878531:19935145,19878532:19879542,19881500:19881647,19883747:19933961,19884960:19933587,19884961:19933213,19884962:19933395,19886208:19887795,19888952:1993273', 'assoc_mat': '19764222:Carton_brun:3726:19765228,19774387:Carton_brun:3726:19785191,19775226:Carton_brun:3726:19783096,19775228:Carton_brun:3726:19781328,19791644:Carton_brun:3726:19793047,19791645:Carton_brun:3726:19792261,19797272:Carton_brun:3726:19798214,19806030:Carton_brun:3726:19806892,19815790:Carton_brun:3726:19816109,19819257:Carton_brun:3726:19820142,19833809:Carton_brun:3726:19947587,19833810:Carton_brun:3726:19834069,19835506:Carton_brun:3726:19945858,19837806:Carton_brun:3726:19945688,19837807:Carton_brun:3726:19945404,19837809:Carton_brun:3726:19838058,19837810:Carton_brun:3726:19841218,19839124:Carton_brun:3726:19839506,19843224:Carton_brun:3726:19942993,19843226:Carton_brun:3726:19843445,19843443:Carton_brun:3726:19944751,19843745:Carton_brun:3726:19944473,19844025:Carton_brun:3726:19944235,19844026:Carton_brun:3726:19943918,19845102:Carton_brun:3726:19942508,19845103:Carton_brun:3726:19942716,19845523:Carton_brun:3726:19847483,19850914:Carton_brun:3726:19941169,19852639:Carton_brun:3726:19940715,19852640:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.006848061334926263, 'nb_photo': 422, 'list_port_cont': '19765226,19773084,19779462,19781314,19781334,19783103,19785192,19787746,19788848,19789747,19792256,19792816,19797636,19798209,19801408,19802243,19805469,19808740,19810436,19811517,19816106,19820149,19824362,19834070,19838060,19839502,19841220,19843451,19844095,19847793,19859903,19868328,19879546,19881283,19881637,19896773,19898113,19907213,19907369,19909553,19910594,19911561,19911919,19912680,19913240,19913254,19914270,19917214,19917416,19917885,19918117,19919061,19919410,19919817,19920077,19921516,19921927,19922121,19922700,19923303,19924074,19924638,19925117,19925740,19926207,19926564,19926819,19927459,19927935,19928091,19928399,19928584,19932742,19932826,19933050,19933123,19933215,19933393,19933582,19934956,19935619,19935831,19936127,19936202,19936320,19936538,19936730,19936799,19937038,19937221,19937314,19937482,19937611,19937753,19938633,19938738,19938948,19939121,19939318,19939494,19940724,19941170,19942514,19942996,19944236,19944465,19945225,19945406,19945853,19946132,19946421,19947594,19948245,1995022', 'assoc_port': '19764222:19765226,19772147:19773084,19773097:19789747,19774386:19788848,19774387:19785192,19774388:19787746,19775226:19783103,19775228:19781334,19775229:19781314,19776431:19779462,19791645:19792256,19792450:19792816,19797271:19797636,19797272:19798209,19800775:19802243,19801172:19801408,19804718:19805469,19808594:19808740,19809800:19810436,19811171:19811517,19815788:20073038,19815790:19816106,19819257:19820149,19822802:19824362,19831693:19951096,19832669:19950221,19833807:19948245,19833809:19947594,19833810:19834070,19835245:19946132,19835246:19946421,19835506:19945853,19837807:19945406,19837808:19945225,19837809:19838060,19837810:19841220,19839124:19839502,19843224:19942996,19843226:19843451,19843745:19944465,19844025:19944236,19844027:19844095,19845102:19942514,19845212:19847793,19850914:19941170,19852639:19940724,19856757:19939494,19856758:19939318,19856759:19939121,19858205:19938948,19858206:19938738,19858208:19938633,19859639:19937482,19859640:19937611,19859641:19937753,19859643:19937314,19859644:1993722', 'assoc_mat': '19764222:Carton_gris:3726:19765226,19772147:Carton_gris:3726:19773084,19773097:Carton_gris:3726:19789747,19774386:Carton_gris:3726:19788848,19774387:Carton_gris:3726:19785192,19774388:Carton_gris:3726:19787746,19775226:Carton_gris:3726:19783103,19775228:Carton_gris:3726:19781334,19775229:Carton_gris:3726:19781314,19776431:Carton_gris:3726:19779462,19791645:Carton_gris:3726:19792256,19792450:Carton_gris:3726:19792816,19797271:Carton_gris:3726:19797636,19797272:Carton_gris:3726:19798209,19800775:Carton_gris:3726:19802243,19801172:Carton_gris:3726:19801408,19804718:Carton_gris:3726:19805469,19808594:Carton_gris:3726:19808740,19809800:Carton_gris:3726:19810436,19811171:Carton_gris:3726:19811517,19815788:Carton_gris:3726:20073038,19815790:Carton_gris:3726:19816106,19819257:Carton_gris:3726:19820149,19822802:Carton_gris:3726:19824362,19831693:Carton_gris:3726:19951096,19832669:Carton_gris:3726:19950221,19833807:Carton_gris:3726:19948245,19833809:Carton_gris:3726:19947594,19833810:Carton_gris:3726:19834070,19835245:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0018241158556058662, 'nb_photo': 63, 'list_port_cont': '19805466,19808733,19859907,19879545,19881290,19906633,19908731,19909550,19910588,19912683,19913239,19913259,19925743,19927465,19928095,19928577,19933124,19933591,19934959,19937881,19942989,19944467,19956245,19965179,19966092,19978850,19982079,20006564,20015509,20021724,20022318,20022770,20024910,20028068,20037659,20038437,20042898,20044609,20044681,20046361,20072051,20073654,20105470,20144824,20146073,20146746,20147503,20148874,20150037,20150550', 'assoc_port': '19804718:19805466,19808594:19808733,19843224:19942989,19843745:19944467,19859638:19937881,19859649:19859907,19878529:19934959,19878532:19879545,19880737:19881290,19884960:19933591,19886206:19933124,19895834:19928577,19895835:19928095,19895838:19927465,19897921:19913259,19897923:19913239,19900689:19912683,19902026:19910588,19903472:19909550,19904777:19908731,19906565:19906633,19917530:19925743,19955913:19956245,19964113:19965179,19965675:19966092,19978229:19978850,19980747:19982079,20006552:20006564,20013865:20024910,20015245:20015509,20019542:20021724,20021858:20022318,20022723:20022770,20028041:20028068,20037597:20037659,20038304:20038437,20042812:20042898,20044107:20044609,20044671:20044681,20046299:20046361,20071972:20072051,20073646:20073654,20105216:20105470,20122301:20150550,20122302:20150037,20138072:20148874,20138073:20147503,20138074:20146746,20138075:20146073,20138076:20144824', 'assoc_mat': '19804718:kraft:3726:19805466,19808594:kraft:3726:19808733,19843224:kraft:3726:19942989,19843745:kraft:3726:19944467,19859638:kraft:3726:19937881,19859649:kraft:3726:19859907,19878529:kraft:3726:19934959,19878532:kraft:3726:19879545,19880737:kraft:3726:19881290,19884960:kraft:3726:19933591,19886206:kraft:3726:19933124,19895834:kraft:3726:19928577,19895835:kraft:3726:19928095,19895838:kraft:3726:19927465,19897921:kraft:3726:19913259,19897923:kraft:3726:19913239,19900689:kraft:3726:19912683,19902026:kraft:3726:19910588,19903472:kraft:3726:19909550,19904777:kraft:3726:19908731,19906565:kraft:3726:19906633,19917530:kraft:3726:19925743,19955913:kraft:3726:19956245,19964113:kraft:3726:19965179,19965675:kraft:3726:19966092,19978229:kraft:3726:19978850,19980747:kraft:3726:19982079,20006552:kraft:3726:20006564,20013865:kraft:3726:20024910,20015245:kraft:3726:20015509,20019542:kraft:3726:20021724,20021858:kraft:3726:20022318,20022723:kraft:3726:20022770,20028041:kraft:3726:20028068,20037597:kraft:3726:20037659,20038304:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0017509069615176415, 'nb_photo': 33, 'list_port_cont': '19781312,19824369,19896775,19909554,19911911,19923860,19926563,19927732,19953099,19964564,19987195,20027941,20038433,20042900,20046078,20046362,20048204,20082923,20115358,20128951,20137163,20138088,20144826,20146066,20146744,20148871,20150042', 'assoc_port': '19775229:19781312,19822802:19824369,19895840:19927732,19895841:19896775,19902028:19911911,19903472:19909554,19916734:19926563,19921578:19923860,19951810:19953099,19964114:19964564,19986537:19987195,20027882:20027941,20038304:20038433,20042812:20042900,20045933:20046078,20046299:20046362,20048159:20048204,20081910:20082923,20115261:20115358,20122302:20150042,20122303:20137163,20125012:20128951,20138072:20148871,20138074:20146744,20138075:20146066,20138076:20144826,20138078:20138088', 'assoc_mat': '19775229:metal:3726:19781312,19822802:metal:3726:19824369,19895840:metal:3726:19927732,19895841:metal:3726:19896775,19902028:metal:3726:19911911,19903472:metal:3726:19909554,19916734:metal:3726:19926563,19921578:metal:3726:19923860,19951810:metal:3726:19953099,19964114:metal:3726:19964564,19986537:metal:3726:19987195,20027882:metal:3726:20027941,20038304:metal:3726:20038433,20042812:metal:3726:20042900,20045933:metal:3726:20046078,20046299:metal:3726:20046362,20048159:metal:3726:20048204,20081910:metal:3726:20082923,20115261:metal:3726:20115358,20122302:metal:3726:20150042,20122303:metal:3726:20137163,20125012:metal:3726:20128951,20138072:metal:3726:20148871,20138074:metal:3726:20146744,20138075:metal:3726:20146066,20138076:metal:3726:20144826,20138078:metal:3726:20138088'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004858323947006404, 'nb_photo': 559, 'list_port_cont': '19762932,19765217,19771738,19776668,19778902,19781307,19785195,19787749,19788853,19789750,19792251,19792815,19793046,19797622,19798217,19801404,19802238,19805471,19808729,19810438,19811525,19816110,19820143,19824370,19834071,19838051,19839509,19841226,19843447,19844103,19847481,19847796,19850869,19854106,19859905,19879541,19881640,19887792,19896774,19898108,19905867,19906627,19907211,19907370,19908740,19908953,19909558,19910591,19911566,19911918,19912688,19913244,19913255,19914273,19916853,19917217,19917887,19918115,19919052,19919399,19919823,19920079,19921512,19921923,19922122,19922489,19922693,19923028,19923302,19923603,19923865,19924068,19924649,19925113,19926566,19926815,19927466,19927727,19927945,19928102,19928403,19928579,19932735,19933055,19933217,19933586,19933970,19934948,19935142,19935620,19935824,19936199,19936323,19936542,19936797,19937039,19937483,19937615,19938302,19938444,19938640,19938946,19939113,19939324,19939500,19940718,19941173,19942990,19943922,19944232,19944469,19944757,19946418,1994825', 'assoc_port': '19762412:19762932,19764222:19765217,19771181:19771738,19773097:19789750,19774386:19788853,19774387:19785195,19774388:19787749,19775229:19781307,19776429:19776668,19777262:19778902,19791644:19793046,19791645:19792251,19792450:19792815,19797271:19797622,19797272:19798217,19800775:19802238,19801172:19801404,19804718:19805471,19808594:19808729,19809800:19810438,19811171:19811525,19815788:20073046,19815790:19816110,19819257:19820143,19822802:19824370,19831693:19951095,19833807:19948255,19833810:19834071,19835246:19946418,19837809:19838051,19837810:19841226,19839124:19839509,19843224:19942990,19843226:19843447,19843443:19944757,19843745:19944469,19844025:19944232,19844026:19943922,19844027:19844103,19845212:19847796,19845523:19847481,19849898:19850869,19850914:19941173,19852639:19940718,19852640:19854106,19856757:19939500,19856758:19939324,19856759:19939113,19858205:19938946,19858207:19938444,19858208:19938640,19858209:19938302,19859639:19937483,19859640:19937615,19859646:19936797,19859647:19937039,19859649:1985990', 'assoc_mat': '19762412:plastique:3726:19762932,19764222:plastique:3726:19765217,19771181:plastique:3726:19771738,19773097:plastique:3726:19789750,19774386:plastique:3726:19788853,19774387:plastique:3726:19785195,19774388:plastique:3726:19787749,19775229:plastique:3726:19781307,19776429:plastique:3726:19776668,19777262:plastique:3726:19778902,19791644:plastique:3726:19793046,19791645:plastique:3726:19792251,19792450:plastique:3726:19792815,19797271:plastique:3726:19797622,19797272:plastique:3726:19798217,19800775:plastique:3726:19802238,19801172:plastique:3726:19801404,19804718:plastique:3726:19805471,19808594:plastique:3726:19808729,19809800:plastique:3726:19810438,19811171:plastique:3726:19811525,19815788:plastique:3726:20073046,19815790:plastique:3726:19816110,19819257:plastique:3726:19820143,19822802:plastique:3726:19824370,19831693:plastique:3726:19951095,19833807:plastique:3726:19948255,19833810:plastique:3726:19834071,19835246:plastique:3726:19946418,19837809:plastique:3726:19838051,19837810:plastique:3726:19841226,1'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007494943126820162, 'nb_photo': 990, 'list_port_cont': '19762927,19765225,19771732,19773081,19778901,19779463,19779956,19781308,19781332,19783093,19785193,19789751,19792252,19792817,19793050,19797632,19798212,19801407,19802244,19805467,19806888,19808737,19810439,19811521,19816102,19819478,19820144,19834068,19839508,19841223,19843446,19844102,19847484,19847799,19850874,19854099,19859909,19879548,19881287,19881646,19887799,19889441,19896767,19898103,19905861,19906637,19907215,19907365,19908739,19908947,19909557,19910597,19911557,19911914,19912678,19913247,19913260,19914275,19916854,19917221,19917421,19917461,19917889,19918121,19919062,19919401,19919826,19920074,19921514,19921919,19922126,19922494,19922691,19923031,19923301,19923608,19923870,19924067,19924645,19925108,19925734,19925998,19926204,19926570,19926811,19927467,19927729,19927940,19928100,19928410,19928578,19932731,19932830,19933060,19933128,19933206,19933388,19933585,19933834,19933963,19934791,19934949,19935146,19935624,19935828,19936203,19936324,19936537,19936737,19936804,19937036,19937220,19937316,1993748', 'assoc_port': '19762412:19762927,19764222:19765225,19771181:19771732,19772147:19773081,19773097:19789751,19774387:19785193,19775226:19783093,19775228:19781332,19775229:19781308,19776428:19779956,19776431:19779463,19777262:19778901,19791644:19793050,19791645:19792252,19792450:19792817,19797271:19797632,19797272:19798212,19800775:19802244,19801172:19801407,19804718:19805467,19806030:19806888,19808594:19808737,19809800:19810439,19811171:19811521,19815788:20073037,19815790:19816102,19819257:19820144,19819258:19819478,19831693:19951103,19833807:19948247,19833809:19947597,19833810:19834068,19835245:19946137,19835246:19946419,19837806:19945686,19837807:19945401,19837808:19945220,19837810:19841223,19839124:19839508,19843224:19943000,19843226:19843446,19843443:19944748,19843745:19944462,19844025:19944229,19844026:19943915,19844027:19844102,19845102:19942513,19845103:19942713,19845212:19847799,19845523:19847484,19849898:19850874,19850914:19941168,19852639:19940719,19852640:19854099,19856757:19939491,19856758:19939319,19856759:1993912', 'assoc_mat': '19762412:Teint_Dans_La_Masse:3726:19762927,19764222:Teint_Dans_La_Masse:3726:19765225,19771181:Teint_Dans_La_Masse:3726:19771732,19772147:Teint_Dans_La_Masse:3726:19773081,19773097:Teint_Dans_La_Masse:3726:19789751,19774387:Teint_Dans_La_Masse:3726:19785193,19775226:Teint_Dans_La_Masse:3726:19783093,19775228:Teint_Dans_La_Masse:3726:19781332,19775229:Teint_Dans_La_Masse:3726:19781308,19776428:Teint_Dans_La_Masse:3726:19779956,19776431:Teint_Dans_La_Masse:3726:19779463,19777262:Teint_Dans_La_Masse:3726:19778901,19791644:Teint_Dans_La_Masse:3726:19793050,19791645:Teint_Dans_La_Masse:3726:19792252,19792450:Teint_Dans_La_Masse:3726:19792817,19797271:Teint_Dans_La_Masse:3726:19797632,19797272:Teint_Dans_La_Masse:3726:19798212,19800775:Teint_Dans_La_Masse:3726:19802244,19801172:Teint_Dans_La_Masse:3726:19801407,19804718:Teint_Dans_La_Masse:3726:19805467,19806030:Teint_Dans_La_Masse:3726:19806888,19808594:Teint_Dans_La_Masse:3726:19808737,19809800:Teint_Dans_La_Masse:3726:19810439,19811171:Teint_Dans_La_Masse:3726:1'}), 'main_stat': {'nb_photos': 28976}}, 'hostname': (), 'impurety_average_per_hashtag': []} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3385 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3385 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3385 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3385 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm_peu_dense"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3385 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3385 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3385 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3385 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((28976,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('JRM', 6115),), 'material_dict': {'JRM': 6115}, 'coverage_data': (), 'impurety_average_data': ((datetime.date(2025, 1, 20), 0.02873942363667511, 390), (datetime.date(2025, 1, 21), 0.0357822721680053, 254), (datetime.date(2025, 1, 22), 0.027896008993662597, 500), (datetime.date(2025, 1, 23), 0.03405910498759631, 1097), (datetime.date(2025, 1, 24), 0.04364138551962661, 975), (datetime.date(2025, 1, 25), 0.029493231696974844, 699), (datetime.date(2025, 1, 27), 0.04057961801371549, 555), (datetime.date(2025, 1, 28), 0.03883234141127869, 596), (datetime.date(2025, 1, 29), 0.048785972715964084, 1049), (datetime.date(2025, 1, 30), 0.03000687384049057, 2975), (datetime.date(2025, 1, 31), 0.0299705361586603, 2331)), 'impurety_average_data_per_hashtag': {'JRM': ((datetime.date(2025, 1, 20), 0.02873942363667511, 390), (datetime.date(2025, 1, 21), 0.0357822721680053, 254), (datetime.date(2025, 1, 22), 0.027896008993662597, 500), (datetime.date(2025, 1, 23), 0.03405910498759631, 1097), (datetime.date(2025, 1, 24), 0.04364138551962661, 975), (datetime.date(2025, 1, 25), 0.029493231696974844, 699), (datetime.date(2025, 1, 27), 0.04057961801371549, 555), (datetime.date(2025, 1, 28), 0.03883234141127869, 596), (datetime.date(2025, 1, 29), 0.048785972715964084, 1049), (datetime.date(2025, 1, 30), 0.03000687384049057, 2975), (datetime.date(2025, 1, 31), 0.0299705361586603, 2331))}, 'quality_array': [], 'number_of_batch': ((500,),), 'datou_id_sts': 3385, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.00682025997537629, 'nb_photo': 348, 'list_port_cont': '19778906,19779459,19781331,19783095,19785196,19787744,19792259,19797624,19801411,19802236,19810444,19811528,19816105,19824368,19839511,19841228,19847800,19859910,19868334,19879543,19881282,19881641,19889449,19896771,19905864,19906634,19907209,19907360,19908735,19908952,19909549,19910599,19911565,19911910,19912685,19913241,19914269,19917894,19918116,19919059,19919404,19919825,19921511,19922130,19922491,19922696,19923600,19923863,19924073,19924643,19925115,19926202,19926812,19927458,19927725,19927938,19928099,19928405,19928582,19932740,19933057,19933117,19933210,19933389,19933964,19934957,19935143,19935623,19936133,19936204,19936325,19936733,19936800,19937044,19937315,19937475,19937613,19937758,19938437,19938638,19939118,19939329,19939489,19940722,19941178,19942506,19942999,19943923,19944226,19944755,19945403,19946131,19946416,19953100,19954540,19954990,19955776,19956248,19958858,19965176,19965474,19966097,19976807,19977535,19978847,19982081,19984259,19987197,19988449,19990216,19990388,19995975,20006565,2001550', 'assoc_port': '19774387:19785196,19774388:19787744,19775226:19783095,19775228:19781331,19776431:19779459,19777262:19778906,19791645:19792259,19797271:19797624,19800775:19802236,19801172:19801411,19809800:19810444,19811171:19811528,19815790:19816105,19822802:19824368,19835245:19946131,19835246:19946416,19837807:19945403,19837810:19841228,19839124:19839511,19843224:19942999,19843443:19944755,19844025:19944226,19844026:19943923,19845102:19942506,19845212:19847800,19850914:19941178,19852639:19940722,19856757:19939489,19856758:19939329,19856759:19939118,19858207:19938437,19858208:19938638,19859639:19937475,19859640:19937613,19859641:19937758,19859643:19937315,19859646:19936800,19859647:19937044,19859649:19859910,19861033:19936733,19861034:19936325,19861037:19936204,19861038:19936133,19862306:19935623,19862564:19868334,19878529:19934957,19878531:19935143,19878532:19879543,19880737:19881282,19881500:19881641,19883747:19933964,19884961:19933210,19884962:19933389,19886206:19933117,19888952:19932740,19888954:19933057,19888955:1988944', 'assoc_mat': '19774387:autre_refus:3726:19785196,19774388:autre_refus:3726:19787744,19775226:autre_refus:3726:19783095,19775228:autre_refus:3726:19781331,19776431:autre_refus:3726:19779459,19777262:autre_refus:3726:19778906,19791645:autre_refus:3726:19792259,19797271:autre_refus:3726:19797624,19800775:autre_refus:3726:19802236,19801172:autre_refus:3726:19801411,19809800:autre_refus:3726:19810444,19811171:autre_refus:3726:19811528,19815790:autre_refus:3726:19816105,19822802:autre_refus:3726:19824368,19835245:autre_refus:3726:19946131,19835246:autre_refus:3726:19946416,19837807:autre_refus:3726:19945403,19837810:autre_refus:3726:19841228,19839124:autre_refus:3726:19839511,19843224:autre_refus:3726:19942999,19843443:autre_refus:3726:19944755,19844025:autre_refus:3726:19944226,19844026:autre_refus:3726:19943923,19845102:autre_refus:3726:19942506,19845212:autre_refus:3726:19847800,19850914:autre_refus:3726:19941178,19852639:autre_refus:3726:19940722,19856757:autre_refus:3726:19939489,19856758:autre_refus:3726:19939329,19856759:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.006017436286858156, 'nb_photo': 666, 'list_port_cont': '19762928,19765220,19771735,19772771,19773074,19778896,19779457,19779964,19781313,19783094,19785200,19787752,19789745,19792260,19792819,19797614,19798219,19802233,19806889,19808734,19810440,19811527,19816100,19820148,19824364,19834074,19838049,19839507,19840795,19841225,19843454,19844097,19847488,19847801,19854101,19859902,19879549,19881284,19881638,19896766,19898104,19905859,19906628,19907216,19907368,19908730,19908950,19909552,19910598,19911564,19911913,19912686,19913245,19913264,19914264,19916860,19917220,19917463,19917893,19918120,19919400,19919816,19920083,19921921,19922493,19923027,19923306,19923604,19924075,19924646,19925733,19926201,19926560,19926813,19927468,19927724,19927937,19928098,19928406,19928585,19932734,19932832,19933051,19933208,19933386,19933581,19934953,19935147,19935829,19936024,19936126,19936330,19936533,19936740,19936802,19937035,19937231,19937311,19937608,19937763,19937890,19938438,19938635,19938731,19938941,19939119,19939327,19939492,19940720,19941174,19942512,19942722,19942997,1994391', 'assoc_port': '19762412:19762928,19764222:19765220,19771181:19771735,19772146:19772771,19772147:19773074,19773097:19789745,19774387:19785200,19774388:19787752,19775226:19783094,19775229:19781313,19776428:19779964,19776431:19779457,19777262:19778896,19791645:19792260,19792450:19792819,19797271:19797614,19797272:19798219,19800775:19802233,19806030:19806889,19808594:19808734,19809800:19810440,19811171:19811527,19815788:20073040,19815790:19816100,19819257:19820148,19821719:19840795,19822802:19824364,19833807:19948251,19833809:19947593,19833810:19834074,19835245:19946135,19835246:19946423,19835506:19945861,19837806:19945687,19837807:19945405,19837808:19945219,19837809:19838049,19837810:19841225,19839124:19839507,19843224:19942997,19843226:19843454,19843443:19944758,19843745:19944464,19844025:19944227,19844026:19943914,19844027:19844097,19845102:19942512,19845103:19942722,19845212:19847801,19845523:19847488,19850914:19941174,19852639:19940720,19852640:19854101,19856757:19939492,19856758:19939327,19856759:19939119,19858205:1993894', 'assoc_mat': '19762412:cartonnette:3726:19762928,19764222:cartonnette:3726:19765220,19771181:cartonnette:3726:19771735,19772146:cartonnette:3726:19772771,19772147:cartonnette:3726:19773074,19773097:cartonnette:3726:19789745,19774387:cartonnette:3726:19785200,19774388:cartonnette:3726:19787752,19775226:cartonnette:3726:19783094,19775229:cartonnette:3726:19781313,19776428:cartonnette:3726:19779964,19776431:cartonnette:3726:19779457,19777262:cartonnette:3726:19778896,19791645:cartonnette:3726:19792260,19792450:cartonnette:3726:19792819,19797271:cartonnette:3726:19797614,19797272:cartonnette:3726:19798219,19800775:cartonnette:3726:19802233,19806030:cartonnette:3726:19806889,19808594:cartonnette:3726:19808734,19809800:cartonnette:3726:19810440,19811171:cartonnette:3726:19811527,19815788:cartonnette:3726:20073040,19815790:cartonnette:3726:19816100,19819257:cartonnette:3726:19820148,19821719:cartonnette:3726:19840795,19822802:cartonnette:3726:19824364,19833807:cartonnette:3726:19948251,19833809:cartonnette:3726:19947593,19833810:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.008400345440782024, 'nb_photo': 615, 'list_port_cont': '19765228,19781328,19783096,19785191,19792261,19793047,19798214,19806892,19816109,19820142,19834069,19838058,19839506,19841218,19843445,19847483,19854102,19859901,19879542,19881647,19887795,19889439,19896768,19898105,19905869,19906635,19907210,19907363,19908729,19908946,19909551,19910590,19911562,19911909,19912679,19913248,19913262,19914266,19916857,19917218,19920080,19922698,19923309,19923864,19924640,19925742,19926005,19926198,19927469,19927722,19927936,19928101,19928401,19928583,19932738,19932827,19933059,19933213,19933395,19933587,19933961,19934952,19935145,19935628,19936018,19936198,19936539,19936735,19937313,19937476,19937755,19937884,19938307,19938447,19938637,19938734,19938949,19939114,19939321,19940715,19941169,19942508,19942716,19942993,19943918,19944235,19944473,19944751,19945404,19945688,19945858,19947587,19953095,19953655,19954535,19954992,19956254,19958857,19964563,19965172,19965476,19966088,19967549,19976804,19977536,19978856,19981009,19982082,19984262,19987191,19989705,19990210,19995974,2000655', 'assoc_port': '19764222:19765228,19774387:19785191,19775226:19783096,19775228:19781328,19791644:19793047,19791645:19792261,19797272:19798214,19806030:19806892,19815790:19816109,19819257:19820142,19833809:19947587,19833810:19834069,19835506:19945858,19837806:19945688,19837807:19945404,19837809:19838058,19837810:19841218,19839124:19839506,19843224:19942993,19843226:19843445,19843443:19944751,19843745:19944473,19844025:19944235,19844026:19943918,19845102:19942508,19845103:19942716,19845523:19847483,19850914:19941169,19852639:19940715,19852640:19854102,19856758:19939321,19856759:19939114,19858205:19938949,19858206:19938734,19858207:19938447,19858208:19938637,19858209:19938307,19859638:19937884,19859639:19937476,19859641:19937755,19859643:19937313,19859649:19859901,19861033:19936735,19861035:19936539,19861037:19936198,19861878:19936018,19862306:19935628,19878529:19934952,19878531:19935145,19878532:19879542,19881500:19881647,19883747:19933961,19884960:19933587,19884961:19933213,19884962:19933395,19886208:19887795,19888952:1993273', 'assoc_mat': '19764222:Carton_brun:3726:19765228,19774387:Carton_brun:3726:19785191,19775226:Carton_brun:3726:19783096,19775228:Carton_brun:3726:19781328,19791644:Carton_brun:3726:19793047,19791645:Carton_brun:3726:19792261,19797272:Carton_brun:3726:19798214,19806030:Carton_brun:3726:19806892,19815790:Carton_brun:3726:19816109,19819257:Carton_brun:3726:19820142,19833809:Carton_brun:3726:19947587,19833810:Carton_brun:3726:19834069,19835506:Carton_brun:3726:19945858,19837806:Carton_brun:3726:19945688,19837807:Carton_brun:3726:19945404,19837809:Carton_brun:3726:19838058,19837810:Carton_brun:3726:19841218,19839124:Carton_brun:3726:19839506,19843224:Carton_brun:3726:19942993,19843226:Carton_brun:3726:19843445,19843443:Carton_brun:3726:19944751,19843745:Carton_brun:3726:19944473,19844025:Carton_brun:3726:19944235,19844026:Carton_brun:3726:19943918,19845102:Carton_brun:3726:19942508,19845103:Carton_brun:3726:19942716,19845523:Carton_brun:3726:19847483,19850914:Carton_brun:3726:19941169,19852639:Carton_brun:3726:19940715,19852640:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.006848061334926263, 'nb_photo': 422, 'list_port_cont': '19765226,19773084,19779462,19781314,19781334,19783103,19785192,19787746,19788848,19789747,19792256,19792816,19797636,19798209,19801408,19802243,19805469,19808740,19810436,19811517,19816106,19820149,19824362,19834070,19838060,19839502,19841220,19843451,19844095,19847793,19859903,19868328,19879546,19881283,19881637,19896773,19898113,19907213,19907369,19909553,19910594,19911561,19911919,19912680,19913240,19913254,19914270,19917214,19917416,19917885,19918117,19919061,19919410,19919817,19920077,19921516,19921927,19922121,19922700,19923303,19924074,19924638,19925117,19925740,19926207,19926564,19926819,19927459,19927935,19928091,19928399,19928584,19932742,19932826,19933050,19933123,19933215,19933393,19933582,19934956,19935619,19935831,19936127,19936202,19936320,19936538,19936730,19936799,19937038,19937221,19937314,19937482,19937611,19937753,19938633,19938738,19938948,19939121,19939318,19939494,19940724,19941170,19942514,19942996,19944236,19944465,19945225,19945406,19945853,19946132,19946421,19947594,19948245,1995022', 'assoc_port': '19764222:19765226,19772147:19773084,19773097:19789747,19774386:19788848,19774387:19785192,19774388:19787746,19775226:19783103,19775228:19781334,19775229:19781314,19776431:19779462,19791645:19792256,19792450:19792816,19797271:19797636,19797272:19798209,19800775:19802243,19801172:19801408,19804718:19805469,19808594:19808740,19809800:19810436,19811171:19811517,19815788:20073038,19815790:19816106,19819257:19820149,19822802:19824362,19831693:19951096,19832669:19950221,19833807:19948245,19833809:19947594,19833810:19834070,19835245:19946132,19835246:19946421,19835506:19945853,19837807:19945406,19837808:19945225,19837809:19838060,19837810:19841220,19839124:19839502,19843224:19942996,19843226:19843451,19843745:19944465,19844025:19944236,19844027:19844095,19845102:19942514,19845212:19847793,19850914:19941170,19852639:19940724,19856757:19939494,19856758:19939318,19856759:19939121,19858205:19938948,19858206:19938738,19858208:19938633,19859639:19937482,19859640:19937611,19859641:19937753,19859643:19937314,19859644:1993722', 'assoc_mat': '19764222:Carton_gris:3726:19765226,19772147:Carton_gris:3726:19773084,19773097:Carton_gris:3726:19789747,19774386:Carton_gris:3726:19788848,19774387:Carton_gris:3726:19785192,19774388:Carton_gris:3726:19787746,19775226:Carton_gris:3726:19783103,19775228:Carton_gris:3726:19781334,19775229:Carton_gris:3726:19781314,19776431:Carton_gris:3726:19779462,19791645:Carton_gris:3726:19792256,19792450:Carton_gris:3726:19792816,19797271:Carton_gris:3726:19797636,19797272:Carton_gris:3726:19798209,19800775:Carton_gris:3726:19802243,19801172:Carton_gris:3726:19801408,19804718:Carton_gris:3726:19805469,19808594:Carton_gris:3726:19808740,19809800:Carton_gris:3726:19810436,19811171:Carton_gris:3726:19811517,19815788:Carton_gris:3726:20073038,19815790:Carton_gris:3726:19816106,19819257:Carton_gris:3726:19820149,19822802:Carton_gris:3726:19824362,19831693:Carton_gris:3726:19951096,19832669:Carton_gris:3726:19950221,19833807:Carton_gris:3726:19948245,19833809:Carton_gris:3726:19947594,19833810:Carton_gris:3726:19834070,19835245:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0018241158556058662, 'nb_photo': 63, 'list_port_cont': '19805466,19808733,19859907,19879545,19881290,19906633,19908731,19909550,19910588,19912683,19913239,19913259,19925743,19927465,19928095,19928577,19933124,19933591,19934959,19937881,19942989,19944467,19956245,19965179,19966092,19978850,19982079,20006564,20015509,20021724,20022318,20022770,20024910,20028068,20037659,20038437,20042898,20044609,20044681,20046361,20072051,20073654,20105470,20144824,20146073,20146746,20147503,20148874,20150037,20150550', 'assoc_port': '19804718:19805466,19808594:19808733,19843224:19942989,19843745:19944467,19859638:19937881,19859649:19859907,19878529:19934959,19878532:19879545,19880737:19881290,19884960:19933591,19886206:19933124,19895834:19928577,19895835:19928095,19895838:19927465,19897921:19913259,19897923:19913239,19900689:19912683,19902026:19910588,19903472:19909550,19904777:19908731,19906565:19906633,19917530:19925743,19955913:19956245,19964113:19965179,19965675:19966092,19978229:19978850,19980747:19982079,20006552:20006564,20013865:20024910,20015245:20015509,20019542:20021724,20021858:20022318,20022723:20022770,20028041:20028068,20037597:20037659,20038304:20038437,20042812:20042898,20044107:20044609,20044671:20044681,20046299:20046361,20071972:20072051,20073646:20073654,20105216:20105470,20122301:20150550,20122302:20150037,20138072:20148874,20138073:20147503,20138074:20146746,20138075:20146073,20138076:20144824', 'assoc_mat': '19804718:kraft:3726:19805466,19808594:kraft:3726:19808733,19843224:kraft:3726:19942989,19843745:kraft:3726:19944467,19859638:kraft:3726:19937881,19859649:kraft:3726:19859907,19878529:kraft:3726:19934959,19878532:kraft:3726:19879545,19880737:kraft:3726:19881290,19884960:kraft:3726:19933591,19886206:kraft:3726:19933124,19895834:kraft:3726:19928577,19895835:kraft:3726:19928095,19895838:kraft:3726:19927465,19897921:kraft:3726:19913259,19897923:kraft:3726:19913239,19900689:kraft:3726:19912683,19902026:kraft:3726:19910588,19903472:kraft:3726:19909550,19904777:kraft:3726:19908731,19906565:kraft:3726:19906633,19917530:kraft:3726:19925743,19955913:kraft:3726:19956245,19964113:kraft:3726:19965179,19965675:kraft:3726:19966092,19978229:kraft:3726:19978850,19980747:kraft:3726:19982079,20006552:kraft:3726:20006564,20013865:kraft:3726:20024910,20015245:kraft:3726:20015509,20019542:kraft:3726:20021724,20021858:kraft:3726:20022318,20022723:kraft:3726:20022770,20028041:kraft:3726:20028068,20037597:kraft:3726:20037659,20038304:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0017509069615176415, 'nb_photo': 33, 'list_port_cont': '19781312,19824369,19896775,19909554,19911911,19923860,19926563,19927732,19953099,19964564,19987195,20027941,20038433,20042900,20046078,20046362,20048204,20082923,20115358,20128951,20137163,20138088,20144826,20146066,20146744,20148871,20150042', 'assoc_port': '19775229:19781312,19822802:19824369,19895840:19927732,19895841:19896775,19902028:19911911,19903472:19909554,19916734:19926563,19921578:19923860,19951810:19953099,19964114:19964564,19986537:19987195,20027882:20027941,20038304:20038433,20042812:20042900,20045933:20046078,20046299:20046362,20048159:20048204,20081910:20082923,20115261:20115358,20122302:20150042,20122303:20137163,20125012:20128951,20138072:20148871,20138074:20146744,20138075:20146066,20138076:20144826,20138078:20138088', 'assoc_mat': '19775229:metal:3726:19781312,19822802:metal:3726:19824369,19895840:metal:3726:19927732,19895841:metal:3726:19896775,19902028:metal:3726:19911911,19903472:metal:3726:19909554,19916734:metal:3726:19926563,19921578:metal:3726:19923860,19951810:metal:3726:19953099,19964114:metal:3726:19964564,19986537:metal:3726:19987195,20027882:metal:3726:20027941,20038304:metal:3726:20038433,20042812:metal:3726:20042900,20045933:metal:3726:20046078,20046299:metal:3726:20046362,20048159:metal:3726:20048204,20081910:metal:3726:20082923,20115261:metal:3726:20115358,20122302:metal:3726:20150042,20122303:metal:3726:20137163,20125012:metal:3726:20128951,20138072:metal:3726:20148871,20138074:metal:3726:20146744,20138075:metal:3726:20146066,20138076:metal:3726:20144826,20138078:metal:3726:20138088'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004858323947006404, 'nb_photo': 559, 'list_port_cont': '19762932,19765217,19771738,19776668,19778902,19781307,19785195,19787749,19788853,19789750,19792251,19792815,19793046,19797622,19798217,19801404,19802238,19805471,19808729,19810438,19811525,19816110,19820143,19824370,19834071,19838051,19839509,19841226,19843447,19844103,19847481,19847796,19850869,19854106,19859905,19879541,19881640,19887792,19896774,19898108,19905867,19906627,19907211,19907370,19908740,19908953,19909558,19910591,19911566,19911918,19912688,19913244,19913255,19914273,19916853,19917217,19917887,19918115,19919052,19919399,19919823,19920079,19921512,19921923,19922122,19922489,19922693,19923028,19923302,19923603,19923865,19924068,19924649,19925113,19926566,19926815,19927466,19927727,19927945,19928102,19928403,19928579,19932735,19933055,19933217,19933586,19933970,19934948,19935142,19935620,19935824,19936199,19936323,19936542,19936797,19937039,19937483,19937615,19938302,19938444,19938640,19938946,19939113,19939324,19939500,19940718,19941173,19942990,19943922,19944232,19944469,19944757,19946418,1994825', 'assoc_port': '19762412:19762932,19764222:19765217,19771181:19771738,19773097:19789750,19774386:19788853,19774387:19785195,19774388:19787749,19775229:19781307,19776429:19776668,19777262:19778902,19791644:19793046,19791645:19792251,19792450:19792815,19797271:19797622,19797272:19798217,19800775:19802238,19801172:19801404,19804718:19805471,19808594:19808729,19809800:19810438,19811171:19811525,19815788:20073046,19815790:19816110,19819257:19820143,19822802:19824370,19831693:19951095,19833807:19948255,19833810:19834071,19835246:19946418,19837809:19838051,19837810:19841226,19839124:19839509,19843224:19942990,19843226:19843447,19843443:19944757,19843745:19944469,19844025:19944232,19844026:19943922,19844027:19844103,19845212:19847796,19845523:19847481,19849898:19850869,19850914:19941173,19852639:19940718,19852640:19854106,19856757:19939500,19856758:19939324,19856759:19939113,19858205:19938946,19858207:19938444,19858208:19938640,19858209:19938302,19859639:19937483,19859640:19937615,19859646:19936797,19859647:19937039,19859649:1985990', 'assoc_mat': '19762412:plastique:3726:19762932,19764222:plastique:3726:19765217,19771181:plastique:3726:19771738,19773097:plastique:3726:19789750,19774386:plastique:3726:19788853,19774387:plastique:3726:19785195,19774388:plastique:3726:19787749,19775229:plastique:3726:19781307,19776429:plastique:3726:19776668,19777262:plastique:3726:19778902,19791644:plastique:3726:19793046,19791645:plastique:3726:19792251,19792450:plastique:3726:19792815,19797271:plastique:3726:19797622,19797272:plastique:3726:19798217,19800775:plastique:3726:19802238,19801172:plastique:3726:19801404,19804718:plastique:3726:19805471,19808594:plastique:3726:19808729,19809800:plastique:3726:19810438,19811171:plastique:3726:19811525,19815788:plastique:3726:20073046,19815790:plastique:3726:19816110,19819257:plastique:3726:19820143,19822802:plastique:3726:19824370,19831693:plastique:3726:19951095,19833807:plastique:3726:19948255,19833810:plastique:3726:19834071,19835246:plastique:3726:19946418,19837809:plastique:3726:19838051,19837810:plastique:3726:19841226,1'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007494943126820162, 'nb_photo': 990, 'list_port_cont': '19762927,19765225,19771732,19773081,19778901,19779463,19779956,19781308,19781332,19783093,19785193,19789751,19792252,19792817,19793050,19797632,19798212,19801407,19802244,19805467,19806888,19808737,19810439,19811521,19816102,19819478,19820144,19834068,19839508,19841223,19843446,19844102,19847484,19847799,19850874,19854099,19859909,19879548,19881287,19881646,19887799,19889441,19896767,19898103,19905861,19906637,19907215,19907365,19908739,19908947,19909557,19910597,19911557,19911914,19912678,19913247,19913260,19914275,19916854,19917221,19917421,19917461,19917889,19918121,19919062,19919401,19919826,19920074,19921514,19921919,19922126,19922494,19922691,19923031,19923301,19923608,19923870,19924067,19924645,19925108,19925734,19925998,19926204,19926570,19926811,19927467,19927729,19927940,19928100,19928410,19928578,19932731,19932830,19933060,19933128,19933206,19933388,19933585,19933834,19933963,19934791,19934949,19935146,19935624,19935828,19936203,19936324,19936537,19936737,19936804,19937036,19937220,19937316,1993748', 'assoc_port': '19762412:19762927,19764222:19765225,19771181:19771732,19772147:19773081,19773097:19789751,19774387:19785193,19775226:19783093,19775228:19781332,19775229:19781308,19776428:19779956,19776431:19779463,19777262:19778901,19791644:19793050,19791645:19792252,19792450:19792817,19797271:19797632,19797272:19798212,19800775:19802244,19801172:19801407,19804718:19805467,19806030:19806888,19808594:19808737,19809800:19810439,19811171:19811521,19815788:20073037,19815790:19816102,19819257:19820144,19819258:19819478,19831693:19951103,19833807:19948247,19833809:19947597,19833810:19834068,19835245:19946137,19835246:19946419,19837806:19945686,19837807:19945401,19837808:19945220,19837810:19841223,19839124:19839508,19843224:19943000,19843226:19843446,19843443:19944748,19843745:19944462,19844025:19944229,19844026:19943915,19844027:19844102,19845102:19942513,19845103:19942713,19845212:19847799,19845523:19847484,19849898:19850874,19850914:19941168,19852639:19940719,19852640:19854099,19856757:19939491,19856758:19939319,19856759:1993912', 'assoc_mat': '19762412:Teint_Dans_La_Masse:3726:19762927,19764222:Teint_Dans_La_Masse:3726:19765225,19771181:Teint_Dans_La_Masse:3726:19771732,19772147:Teint_Dans_La_Masse:3726:19773081,19773097:Teint_Dans_La_Masse:3726:19789751,19774387:Teint_Dans_La_Masse:3726:19785193,19775226:Teint_Dans_La_Masse:3726:19783093,19775228:Teint_Dans_La_Masse:3726:19781332,19775229:Teint_Dans_La_Masse:3726:19781308,19776428:Teint_Dans_La_Masse:3726:19779956,19776431:Teint_Dans_La_Masse:3726:19779463,19777262:Teint_Dans_La_Masse:3726:19778901,19791644:Teint_Dans_La_Masse:3726:19793050,19791645:Teint_Dans_La_Masse:3726:19792252,19792450:Teint_Dans_La_Masse:3726:19792817,19797271:Teint_Dans_La_Masse:3726:19797632,19797272:Teint_Dans_La_Masse:3726:19798212,19800775:Teint_Dans_La_Masse:3726:19802244,19801172:Teint_Dans_La_Masse:3726:19801407,19804718:Teint_Dans_La_Masse:3726:19805467,19806030:Teint_Dans_La_Masse:3726:19806888,19808594:Teint_Dans_La_Masse:3726:19808737,19809800:Teint_Dans_La_Masse:3726:19810439,19811171:Teint_Dans_La_Masse:3726:1'}), 'main_stat': {'nb_photos': 28976}}, 'hostname': (), 'impurety_average_per_hashtag': []} filepath : /data_2/data_log/job/memo/arc_en_ciel_jrm_peu_dense/sla_mensuel_arc_en_ciel_jrm_peu_dense_mois_01_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'JRM': {'autre_refus': ['autre_refus', '0.68%', 348], 'cartonnette': ['cartonnette', '0.6%', 666], 'Carton_brun': ['Carton_brun', '0.84%', 615], 'Carton_gris': ['Carton_gris', '0.68%', 422], 'kraft': ['kraft', '0.18%', 63], 'metal': ['metal', '0.18%', 33], 'plastique': ['plastique', '0.49%', 559], 'Teint_Dans_La_Masse': ['Teint_Dans_La_Masse', '0.75%', 990]}} before organize_and_plot_impurety_average_data before organize_and_plot_quality_photo_data finish generating filepath : /data_2/data_log/job/memo/arc_en_ciel_jrm_peu_dense/sla_mensuel_arc_en_ciel_jrm_peu_dense_mois_01_annee_2025.pdf le fichier se trouve ici : /data_2/data_log/job/memo/arc_en_ciel_jrm_peu_dense 2.78user 2.94system 0:09.06elapsed 63%CPU (0avgtext+0avgdata 193592maxresident)k 15400inputs+392outputs (1major+76203minor)pagefaults 0swaps