python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=30005 --dashboard_places=sevran --rootfolder_sla=/data_4/data_log/job/memo/sevran -v --mtr_id=1042 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 30005, Date : 2025-10 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (2, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4887 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4887 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4887 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4887 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Inconsistency in dashboard_places dashboard_places from input : sevran dashboard_name_from_port found from datou STS from crontab from raspi : Sevran We force the correct camera_place_name ! TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Sevran"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4101 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4101 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4101 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4101 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (2, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4887 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4887 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4887 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4887 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Sevran"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4101 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4101 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4101 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4101 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 94 month : 10 mtr_id : 1042 dashboard_places : Sevran date : 2025-10 year : 2025 raspi : 30005 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'Sevran' and date like '%2025-10%') and created_at like '%2025-10%'))); nb_day : (2, 31) after unwanted_material_data nb_day : (2, 31) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%30005%' AND ms.result_str like '%2025/10%'ORDER BY ms.id desc LIMIT 0, 1000000; No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 1841, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1841, 'last_update': '2025/11/06', 'portfolio_id': 27984116, 'last_run_id': 2507905, 'total_number_of_photos': 6717}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 1841, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1841, 'last_update': '2025/11/03', 'portfolio_id': 27984116, 'last_run_id': 2507905, 'total_number_of_photos': 6717}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 1719, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 31, 'nb_images_started': 1019, 'nb_selected_images': 2738, 'last_update': '2025/11/04', 'portfolio_id': 27928780, 'last_run_id': 2507897, 'total_number_of_photos': 5998}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 1841, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1841, 'last_update': '2025/11/03', 'portfolio_id': 27984116, 'last_run_id': 2507905, 'total_number_of_photos': 6717}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 1719, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 31, 'nb_images_started': 1019, 'nb_selected_images': 2738, 'last_update': '2025/11/04', 'portfolio_id': 27928780, 'last_run_id': 2507897, 'total_number_of_photos': 5998}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 388, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 844, 'nb_selected_images': 1232, 'last_update': '2025/11/03', 'portfolio_id': 27909519, 'last_run_id': 2507849, 'total_number_of_photos': 3558}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 1841, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1841, 'last_update': '2025/11/03', 'portfolio_id': 27984116, 'last_run_id': 2507905, 'total_number_of_photos': 6717}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 1719, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 31, 'nb_images_started': 1019, 'nb_selected_images': 2738, 'last_update': '2025/11/04', 'portfolio_id': 27928780, 'last_run_id': 2507897, 'total_number_of_photos': 5998}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 388, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 7, 'nb_images_started': 844, 'nb_selected_images': 1232, 'last_update': '2025/11/03', 'portfolio_id': 27909519, 'last_run_id': 2507849, 'total_number_of_photos': 3558}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 4, 'nb_images_finished': 92, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 20, 'nb_images_started': 479, 'nb_selected_images': 571, 'last_update': '2025/11/04', 'portfolio_id': 27909429, 'last_run_id': 2507817, 'total_number_of_photos': 3060}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 884, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 957, 'nb_selected_images': 1841, 'last_update': '2025/11/03', 'portfolio_id': 27984116, 'last_run_id': 2498311, 'total_number_of_photos': 6717}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 18, 'nb_images_finished': 983, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 798, 'nb_selected_images': 1781, 'last_update': '2025/11/03', 'portfolio_id': 27928780, 'last_run_id': 2489821, 'total_number_of_photos': 5998}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 1190, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1190, 'last_update': '2025/11/01', 'portfolio_id': 27909519, 'last_run_id': 2482049, 'total_number_of_photos': 3558}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 156, 'nb_selected_images': 156, 'last_update': '2025/10/29', 'portfolio_id': 27909429, 'last_run_id': 2477335, 'total_number_of_photos': 3060}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 142, 'nb_selected_images': 142, 'last_update': '2025/10/29', 'portfolio_id': 27909405, 'last_run_id': 2477345, 'total_number_of_photos': 1770}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 884, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 10, 'nb_images_started': 957, 'nb_selected_images': 1841, 'last_update': '2025/11/01', 'portfolio_id': 27984116, 'last_run_id': 2498311, 'total_number_of_photos': 6717}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 18, 'nb_images_finished': 983, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 798, 'nb_selected_images': 1781, 'last_update': '2025/11/01', 'portfolio_id': 27928780, 'last_run_id': 2489821, 'total_number_of_photos': 5998}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 1190, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1190, 'last_update': '2025/11/01', 'portfolio_id': 27909519, 'last_run_id': 2482049, 'total_number_of_photos': 3558}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 156, 'nb_selected_images': 156, 'last_update': '2025/10/29', 'portfolio_id': 27909429, 'last_run_id': 2477335, 'total_number_of_photos': 3060}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 142, 'nb_selected_images': 142, 'last_update': '2025/10/29', 'portfolio_id': 27909405, 'last_run_id': 2477345, 'total_number_of_photos': 1770}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 18, 'nb_images_finished': 983, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 798, 'nb_selected_images': 1781, 'last_update': '2025/10/31', 'portfolio_id': 27928780, 'last_run_id': 2489821, 'total_number_of_photos': 5998}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 1190, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1190, 'last_update': '2025/10/30', 'portfolio_id': 27909519, 'last_run_id': 2482049, 'total_number_of_photos': 3558}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 156, 'nb_selected_images': 156, 'last_update': '2025/10/29', 'portfolio_id': 27909429, 'last_run_id': 2477335, 'total_number_of_photos': 3060}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 142, 'nb_selected_images': 142, 'last_update': '2025/10/29', 'portfolio_id': 27909405, 'last_run_id': 2477345, 'total_number_of_photos': 1770}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 1190, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1190, 'last_update': '2025/10/30', 'portfolio_id': 27909519, 'last_run_id': 2481359, 'total_number_of_photos': 3558}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 156, 'nb_selected_images': 156, 'last_update': '2025/10/29', 'portfolio_id': 27909429, 'last_run_id': 2477335, 'total_number_of_photos': 3060}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 142, 'nb_selected_images': 142, 'last_update': '2025/10/29', 'portfolio_id': 27909405, 'last_run_id': 2477345, 'total_number_of_photos': 1770}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 432, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 432, 'last_update': '2025/10/19', 'portfolio_id': 27896763, 'last_run_id': 2477195, 'total_number_of_photos': 3642}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 761, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 761, 'last_update': '2025/10/18', 'portfolio_id': 27870362, 'last_run_id': 2475127, 'total_number_of_photos': 7353}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 9, 'nb_images_finished': 161, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 848, 'nb_selected_images': 1009, 'last_update': '2025/10/18', 'portfolio_id': 27849582, 'last_run_id': 2470113, 'total_number_of_photos': 5247}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 2170, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2170, 'last_update': '2025/10/18', 'portfolio_id': 27818016, 'last_run_id': 2467723, 'total_number_of_photos': 6912}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 1052, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 79, 'nb_selected_images': 1131, 'last_update': '2025/10/16', 'portfolio_id': 27777892, 'last_run_id': 2460067, 'total_number_of_photos': 7471}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 2412, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2412, 'last_update': '2025/10/14', 'portfolio_id': 27746291, 'last_run_id': 2451685, 'total_number_of_photos': 6968}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 761, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 761, 'last_update': '2025/10/18', 'portfolio_id': 27870362, 'last_run_id': 2475127, 'total_number_of_photos': 7353}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 9, 'nb_images_finished': 161, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 9, 'nb_images_started': 848, 'nb_selected_images': 1009, 'last_update': '2025/10/18', 'portfolio_id': 27849582, 'last_run_id': 2470113, 'total_number_of_photos': 5241}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 2170, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2170, 'last_update': '2025/10/18', 'portfolio_id': 27818016, 'last_run_id': 2467723, 'total_number_of_photos': 6912}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 1052, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 79, 'nb_selected_images': 1131, 'last_update': '2025/10/16', 'portfolio_id': 27777892, 'last_run_id': 2460067, 'total_number_of_photos': 7471}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 2412, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2412, 'last_update': '2025/10/14', 'portfolio_id': 27746291, 'last_run_id': 2451685, 'total_number_of_photos': 6968}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 1788, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1788, 'last_update': '2025/10/12', 'portfolio_id': 27720008, 'last_run_id': 2442299, 'total_number_of_photos': 8113}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 2170, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2170, 'last_update': '2025/10/16', 'portfolio_id': 27818016, 'last_run_id': 2466889, 'total_number_of_photos': 6912}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 1052, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 79, 'nb_selected_images': 1131, 'last_update': '2025/10/16', 'portfolio_id': 27777892, 'last_run_id': 2460067, 'total_number_of_photos': 7471}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 2412, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2412, 'last_update': '2025/10/14', 'portfolio_id': 27746291, 'last_run_id': 2451685, 'total_number_of_photos': 6968}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 1788, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1788, 'last_update': '2025/10/12', 'portfolio_id': 27720008, 'last_run_id': 2442299, 'total_number_of_photos': 8113}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 42, 'nb_images_finished': 2264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2264, 'last_update': '2025/10/11', 'portfolio_id': 27666958, 'last_run_id': 2438025, 'total_number_of_photos': 7357}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 91, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 925, 'nb_selected_images': 1016, 'last_update': '2025/10/11', 'portfolio_id': 27616361, 'last_run_id': 2431413, 'total_number_of_photos': 7837}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 20, 'nb_images_finished': 1052, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 79, 'nb_selected_images': 1131, 'last_update': '2025/10/15', 'portfolio_id': 27777892, 'last_run_id': 2458899, 'total_number_of_photos': 7471}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 2412, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2412, 'last_update': '2025/10/14', 'portfolio_id': 27746291, 'last_run_id': 2451685, 'total_number_of_photos': 6968}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 1788, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1788, 'last_update': '2025/10/12', 'portfolio_id': 27720008, 'last_run_id': 2442299, 'total_number_of_photos': 8113}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 42, 'nb_images_finished': 2264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2264, 'last_update': '2025/10/11', 'portfolio_id': 27666958, 'last_run_id': 2438025, 'total_number_of_photos': 7357}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 91, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 925, 'nb_selected_images': 1016, 'last_update': '2025/10/11', 'portfolio_id': 27616361, 'last_run_id': 2431413, 'total_number_of_photos': 7837}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 981, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 20, 'nb_images_started': 1125, 'nb_selected_images': 2106, 'last_update': '2025/10/11', 'portfolio_id': 27570558, 'last_run_id': 2423633, 'total_number_of_photos': 8224}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 2412, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2412, 'last_update': '2025/10/14', 'portfolio_id': 27746291, 'last_run_id': 2451685, 'total_number_of_photos': 6968}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 1788, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1788, 'last_update': '2025/10/12', 'portfolio_id': 27720008, 'last_run_id': 2442299, 'total_number_of_photos': 8113}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 42, 'nb_images_finished': 2264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2264, 'last_update': '2025/10/11', 'portfolio_id': 27666958, 'last_run_id': 2438025, 'total_number_of_photos': 7357}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 91, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 925, 'nb_selected_images': 1016, 'last_update': '2025/10/11', 'portfolio_id': 27616361, 'last_run_id': 2431413, 'total_number_of_photos': 7837}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 981, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 20, 'nb_images_started': 1125, 'nb_selected_images': 2106, 'last_update': '2025/10/11', 'portfolio_id': 27570558, 'last_run_id': 2423633, 'total_number_of_photos': 8224}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 1016, 'nb_selected_images': 1016, 'last_update': '2025/10/11', 'portfolio_id': 27544532, 'last_run_id': 2417591, 'total_number_of_photos': 7539}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 1788, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1788, 'last_update': '2025/10/12', 'portfolio_id': 27720008, 'last_run_id': 2442299, 'total_number_of_photos': 8113}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 42, 'nb_images_finished': 2264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2264, 'last_update': '2025/10/11', 'portfolio_id': 27666958, 'last_run_id': 2438025, 'total_number_of_photos': 7357}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 91, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 925, 'nb_selected_images': 1016, 'last_update': '2025/10/11', 'portfolio_id': 27616361, 'last_run_id': 2431413, 'total_number_of_photos': 7837}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 981, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 20, 'nb_images_started': 1125, 'nb_selected_images': 2106, 'last_update': '2025/10/11', 'portfolio_id': 27570558, 'last_run_id': 2423633, 'total_number_of_photos': 8224}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 1016, 'nb_selected_images': 1016, 'last_update': '2025/10/11', 'portfolio_id': 27544532, 'last_run_id': 2417591, 'total_number_of_photos': 7539}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 20, 'nb_images_started': 1061, 'nb_selected_images': 1061, 'last_update': '2025/10/11', 'portfolio_id': 27519418, 'last_run_id': 2414459, 'total_number_of_photos': 7154}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 1788, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1788, 'last_update': '2025/10/12', 'portfolio_id': 27720008, 'last_run_id': 2442299, 'total_number_of_photos': 8113}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 42, 'nb_images_finished': 2264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2264, 'last_update': '2025/10/11', 'portfolio_id': 27666958, 'last_run_id': 2438025, 'total_number_of_photos': 7357}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 91, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 925, 'nb_selected_images': 1016, 'last_update': '2025/10/11', 'portfolio_id': 27616361, 'last_run_id': 2431413, 'total_number_of_photos': 7837}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 981, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 20, 'nb_images_started': 1125, 'nb_selected_images': 2106, 'last_update': '2025/10/11', 'portfolio_id': 27570558, 'last_run_id': 2423633, 'total_number_of_photos': 8224}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 1016, 'nb_selected_images': 1016, 'last_update': '2025/10/11', 'portfolio_id': 27544532, 'last_run_id': 2417591, 'total_number_of_photos': 7539}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 20, 'nb_images_started': 1061, 'nb_selected_images': 1061, 'last_update': '2025/10/11', 'portfolio_id': 27519418, 'last_run_id': 2414459, 'total_number_of_photos': 7154}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 42, 'nb_images_finished': 2264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2264, 'last_update': '2025/10/11', 'portfolio_id': 27666958, 'last_run_id': 2438025, 'total_number_of_photos': 7357}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 91, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 925, 'nb_selected_images': 1016, 'last_update': '2025/10/11', 'portfolio_id': 27616361, 'last_run_id': 2431413, 'total_number_of_photos': 7837}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 981, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 20, 'nb_images_started': 1125, 'nb_selected_images': 2106, 'last_update': '2025/10/11', 'portfolio_id': 27570558, 'last_run_id': 2423633, 'total_number_of_photos': 8224}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 1016, 'nb_selected_images': 1016, 'last_update': '2025/10/11', 'portfolio_id': 27544532, 'last_run_id': 2417591, 'total_number_of_photos': 7539}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 20, 'nb_images_started': 1061, 'nb_selected_images': 1061, 'last_update': '2025/10/11', 'portfolio_id': 27519418, 'last_run_id': 2414459, 'total_number_of_photos': 7154}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 55, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 55, 'last_update': '2025/10/05', 'portfolio_id': 27507844, 'last_run_id': 2404349, 'total_number_of_photos': 6986}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 981, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 20, 'nb_images_started': 1125, 'nb_selected_images': 2106, 'last_update': '2025/10/10', 'portfolio_id': 27570558, 'last_run_id': 2423633, 'total_number_of_photos': 8224}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 1016, 'nb_selected_images': 1016, 'last_update': '2025/10/09', 'portfolio_id': 27544532, 'last_run_id': 2417591, 'total_number_of_photos': 7539}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 20, 'nb_images_started': 1061, 'nb_selected_images': 1061, 'last_update': '2025/10/09', 'portfolio_id': 27519418, 'last_run_id': 2414459, 'total_number_of_photos': 7154}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 55, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 55, 'last_update': '2025/10/05', 'portfolio_id': 27507844, 'last_run_id': 2404349, 'total_number_of_photos': 6986}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2090, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2090, 'last_update': '2025/10/04', 'portfolio_id': 27462344, 'last_run_id': 2401783, 'total_number_of_photos': 7901}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 411, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 625, 'nb_selected_images': 1036, 'last_update': '2025/10/08', 'portfolio_id': 27570558, 'last_run_id': 2416763, 'total_number_of_photos': 8224}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 1016, 'nb_selected_images': 1016, 'last_update': '2025/10/09', 'portfolio_id': 27544532, 'last_run_id': 2417591, 'total_number_of_photos': 7539}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 20, 'nb_images_started': 1061, 'nb_selected_images': 1061, 'last_update': '2025/10/08', 'portfolio_id': 27519418, 'last_run_id': 2414459, 'total_number_of_photos': 7154}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 55, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 55, 'last_update': '2025/10/05', 'portfolio_id': 27507844, 'last_run_id': 2404349, 'total_number_of_photos': 6986}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2090, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2090, 'last_update': '2025/10/04', 'portfolio_id': 27462344, 'last_run_id': 2401783, 'total_number_of_photos': 7901}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 37, 'nb_images_finished': 2175, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2175, 'last_update': '2025/10/04', 'portfolio_id': 27424617, 'last_run_id': 2394417, 'total_number_of_photos': 7621}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/10/06', 'portfolio_id': 27519418, 'last_run_id': 2404883, 'total_number_of_photos': 7154}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 55, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 55, 'last_update': '2025/10/05', 'portfolio_id': 27507844, 'last_run_id': 2404349, 'total_number_of_photos': 6986}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2090, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2090, 'last_update': '2025/10/04', 'portfolio_id': 27462344, 'last_run_id': 2401783, 'total_number_of_photos': 7901}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 37, 'nb_images_finished': 2175, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2175, 'last_update': '2025/10/04', 'portfolio_id': 27424617, 'last_run_id': 2394417, 'total_number_of_photos': 7621}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 2238, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2238, 'last_update': '2025/10/04', 'portfolio_id': 27375684, 'last_run_id': 2387085, 'total_number_of_photos': 7810}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/10/06', 'portfolio_id': 27519418, 'last_run_id': 2404883, 'total_number_of_photos': 7154}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 55, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 55, 'last_update': '2025/10/05', 'portfolio_id': 27507844, 'last_run_id': 2404349, 'total_number_of_photos': 6986}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2090, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2090, 'last_update': '2025/10/04', 'portfolio_id': 27462344, 'last_run_id': 2401783, 'total_number_of_photos': 7901}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 37, 'nb_images_finished': 2175, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2175, 'last_update': '2025/10/04', 'portfolio_id': 27424617, 'last_run_id': 2394417, 'total_number_of_photos': 7621}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 2238, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2238, 'last_update': '2025/10/04', 'portfolio_id': 27375684, 'last_run_id': 2387085, 'total_number_of_photos': 7810}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 55, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 55, 'last_update': '2025/10/05', 'portfolio_id': 27507844, 'last_run_id': 2404349, 'total_number_of_photos': 6986}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2090, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2090, 'last_update': '2025/10/04', 'portfolio_id': 27462344, 'last_run_id': 2401783, 'total_number_of_photos': 7901}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 37, 'nb_images_finished': 2175, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2175, 'last_update': '2025/10/04', 'portfolio_id': 27424617, 'last_run_id': 2394417, 'total_number_of_photos': 7621}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 2238, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2238, 'last_update': '2025/10/04', 'portfolio_id': 27375684, 'last_run_id': 2387085, 'total_number_of_photos': 7810}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 2, 'nb_images_finished': 55, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 55, 'last_update': '2025/10/05', 'portfolio_id': 27507844, 'last_run_id': 2404349, 'total_number_of_photos': 6986}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2090, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2090, 'last_update': '2025/10/04', 'portfolio_id': 27462344, 'last_run_id': 2401783, 'total_number_of_photos': 7901}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 37, 'nb_images_finished': 2175, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2175, 'last_update': '2025/10/04', 'portfolio_id': 27424617, 'last_run_id': 2394417, 'total_number_of_photos': 7621}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 2238, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2238, 'last_update': '2025/10/04', 'portfolio_id': 27375684, 'last_run_id': 2387085, 'total_number_of_photos': 7810}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 2090, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2090, 'last_update': '2025/10/04', 'portfolio_id': 27462344, 'last_run_id': 2401783, 'total_number_of_photos': 7901}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 37, 'nb_images_finished': 2175, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2175, 'last_update': '2025/10/04', 'portfolio_id': 27424617, 'last_run_id': 2394417, 'total_number_of_photos': 7621}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 2238, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2238, 'last_update': '2025/10/04', 'portfolio_id': 27375684, 'last_run_id': 2387085, 'total_number_of_photos': 7810}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 37, 'nb_images_finished': 2175, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2175, 'last_update': '2025/10/03', 'portfolio_id': 27424617, 'last_run_id': 2394417, 'total_number_of_photos': 7621}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 2238, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2238, 'last_update': '2025/10/03', 'portfolio_id': 27375684, 'last_run_id': 2387085, 'total_number_of_photos': 7810}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 40, 'nb_images_finished': 2238, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2238, 'last_update': '2025/10/02', 'portfolio_id': 27375684, 'last_run_id': 2386615, 'total_number_of_photos': 7795}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Found day : 2025-10-31 00:00:00 Found day : 2025-10-30 00:00:00 Found day : 2025-10-29 00:00:00 Found day : 2025-10-28 00:00:00 Found day : 2025-10-27 00:00:00 Found day : 2025-10-25 00:00:00 Found day : 2025-10-24 00:00:00 Found day : 2025-10-23 00:00:00 Found day : 2025-10-18 00:00:00 Found day : 2025-10-17 00:00:00 Found day : 2025-10-16 00:00:00 Found day : 2025-10-15 00:00:00 Found day : 2025-10-14 00:00:00 Found day : 2025-10-13 00:00:00 Found day : 2025-10-11 00:00:00 Found day : 2025-10-10 00:00:00 Found day : 2025-10-09 00:00:00 Found day : 2025-10-08 00:00:00 Found day : 2025-10-07 00:00:00 Found day : 2025-10-06 00:00:00 Found day : 2025-10-04 00:00:00 Found day : 2025-10-03 00:00:00 Found day : 2025-10-02 00:00:00 Found day : 2025-10-01 00:00:00 Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-10-20 00:00:00,2025-10-21 00:00:00,2025-10-22 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where ded.dashboard_place_id = 94 and month(ded.date) = 10 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______pcnc' and ded.dashboard_place_id = 94 and month(ded.date) = 10 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______refus' and ded.dashboard_place_id = 94 and month(ded.date) = 10 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______film_pedb' and ded.dashboard_place_id = 94 and month(ded.date) = 10 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______pet_clair' and ded.dashboard_place_id = 94 and month(ded.date) = 10 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 94 and mp.name like '%102025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-10-01 : dt_date_just_month_year : 2025-10-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "Sevran" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-10-01" AND ded.date <= "2025-10-31" apple3 {'emr': {'mat': 'emr', 'pht': 4207, 'datou_carac_id': 3993, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'carton,background'}, 'pcm': {'mat': 'pcm', 'pht': 4209, 'datou_carac_id': 3994, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'pcnc': {'mat': 'pcnc', 'pht': 4207, 'datou_carac_id': 3993, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'carton,background'}, 'jrm': {'mat': 'jrm', 'pht': 3726, 'datou_carac_id': 3459, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'ela': {'mat': 'ela', 'pht': 4203, 'datou_carac_id': 3991, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'ela,background'}, 'pet_clair': {'mat': 'pet_clair', 'pht': 3327, 'datou_carac_id': 3804, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_clair,bouchon,etiquette,barquette_avec_film,background'}, 'film_pedb': {'mat': 'film_pedb', 'pht': 4461, 'datou_carac_id': 4322, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'film_plastique'}, 'pehd_pp': {'mat': 'pehd_pp', 'pht': 4211, 'datou_carac_id': 3995, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pehd,background'}, 'flux_dev': {'mat': 'flux_dev', 'pht': 4200, 'datou_carac_id': 4153, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_fonce,background'}, 'aluminium': {'mat': 'aluminium', 'pht': 4205, 'datou_carac_id': 3992, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'metal,background'}, 'refus': {'mat': 'refus', 'pht': 3594, 'datou_carac_id': 3318, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'refus,background'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (2387085,2394417,2401783,2404349,2404603,2414459,2417591,2423633,2431413,2438025,2442299,2443095,2451685,2460067,2467723,2470113,2475127,2507777,2507779,2507941,2508051,2508105,2507813,2507817,2507849,2507897,2507905) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id AND ptp.type IN (4207,4209,4207,3726,4203,3327,4461,4211,4200,4205,3594) group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.012918205022582627, 'nb_photo': 5, 'list_port_cont': '27463580,28108207', 'assoc_port': '27463495:27463580,28107855:28108207', 'assoc_mat': '27463495:autre:3327:27463580,28107855:autre:3327:28108207'}, {'unwanted_material': 'autre', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0013341026203662505, 'nb_photo': 334, 'list_port_cont': '27420354,27421103,27421493,27422890,27423794,27464702,27464706,27464912,27465076,27465292,27465618,27465960,27501479,27501851,27501934,27502239,27502374,27502556,27502674,27503452,27503951,27509211,27510363,27584011,27592768,27593254,27594099,27594587,27595476,27601087,27608774,27641941,27642332,27686193,27691923,27692566,27693736,27696625,27697234,27697488,27697788,27698266,27700879,27708285,27710400,27711862,27715471,27724731,27727323,27728093,27729650,27735013,27735964,27739528,27750073,27756621,27756765,27756853,27757483,27766909,27771139,27771760,27774735,27795790,27799611,27805802,27827728,27828029,27836605,27836727,27837545,27837752,27839495,27844340,27868749,27875838,27875994,27876255,27879627,27886729,27888908,27891182,27909611,27909640,27930553,27945512,27947028,28020305,28025692,28044516,28107784,28108298,28108747,28109214,28109516,28109958,28113232,28113623,28115916,28116271,28116615,28117028,28117408,28118105,28119308,28120108,28121845,28122432,28122742,28123043,28123372,28123926,28124936,2812535', 'assoc_port': '27418735:27421493,27418745:27421103,27418746:27423794,27418755:27420354,27418757:27422890,27463472:27464706,27463474:27465960,27463475:27465076,27463481:27465618,27463483:27465292,27463485:27464912,27463488:27464702,27499690:27503452,27499694:27501934,27499699:27502239,27499702:27502556,27499705:27503951,27499708:27501851,27499736:27501479,27499754:27502674,27499758:27502374,27508924:27509211,27508932:27510363,27582565:27584011,27592183:27594587,27592186:27595476,27592214:27594099,27592225:27593254,27592231:27592768,27600762:27601087,27606148:27608774,27641624:27642332,27641629:27641941,27685685:27686193,27691548:27698266,27691563:27697788,27691699:27700879,27691701:27697488,27691707:27697234,27691710:27693736,27691756:27696625,27691760:27692566,27691762:27691923,27704755:27708285,27710102:27710400,27710103:27715471,27711758:27711862,27724672:27724731,27727085:27727323,27727917:27728093,27729545:27729650,27734955:27735013,27735875:27735964,27739475:27739528,27749761:27750073,27756449:27757483,27756454:2775676', 'assoc_mat': '27418735:autre:3594:27421493,27418745:autre:3594:27421103,27418746:autre:3594:27423794,27418755:autre:3594:27420354,27418757:autre:3594:27422890,27463472:autre:3594:27464706,27463474:autre:3594:27465960,27463475:autre:3594:27465076,27463481:autre:3594:27465618,27463483:autre:3594:27465292,27463485:autre:3594:27464912,27463488:autre:3594:27464702,27499690:autre:3594:27503452,27499694:autre:3594:27501934,27499699:autre:3594:27502239,27499702:autre:3594:27502556,27499705:autre:3594:27503951,27499708:autre:3594:27501851,27499736:autre:3594:27501479,27499754:autre:3594:27502674,27499758:autre:3594:27502374,27508924:autre:3594:27509211,27508932:autre:3594:27510363,27582565:autre:3594:27584011,27592183:autre:3594:27594587,27592186:autre:3594:27595476,27592214:autre:3594:27594099,27592225:autre:3594:27593254,27592231:autre:3594:27592768,27600762:autre:3594:27601087,27606148:autre:3594:27608774,27641624:autre:3594:27642332,27641629:autre:3594:27641941,27685685:autre:3594:27686193,27691548:autre:3594:27698266,27691563:'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.016687255950586448, 'nb_photo': 6, 'list_port_cont': '27418977,27606298,27771566,27918712,28108828', 'assoc_port': '27418793:27418977,27606180:27606298,27770943:27771566,27918365:27918712,28108431:28108828', 'assoc_mat': '27418793:barquette_opaque:4461:27418977,27606180:barquette_opaque:4461:27606298,27770943:barquette_opaque:4461:27771566,27918365:barquette_opaque:4461:27918712,28108431:barquette_opaque:4461:28108828'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.001050001707800891, 'nb_photo': 2734, 'list_port_cont': '27418938,27420094,27420184,27420400,27420568,27420932,27421128,27421338,27421737,27421864,27421934,27422251,27422436,27422662,27422918,27423099,27423594,27423998,27424254,27428711,27428928,27432684,27463637,27464355,27464490,27464602,27464804,27464896,27465303,27466124,27466302,27466435,27466841,27466997,27467192,27467540,27467928,27468983,27470103,27499780,27500586,27500859,27501179,27501371,27501501,27501669,27502413,27502721,27502847,27503003,27503104,27503774,27503890,27504853,27505150,27506136,27506738,27506880,27508984,27510424,27510541,27510601,27510729,27510915,27516627,27516734,27582730,27595498,27596194,27596417,27596530,27602959,27603078,27603298,27603312,27603336,27603348,27603368,27603369,27603390,27606234,27606275,27606490,27608948,27609072,27609192,27609349,27609485,27609645,27609810,27609978,27610110,27611558,27612259,27616464,27616764,27617481,27622883,27623500,27629770,27630028,27630254,27630556,27641783,27671980,27686447,27686493,27686730,27687067,27687342,27687589,27688317,27688599,2768923', 'assoc_port': '27418726:27420094,27418727:27420184,27418728:27420400,27418729:27420568,27418731:27420932,27418732:27421128,27418734:27421338,27418737:27421737,27418739:27421934,27418740:27422251,27418742:27422436,27418744:27422662,27418747:27422918,27418749:27423099,27418753:27423594,27418759:27423998,27418763:27424254,27418767:27428711,27418792:27428928,27418795:27421864,27418800:27418938,27432639:27432684,27463445:27464355,27463446:27464490,27463447:27464602,27463473:27464804,27463476:27470103,27463482:27468983,27463484:27466124,27463487:27466302,27463489:27466435,27463492:27466841,27463493:27466997,27463496:27467192,27463499:27467540,27463506:27467928,27463508:27464896,27463510:27465303,27463512:27463637,27499684:27500586,27499685:27504853,27499686:27500859,27499687:27505150,27499688:27501179,27499689:27501371,27499691:27501501,27499692:27501669,27499695:27506136,27499698:27502413,27499701:27502721,27499707:27502847,27499710:27503003,27499711:27503104,27499714:27506738,27499718:27506880,27499753:27503774,27499756:2750389', 'assoc_mat': '27418726:barquette_opaque:4207:27420094,27418727:barquette_opaque:4207:27420184,27418728:barquette_opaque:4207:27420400,27418729:barquette_opaque:4207:27420568,27418731:barquette_opaque:4207:27420932,27418732:barquette_opaque:4207:27421128,27418734:barquette_opaque:4207:27421338,27418737:barquette_opaque:4207:27421737,27418739:barquette_opaque:4207:27421934,27418740:barquette_opaque:4207:27422251,27418742:barquette_opaque:4207:27422436,27418744:barquette_opaque:4207:27422662,27418747:barquette_opaque:4207:27422918,27418749:barquette_opaque:4207:27423099,27418753:barquette_opaque:4207:27423594,27418759:barquette_opaque:4207:27423998,27418763:barquette_opaque:4207:27424254,27418767:barquette_opaque:4207:27428711,27418792:barquette_opaque:4207:27428928,27418795:barquette_opaque:4207:27421864,27418800:barquette_opaque:4207:27418938,27432639:barquette_opaque:4207:27432684,27463445:barquette_opaque:4207:27464355,27463446:barquette_opaque:4207:27464490,27463447:barquette_opaque:4207:27464602,27463473:barquette_opaqu'}, {'unwanted_material': 'bouchon', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.004054244229126342, 'nb_photo': 5, 'list_port_cont': '27463584,28107739,28108206', 'assoc_port': '27463495:27463584,28107402:28107739,28107855:28108206', 'assoc_mat': '27463495:bouchon:3327:27463584,28107402:bouchon:3327:28107739,28107855:bouchon:3327:28108206'}, {'unwanted_material': 'carton', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.005690070892308352, 'nb_photo': 137, 'list_port_cont': '27418975,27419136,27419435,27463602,27463881,27463940,27499841,27500136,27583087,27583664,27583992,27592467,27606296,27606423,27641714,27641962,27686002,27686248,27686351,27691799,27692072,27711913,27728725,27749877,27749962,27766769,27771558,27771853,27805484,27808574,27830281,27868497,27875044,27930396,27948490,28022417,28022890,28031876,28034094,28049312,28106709,28106889,28107522,28107979,28108052,28108834,28109224,28111126,28111308,28116180,28116823,28117426,28117695,28118421,28118778,28119066,28119575,28121573,28128326', 'assoc_port': '27418738:27419435,27418764:27419136,27418793:27418975,27463478:27463940,27463486:27463881,27463501:27463602,27499715:27500136,27499761:27499841,27582568:27583992,27582573:27583664,27582585:27583087,27592220:27592467,27606142:27606423,27606180:27606296,27641634:27641962,27641639:27641714,27685670:27686248,27685683:27686351,27685684:27686002,27691582:27691799,27691729:27692072,27711756:27711913,27728621:27728725,27749755:27749962,27749756:27749877,27766715:27766769,27770943:27771558,27770946:27771853,27805407:27805484,27808484:27808574,27830132:27830281,27868455:27868497,27874707:27875044,27930306:27930396,27948341:27948490,28022255:28022890,28022262:28022417,28024764:28034094,28031589:28031876,28033123:28049312,28106269:28119575,28106430:28111308,28106431:28111126,28106436:28116180,28106456:28121573,28106469:28106709,28106532:28119066,28106536:28128326,28106550:28107522,28106644:28106889,28106780:28118421,28107405:28118778,28107442:28107979,28107445:28116823,28107780:28117695,28107836:28109224,28107873:2810805', 'assoc_mat': '27418738:carton:4461:27419435,27418764:carton:4461:27419136,27418793:carton:4461:27418975,27463478:carton:4461:27463940,27463486:carton:4461:27463881,27463501:carton:4461:27463602,27499715:carton:4461:27500136,27499761:carton:4461:27499841,27582568:carton:4461:27583992,27582573:carton:4461:27583664,27582585:carton:4461:27583087,27592220:carton:4461:27592467,27606142:carton:4461:27606423,27606180:carton:4461:27606296,27641634:carton:4461:27641962,27641639:carton:4461:27641714,27685670:carton:4461:27686248,27685683:carton:4461:27686351,27685684:carton:4461:27686002,27691582:carton:4461:27691799,27691729:carton:4461:27692072,27711756:carton:4461:27711913,27728621:carton:4461:27728725,27749755:carton:4461:27749962,27749756:carton:4461:27749877,27766715:carton:4461:27766769,27770943:carton:4461:27771558,27770946:carton:4461:27771853,27805407:carton:4461:27805484,27808484:carton:4461:27808574,27830132:carton:4461:27830281,27868455:carton:4461:27868497,27874707:carton:4461:27875044,27930306:carton:4461:27930396,2794'}, {'unwanted_material': 'carton', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.9823530899579359, 'nb_photo': 5218, 'list_port_cont': '27418948,27420095,27420188,27420375,27420559,27421118,27421347,27421748,27421875,27422249,27422424,27422677,27422925,27423101,27423584,27423814,27424011,27424239,27424409,27428698,27428941,27432679,27463627,27464475,27464593,27464808,27464895,27465665,27466292,27466652,27466844,27466989,27467183,27467403,27467535,27467740,27467936,27468989,27470111,27499774,27500587,27500857,27501184,27501379,27501504,27501664,27502113,27502425,27502733,27502996,27503119,27503327,27503765,27503887,27504863,27505154,27506133,27506744,27506887,27508980,27510422,27510537,27510591,27510717,27510913,27516624,27516739,27582736,27594737,27595490,27596191,27596419,27596525,27602944,27603066,27603287,27603317,27603324,27603341,27603355,27603387,27606274,27608954,27609066,27609355,27609483,27609649,27609820,27610000,27610111,27611564,27612263,27616462,27616766,27617478,27623497,27629766,27630026,27630253,27630559,27641788,27670436,27671969,27686440,27686494,27686724,27687080,27687337,27687782,27688305,27688844,27689222,27689594,2769189', 'assoc_port': '27418726:27420095,27418727:27420188,27418728:27420375,27418729:27420559,27418732:27421118,27418734:27421347,27418737:27421748,27418740:27422249,27418742:27422424,27418744:27422677,27418747:27422925,27418749:27423101,27418753:27423584,27418756:27423814,27418759:27424011,27418763:27424239,27418766:27424409,27418767:27428698,27418792:27428941,27418795:27421875,27418800:27418948,27432639:27432679,27463446:27464475,27463447:27464593,27463473:27464808,27463476:27470111,27463479:27465665,27463482:27468989,27463487:27466292,27463491:27466652,27463492:27466844,27463493:27466989,27463496:27467183,27463498:27467403,27463499:27467535,27463502:27467740,27463506:27467936,27463508:27464895,27463512:27463627,27499684:27500587,27499685:27504863,27499686:27500857,27499687:27505154,27499688:27501184,27499689:27501379,27499691:27501504,27499692:27501664,27499695:27506133,27499697:27502113,27499698:27502425,27499701:27502733,27499710:27502996,27499711:27503119,27499714:27506744,27499717:27503327,27499718:27506887,27499753:2750376', 'assoc_mat': '27418726:carton:4207:27420095,27418727:carton:4207:27420188,27418728:carton:4207:27420375,27418729:carton:4207:27420559,27418732:carton:4207:27421118,27418734:carton:4207:27421347,27418737:carton:4207:27421748,27418740:carton:4207:27422249,27418742:carton:4207:27422424,27418744:carton:4207:27422677,27418747:carton:4207:27422925,27418749:carton:4207:27423101,27418753:carton:4207:27423584,27418756:carton:4207:27423814,27418759:carton:4207:27424011,27418763:carton:4207:27424239,27418766:carton:4207:27424409,27418767:carton:4207:27428698,27418792:carton:4207:27428941,27418795:carton:4207:27421875,27418800:carton:4207:27418948,27432639:carton:4207:27432679,27463446:carton:4207:27464475,27463447:carton:4207:27464593,27463473:carton:4207:27464808,27463476:carton:4207:27470111,27463479:carton:4207:27465665,27463482:carton:4207:27468989,27463487:carton:4207:27466292,27463491:carton:4207:27466652,27463492:carton:4207:27466844,27463493:carton:4207:27466989,27463496:carton:4207:27467183,27463498:carton:4207:27467403,2746'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.11880826110040273, 'nb_photo': 17, 'list_port_cont': '27463576,27766795,28010959,28108213,28113457', 'assoc_port': '27463495:27463576,27766720:27766795,28010441:28010959,28106529:28113457,28107855:28108213', 'assoc_mat': '27463495:carton:3327:27463576,27766720:carton:3327:27766795,28010441:carton:3327:28010959,28106529:carton:3327:28113457,28107855:carton:3327:28108213'}, {'unwanted_material': 'carton', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.004491002284790919, 'nb_photo': 602, 'list_port_cont': '27419388,27419704,27420361,27420759,27421104,27421456,27421495,27422896,27423796,27464695,27464710,27465074,27465300,27465498,27465620,27465964,27466603,27501486,27501846,27501931,27502234,27502378,27502555,27502691,27502948,27503459,27503950,27509213,27510367,27582866,27583295,27584014,27584715,27592773,27593257,27593709,27594103,27594581,27595793,27601086,27606471,27608779,27641940,27642324,27686198,27691927,27692575,27693737,27696272,27697237,27697481,27697782,27698263,27700872,27708282,27710395,27710997,27711861,27724732,27727329,27727735,27728092,27729644,27734421,27735018,27735963,27739525,27750337,27756619,27756762,27756854,27757486,27766906,27767799,27774158,27795784,27799609,27805800,27810676,27825619,27827433,27827734,27828030,27830439,27830635,27836600,27836723,27837549,27837745,27838103,27839494,27844344,27868754,27870057,27875814,27875991,27876260,27878337,27878816,27879628,27879962,27880180,27886733,27888902,27891188,27909608,27909635,27918612,27922420,27930550,27945159,27945508,27945692,2794726', 'assoc_port': '27418730:27420759,27418735:27421495,27418743:27421456,27418745:27421104,27418746:27423796,27418755:27420361,27418757:27422896,27418761:27419704,27418798:27419388,27463472:27464710,27463474:27465964,27463475:27465074,27463477:27465498,27463481:27465620,27463483:27465300,27463488:27464695,27463504:27466603,27499690:27503459,27499694:27501931,27499699:27502234,27499702:27502555,27499705:27503950,27499708:27501846,27499736:27501486,27499750:27502948,27499754:27502691,27499758:27502378,27508924:27509213,27508932:27510367,27582559:27584715,27582565:27584014,27582577:27583295,27582586:27582866,27592179:27595793,27592183:27594581,27592214:27594103,27592223:27593709,27592225:27593257,27592231:27592773,27600762:27601086,27606148:27608779,27606150:27606471,27641624:27642324,27641629:27641940,27685685:27686198,27691548:27698263,27691563:27697782,27691577:27696272,27691699:27700872,27691701:27697481,27691707:27697237,27691710:27693737,27691760:27692575,27691762:27691927,27704755:27708282,27710099:27710997,27710102:2771039', 'assoc_mat': '27418730:carton:3594:27420759,27418735:carton:3594:27421495,27418743:carton:3594:27421456,27418745:carton:3594:27421104,27418746:carton:3594:27423796,27418755:carton:3594:27420361,27418757:carton:3594:27422896,27418761:carton:3594:27419704,27418798:carton:3594:27419388,27463472:carton:3594:27464710,27463474:carton:3594:27465964,27463475:carton:3594:27465074,27463477:carton:3594:27465498,27463481:carton:3594:27465620,27463483:carton:3594:27465300,27463488:carton:3594:27464695,27463504:carton:3594:27466603,27499690:carton:3594:27503459,27499694:carton:3594:27501931,27499699:carton:3594:27502234,27499702:carton:3594:27502555,27499705:carton:3594:27503950,27499708:carton:3594:27501846,27499736:carton:3594:27501486,27499750:carton:3594:27502948,27499754:carton:3594:27502691,27499758:carton:3594:27502378,27508924:carton:3594:27509213,27508932:carton:3594:27510367,27582559:carton:3594:27584715,27582565:carton:3594:27584014,27582577:carton:3594:27583295,27582586:carton:3594:27582866,27592179:carton:3594:27595793,2759'}, {'unwanted_material': 'ela', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 1.1134562887965346e-05, 'nb_photo': 30, 'list_port_cont': '27421863,27715360,27909542,27909553,27949172,28021269', 'assoc_port': '27418795:27421863,27704747:27715360,27909527:27909553,27909530:27909542,27948335:27949172,27958871:28021269', 'assoc_mat': '27418795:ela:4207:27421863,27704747:ela:4207:27715360,27909527:ela:4207:27909553,27909530:ela:4207:27909542,27948335:ela:4207:27949172,27958871:ela:4207:28021269'}, {'unwanted_material': 'etiquette', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.000268508604521373, 'nb_photo': 2, 'list_port_cont': '27727992,28117796', 'assoc_port': '27727916:27727992,28107777:28117796', 'assoc_mat': '27727916:etiquette:4461:27727992,28107777:etiquette:4461:28117796'}, {'unwanted_material': 'etiquette', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.000331231933872294, 'nb_photo': 1147, 'list_port_cont': '27420177,27420373,27421123,27421336,27421862,27421928,27422253,27422425,27422652,27422912,27423090,27423410,27424010,27424243,27428704,27432682,27464595,27464900,27465307,27466122,27466298,27466850,27466990,27467189,27467396,27468981,27470112,27499773,27500584,27500858,27501381,27501505,27502995,27503114,27503766,27503886,27504860,27505155,27506878,27508981,27510430,27510542,27510589,27510716,27510918,27516747,27582740,27595487,27596425,27596532,27602950,27603064,27603190,27603304,27603333,27603346,27603367,27603392,27606280,27608788,27608956,27609077,27609351,27609640,27609819,27609964,27617474,27623505,27629762,27630029,27641787,27670440,27686491,27687065,27688303,27688586,27689233,27689595,27691905,27695886,27698313,27705024,27708516,27708670,27709170,27709353,27709520,27709902,27710110,27710264,27710544,27711960,27712406,27712902,27715366,27715526,27715950,27719824,27720785,27728632,27730044,27730415,27730442,27730491,27731071,27733362,27734398,27735958,27736070,27737413,27740473,27740500,27749148,2775001', 'assoc_port': '27418727:27420177,27418728:27420373,27418732:27421123,27418734:27421336,27418739:27421928,27418740:27422253,27418742:27422425,27418744:27422652,27418747:27422912,27418749:27423090,27418750:27423410,27418759:27424010,27418763:27424243,27418767:27428704,27418795:27421862,27432639:27432682,27463447:27464595,27463476:27470112,27463482:27468981,27463484:27466122,27463487:27466298,27463492:27466850,27463493:27466990,27463496:27467189,27463498:27467396,27463508:27464900,27463510:27465307,27499684:27500584,27499685:27504860,27499686:27500858,27499687:27505155,27499689:27501381,27499691:27501505,27499710:27502995,27499711:27503114,27499718:27506878,27499753:27503766,27499756:27503886,27499760:27499773,27508925:27510430,27508926:27510589,27508927:27510716,27508929:27510542,27508931:27510918,27508934:27508981,27516595:27516747,27582558:27608788,27582561:27608956,27582563:27609077,27582571:27609351,27582579:27609640,27582580:27609819,27582582:27609964,27582588:27582740,27592178:27603392,27592181:27603367,27592185:2760333', 'assoc_mat': '27418727:etiquette:4207:27420177,27418728:etiquette:4207:27420373,27418732:etiquette:4207:27421123,27418734:etiquette:4207:27421336,27418739:etiquette:4207:27421928,27418740:etiquette:4207:27422253,27418742:etiquette:4207:27422425,27418744:etiquette:4207:27422652,27418747:etiquette:4207:27422912,27418749:etiquette:4207:27423090,27418750:etiquette:4207:27423410,27418759:etiquette:4207:27424010,27418763:etiquette:4207:27424243,27418767:etiquette:4207:27428704,27418795:etiquette:4207:27421862,27432639:etiquette:4207:27432682,27463447:etiquette:4207:27464595,27463476:etiquette:4207:27470112,27463482:etiquette:4207:27468981,27463484:etiquette:4207:27466122,27463487:etiquette:4207:27466298,27463492:etiquette:4207:27466850,27463493:etiquette:4207:27466990,27463496:etiquette:4207:27467189,27463498:etiquette:4207:27467396,27463508:etiquette:4207:27464900,27463510:etiquette:4207:27465307,27499684:etiquette:4207:27500584,27499685:etiquette:4207:27504860,27499686:etiquette:4207:27500858,27499687:etiquette:4207:27505155,2'}, {'unwanted_material': 'film_plastique', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.9275231751574334, 'nb_photo': 1495, 'list_port_cont': '27418881,27418967,27419133,27419294,27419442,27463601,27463808,27463886,27463943,27499842,27500027,27500130,27500214,27583084,27583669,27583981,27584118,27592464,27592658,27606294,27606331,27606431,27641713,27641961,27642092,27686000,27686262,27686350,27691795,27692064,27692253,27710171,27711926,27727991,27728719,27728835,27734452,27738514,27749874,27749963,27756571,27756625,27766770,27771356,27771565,27771843,27805481,27808571,27825466,27830270,27839448,27868494,27868655,27875046,27886576,27918701,27918941,27930390,27946924,27946997,27948494,28007036,28022404,28022801,28022900,28031878,28033568,28034102,28044536,28049310,28106712,28106886,28107333,28107512,28107981,28108038,28108101,28108833,28109000,28109229,28109639,28110050,28110259,28111066,28111130,28111315,28112431,28116174,28116818,28117422,28117458,28117689,28117795,28118232,28118417,28118771,28119080,28119573,28121576,28128334,28132613', 'assoc_port': '27418738:27419442,27418752:27419294,27418764:27419133,27418793:27418967,27418799:27418881,27463478:27463943,27463486:27463886,27463490:27463808,27463501:27463601,27499704:27500214,27499715:27500130,27499751:27500027,27499761:27499842,27582566:27584118,27582568:27583981,27582573:27583669,27582585:27583084,27592213:27592658,27592220:27592464,27606142:27606431,27606147:27606331,27606180:27606294,27641626:27642092,27641634:27641961,27641639:27641713,27685670:27686262,27685683:27686350,27685684:27686000,27691582:27691795,27691704:27692253,27691729:27692064,27710104:27710171,27711756:27711926,27727916:27727991,27728617:27728835,27728621:27728719,27734386:27734452,27738493:27738514,27749755:27749963,27749756:27749874,27756451:27756571,27756452:27756625,27766715:27766770,27770943:27771565,27770946:27771843,27770950:27771356,27805407:27805481,27808484:27808571,27825269:27825466,27830132:27830270,27839273:27839448,27868454:27868655,27868455:27868494,27874707:27875046,27886513:27886576,27918334:27918941,27918365:2791870', 'assoc_mat': '27418738:film_plastique:4461:27419442,27418752:film_plastique:4461:27419294,27418764:film_plastique:4461:27419133,27418793:film_plastique:4461:27418967,27418799:film_plastique:4461:27418881,27463478:film_plastique:4461:27463943,27463486:film_plastique:4461:27463886,27463490:film_plastique:4461:27463808,27463501:film_plastique:4461:27463601,27499704:film_plastique:4461:27500214,27499715:film_plastique:4461:27500130,27499751:film_plastique:4461:27500027,27499761:film_plastique:4461:27499842,27582566:film_plastique:4461:27584118,27582568:film_plastique:4461:27583981,27582573:film_plastique:4461:27583669,27582585:film_plastique:4461:27583084,27592213:film_plastique:4461:27592658,27592220:film_plastique:4461:27592464,27606142:film_plastique:4461:27606431,27606147:film_plastique:4461:27606331,27606180:film_plastique:4461:27606294,27641626:film_plastique:4461:27642092,27641634:film_plastique:4461:27641961,27641639:film_plastique:4461:27641713,27685670:film_plastique:4461:27686262,27685683:film_plastique:4461:2768635'}, {'unwanted_material': 'film_plastique', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.005738575542220781, 'nb_photo': 14864, 'list_port_cont': '27418941,27419862,27420096,27420186,27420371,27420561,27420928,27421121,27421342,27421739,27421866,27421924,27422240,27422421,27422679,27422922,27423096,27423425,27423595,27423824,27424008,27424249,27424399,27428705,27428942,27432680,27463629,27464357,27464478,27464596,27464805,27464892,27465302,27465666,27465835,27466116,27466294,27466436,27466656,27466840,27466993,27467180,27467404,27467536,27467733,27467927,27468977,27470114,27499787,27500590,27500852,27501176,27501373,27501500,27501660,27502119,27502416,27502724,27502839,27502997,27503112,27503319,27503759,27503891,27504854,27505146,27506130,27506736,27506888,27508988,27510428,27510543,27510600,27510719,27510846,27510910,27516626,27516737,27582741,27594731,27595492,27596193,27596421,27596535,27602945,27603071,27603191,27603295,27603315,27603328,27603350,27603361,27603384,27603400,27606226,27606268,27606487,27608955,27609074,27609200,27609347,27609492,27609635,27609821,27609979,27610100,27611571,27612252,27616466,27616755,27617485,27622878,27623496,2762977', 'assoc_port': '27418725:27419862,27418726:27420096,27418727:27420186,27418728:27420371,27418729:27420561,27418731:27420928,27418732:27421121,27418734:27421342,27418737:27421739,27418739:27421924,27418740:27422240,27418742:27422421,27418744:27422679,27418747:27422922,27418749:27423096,27418750:27423425,27418753:27423595,27418756:27423824,27418759:27424008,27418763:27424249,27418766:27424399,27418767:27428705,27418792:27428942,27418795:27421866,27418800:27418941,27432639:27432680,27463445:27464357,27463446:27464478,27463447:27464596,27463473:27464805,27463476:27470114,27463479:27465666,27463480:27465835,27463482:27468977,27463484:27466116,27463487:27466294,27463489:27466436,27463491:27466656,27463492:27466840,27463493:27466993,27463496:27467180,27463498:27467404,27463499:27467536,27463502:27467733,27463506:27467927,27463508:27464892,27463510:27465302,27463512:27463629,27499684:27500590,27499685:27504854,27499686:27500852,27499687:27505146,27499688:27501176,27499689:27501373,27499691:27501500,27499692:27501660,27499695:2750613', 'assoc_mat': '27418725:film_plastique:4207:27419862,27418726:film_plastique:4207:27420096,27418727:film_plastique:4207:27420186,27418728:film_plastique:4207:27420371,27418729:film_plastique:4207:27420561,27418731:film_plastique:4207:27420928,27418732:film_plastique:4207:27421121,27418734:film_plastique:4207:27421342,27418737:film_plastique:4207:27421739,27418739:film_plastique:4207:27421924,27418740:film_plastique:4207:27422240,27418742:film_plastique:4207:27422421,27418744:film_plastique:4207:27422679,27418747:film_plastique:4207:27422922,27418749:film_plastique:4207:27423096,27418750:film_plastique:4207:27423425,27418753:film_plastique:4207:27423595,27418756:film_plastique:4207:27423824,27418759:film_plastique:4207:27424008,27418763:film_plastique:4207:27424249,27418766:film_plastique:4207:27424399,27418767:film_plastique:4207:27428705,27418792:film_plastique:4207:27428942,27418795:film_plastique:4207:27421866,27418800:film_plastique:4207:27418941,27432639:film_plastique:4207:27432680,27463445:film_plastique:4207:2746435'}, {'unwanted_material': 'kraft', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00014453050925727272, 'nb_photo': 23, 'list_port_cont': '27421126,27424240,27506889,27629768,27709521,27710251,27740488,27791005,27812306,27884565,27909540,28021268,28062659,28279649', 'assoc_port': '27418732:27421126,27418763:27424240,27499718:27506889,27606141:27629768,27691703:27709521,27691727:27710251,27740472:27740488,27789756:27791005,27812255:27812306,27884188:27884565,27909530:27909540,27958871:28021268,28006905:28062659,28106783:28279649', 'assoc_mat': '27418732:kraft:4207:27421126,27418763:kraft:4207:27424240,27499718:kraft:4207:27506889,27606141:kraft:4207:27629768,27691703:kraft:4207:27709521,27691727:kraft:4207:27710251,27740472:kraft:4207:27740488,27789756:kraft:4207:27791005,27812255:kraft:4207:27812306,27884188:kraft:4207:27884565,27909530:kraft:4207:27909540,27958871:kraft:4207:28021268,28006905:kraft:4207:28062659,28106783:kraft:4207:28279649'}, {'unwanted_material': 'metal', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.011692036280533944, 'nb_photo': 1, 'list_port_cont': '27583663', 'assoc_port': '27582573:27583663', 'assoc_mat': '27582573:metal:4461:27583663'}, {'unwanted_material': 'metal', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0051882316820514975, 'nb_photo': 803, 'list_port_cont': '27418937,27420185,27420376,27420558,27421129,27421346,27421867,27421939,27422241,27422428,27422646,27422924,27423103,27423999,27432678,27464597,27464898,27465832,27466301,27466655,27466852,27466996,27467394,27467735,27467933,27468974,27470104,27499781,27500589,27501183,27501497,27503105,27503771,27503877,27504851,27505147,27506128,27506881,27508977,27510721,27510917,27516740,27595493,27596424,27602948,27603074,27603296,27603310,27603364,27603385,27606271,27608949,27609064,27609636,27609980,27612266,27616460,27616769,27617480,27622879,27623492,27629764,27630039,27630564,27641785,27686448,27686489,27687071,27687341,27688309,27689231,27689812,27691901,27695884,27698189,27698321,27705013,27708347,27708509,27708675,27709517,27709628,27709691,27709906,27710117,27710539,27712419,27712785,27712904,27715367,27715617,27715951,27719829,27720798,27727128,27727284,27728316,27730379,27730433,27730484,27730546,27731073,27733369,27733569,27734401,27735956,27736064,27736509,27737422,27740487,27740497,27750080,27750102,2775015', 'assoc_port': '27418727:27420185,27418728:27420376,27418729:27420558,27418732:27421129,27418734:27421346,27418739:27421939,27418740:27422241,27418742:27422428,27418744:27422646,27418747:27422924,27418749:27423103,27418759:27423999,27418795:27421867,27418800:27418937,27432639:27432678,27463447:27464597,27463476:27470104,27463480:27465832,27463482:27468974,27463487:27466301,27463491:27466655,27463492:27466852,27463493:27466996,27463498:27467394,27463502:27467735,27463506:27467933,27463508:27464898,27499684:27500589,27499685:27504851,27499687:27505147,27499688:27501183,27499691:27501497,27499695:27506128,27499711:27503105,27499718:27506881,27499753:27503771,27499756:27503877,27499760:27499781,27508927:27510721,27508931:27510917,27508934:27508977,27516595:27516740,27582561:27608949,27582563:27609064,27582579:27609636,27582582:27609980,27592178:27603385,27592181:27603364,27592216:27603296,27592217:27603310,27592218:27603074,27592227:27596424,27595363:27595493,27600763:27602948,27606141:27629764,27606143:27630039,27606145:2762349', 'assoc_mat': '27418727:metal:4207:27420185,27418728:metal:4207:27420376,27418729:metal:4207:27420558,27418732:metal:4207:27421129,27418734:metal:4207:27421346,27418739:metal:4207:27421939,27418740:metal:4207:27422241,27418742:metal:4207:27422428,27418744:metal:4207:27422646,27418747:metal:4207:27422924,27418749:metal:4207:27423103,27418759:metal:4207:27423999,27418795:metal:4207:27421867,27418800:metal:4207:27418937,27432639:metal:4207:27432678,27463447:metal:4207:27464597,27463476:metal:4207:27470104,27463480:metal:4207:27465832,27463482:metal:4207:27468974,27463487:metal:4207:27466301,27463491:metal:4207:27466655,27463492:metal:4207:27466852,27463493:metal:4207:27466996,27463498:metal:4207:27467394,27463502:metal:4207:27467735,27463506:metal:4207:27467933,27463508:metal:4207:27464898,27499684:metal:4207:27500589,27499685:metal:4207:27504851,27499687:metal:4207:27505147,27499688:metal:4207:27501183,27499691:metal:4207:27501497,27499695:metal:4207:27506128,27499711:metal:4207:27503105,27499718:metal:4207:27506881,27499753:'}, {'unwanted_material': 'metal', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.00031845171456874557, 'nb_photo': 144, 'list_port_cont': '27419696,27421102,27465504,27501856,27502381,27502672,27503948,27509219,27583289,27592767,27594589,27608776,27641943,27642329,27686195,27686651,27692576,27693732,27696269,27696627,27697233,27697789,27700875,27710402,27715467,27727332,27729647,27756857,27757484,27766908,27767801,27771141,27799606,27827731,27830441,27836603,27838101,27839500,27868747,27875833,27879620,27888904,27909612,27945162,27945513,27947259,28013640,28020309,28044518,28045012,28108303,28109206,28109526,28112376,28112819,28115918,28117407,28118100,28120111,28121851,28122737,28123049,28123367,28125349,28126017,28128441,28128842,28129225', 'assoc_port': '27418745:27421102,27418761:27419696,27463477:27465504,27499705:27503948,27499708:27501856,27499754:27502672,27499758:27502381,27508924:27509219,27582577:27583289,27592183:27594589,27592231:27592767,27606148:27608776,27641624:27642329,27641629:27641943,27685658:27686651,27685685:27686195,27691563:27697789,27691577:27696269,27691699:27700875,27691707:27697233,27691710:27693732,27691756:27696627,27691760:27692576,27710102:27710402,27710103:27715467,27727085:27727332,27729545:27729647,27756449:27757484,27756455:27756857,27766717:27767801,27766721:27766908,27770948:27771141,27799345:27799606,27827191:27827731,27830135:27830441,27831149:27838101,27836511:27836603,27839271:27839500,27868453:27868747,27874751:27875833,27877920:27879620,27888879:27888904,27909529:27909612,27944806:27947259,27944828:27945513,27944829:27945162,28012680:28020309,28012681:28013640,28044321:28045012,28044330:28044518,28106440:28128842,28106523:28128441,28106540:28129225,28106544:28126017,28106546:28125349,28106603:28122737,28107399:2812185', 'assoc_mat': '27418745:metal:3594:27421102,27418761:metal:3594:27419696,27463477:metal:3594:27465504,27499705:metal:3594:27503948,27499708:metal:3594:27501856,27499754:metal:3594:27502672,27499758:metal:3594:27502381,27508924:metal:3594:27509219,27582577:metal:3594:27583289,27592183:metal:3594:27594589,27592231:metal:3594:27592767,27606148:metal:3594:27608776,27641624:metal:3594:27642329,27641629:metal:3594:27641943,27685658:metal:3594:27686651,27685685:metal:3594:27686195,27691563:metal:3594:27697789,27691577:metal:3594:27696269,27691699:metal:3594:27700875,27691707:metal:3594:27697233,27691710:metal:3594:27693732,27691756:metal:3594:27696627,27691760:metal:3594:27692576,27710102:metal:3594:27710402,27710103:metal:3594:27715467,27727085:metal:3594:27727332,27729545:metal:3594:27729647,27756449:metal:3594:27757484,27756455:metal:3594:27756857,27766717:metal:3594:27767801,27766721:metal:3594:27766908,27770948:metal:3594:27771141,27799345:metal:3594:27799606,27827191:metal:3594:27827731,27830135:metal:3594:27830441,27831149:'}, {'unwanted_material': 'papier', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.07153413732892204, 'nb_photo': 5023, 'list_port_cont': '27418871,27418973,27419124,27419295,27419447,27463588,27463798,27463889,27463938,27499839,27500025,27500123,27500208,27583089,27583668,27583986,27584121,27592476,27592659,27606287,27606325,27606422,27641717,27641954,27642082,27686001,27686249,27686356,27691792,27692067,27692261,27710174,27711920,27727993,27728727,27728842,27734457,27738523,27749881,27749967,27756577,27756631,27766758,27771358,27771553,27771852,27805485,27808562,27825476,27830275,27839441,27868493,27868652,27875041,27886577,27918702,27918947,27930398,27946913,27947001,27948489,28007037,28022411,28022806,28022896,28031871,28033558,28034100,28044528,28049314,28106696,28106862,28107335,28107520,28107977,28108041,28108094,28108831,28108998,28109222,28109649,28110051,28110256,28111073,28111132,28111314,28112446,28116178,28116812,28117427,28117466,28117693,28117798,28118223,28118409,28118774,28119073,28119564,28121567,28128333,28132615', 'assoc_port': '27418738:27419447,27418752:27419295,27418764:27419124,27418793:27418973,27418799:27418871,27463478:27463938,27463486:27463889,27463490:27463798,27463501:27463588,27499704:27500208,27499715:27500123,27499751:27500025,27499761:27499839,27582566:27584121,27582568:27583986,27582573:27583668,27582585:27583089,27592213:27592659,27592220:27592476,27606142:27606422,27606147:27606325,27606180:27606287,27641626:27642082,27641634:27641954,27641639:27641717,27685670:27686249,27685683:27686356,27685684:27686001,27691582:27691792,27691704:27692261,27691729:27692067,27710104:27710174,27711756:27711920,27727916:27727993,27728617:27728842,27728621:27728727,27734386:27734457,27738493:27738523,27749755:27749967,27749756:27749881,27756451:27756577,27756452:27756631,27766715:27766758,27770943:27771553,27770946:27771852,27770950:27771358,27805407:27805485,27808484:27808562,27825269:27825476,27830132:27830275,27839273:27839441,27868454:27868652,27868455:27868493,27874707:27875041,27886513:27886577,27918334:27918947,27918365:2791870', 'assoc_mat': '27418738:papier:4461:27419447,27418752:papier:4461:27419295,27418764:papier:4461:27419124,27418793:papier:4461:27418973,27418799:papier:4461:27418871,27463478:papier:4461:27463938,27463486:papier:4461:27463889,27463490:papier:4461:27463798,27463501:papier:4461:27463588,27499704:papier:4461:27500208,27499715:papier:4461:27500123,27499751:papier:4461:27500025,27499761:papier:4461:27499839,27582566:papier:4461:27584121,27582568:papier:4461:27583986,27582573:papier:4461:27583668,27582585:papier:4461:27583089,27592213:papier:4461:27592659,27592220:papier:4461:27592476,27606142:papier:4461:27606422,27606147:papier:4461:27606325,27606180:papier:4461:27606287,27641626:papier:4461:27642082,27641634:papier:4461:27641954,27641639:papier:4461:27641717,27685670:papier:4461:27686249,27685683:papier:4461:27686356,27685684:papier:4461:27686001,27691582:papier:4461:27691792,27691704:papier:4461:27692261,27691729:papier:4461:27692067,27710104:papier:4461:27710174,27711756:papier:4461:27711920,27727916:papier:4461:27727993,2772'}, {'unwanted_material': 'papier', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.006848099963115994, 'nb_photo': 20149, 'list_port_cont': '27418946,27419865,27420102,27420174,27420369,27420560,27420930,27421127,27421345,27421740,27421869,27421937,27422254,27422437,27422674,27422926,27423092,27423424,27423585,27424002,27424250,27424400,27428699,27428938,27432685,27463638,27464350,27464480,27464600,27464816,27464906,27465311,27465659,27465826,27466114,27466287,27466445,27466653,27466847,27467004,27467188,27467391,27467541,27467736,27467939,27468975,27470107,27499784,27500855,27501177,27501367,27501499,27501668,27502123,27502420,27502727,27502842,27503001,27503117,27503321,27503764,27503883,27504864,27505140,27506137,27506734,27506890,27508986,27510434,27510545,27510590,27510731,27510847,27510908,27516635,27516735,27582727,27594738,27595497,27596201,27596420,27596527,27602952,27603072,27603196,27603301,27603306,27603323,27603338,27603365,27603372,27603398,27606235,27606270,27606495,27608789,27608946,27609069,27609188,27609345,27609497,27609648,27609812,27610002,27610101,27611560,27612264,27616461,27616759,27617484,27622884,27623498,27629769,2763003', 'assoc_port': '27418725:27419865,27418726:27420102,27418727:27420174,27418728:27420369,27418729:27420560,27418731:27420930,27418732:27421127,27418734:27421345,27418737:27421740,27418739:27421937,27418740:27422254,27418742:27422437,27418744:27422674,27418747:27422926,27418749:27423092,27418750:27423424,27418753:27423585,27418759:27424002,27418763:27424250,27418766:27424400,27418767:27428699,27418792:27428938,27418795:27421869,27418800:27418946,27432639:27432685,27463445:27464350,27463446:27464480,27463447:27464600,27463473:27464816,27463476:27470107,27463479:27465659,27463480:27465826,27463482:27468975,27463484:27466114,27463487:27466287,27463489:27466445,27463491:27466653,27463492:27466847,27463493:27467004,27463496:27467188,27463498:27467391,27463499:27467541,27463502:27467736,27463506:27467939,27463508:27464906,27463510:27465311,27463512:27463638,27499685:27504864,27499686:27500855,27499687:27505140,27499688:27501177,27499689:27501367,27499691:27501499,27499692:27501668,27499695:27506137,27499697:27502123,27499698:2750242', 'assoc_mat': '27418725:papier:4207:27419865,27418726:papier:4207:27420102,27418727:papier:4207:27420174,27418728:papier:4207:27420369,27418729:papier:4207:27420560,27418731:papier:4207:27420930,27418732:papier:4207:27421127,27418734:papier:4207:27421345,27418737:papier:4207:27421740,27418739:papier:4207:27421937,27418740:papier:4207:27422254,27418742:papier:4207:27422437,27418744:papier:4207:27422674,27418747:papier:4207:27422926,27418749:papier:4207:27423092,27418750:papier:4207:27423424,27418753:papier:4207:27423585,27418759:papier:4207:27424002,27418763:papier:4207:27424250,27418766:papier:4207:27424400,27418767:papier:4207:27428699,27418792:papier:4207:27428938,27418795:papier:4207:27421869,27418800:papier:4207:27418946,27432639:papier:4207:27432685,27463445:papier:4207:27464350,27463446:papier:4207:27464480,27463447:papier:4207:27464600,27463473:papier:4207:27464816,27463476:papier:4207:27470107,27463479:papier:4207:27465659,27463480:papier:4207:27465826,27463482:papier:4207:27468975,27463484:papier:4207:27466114,2746'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.04079768424702879, 'nb_photo': 21, 'list_port_cont': '27463583,27766794,28010958,28108211,28113458', 'assoc_port': '27463495:27463583,27766720:27766794,28010441:28010958,28106529:28113458,28107855:28108211', 'assoc_mat': '27463495:papier:3327:27463583,27766720:papier:3327:27766794,28010441:papier:3327:28010958,28106529:papier:3327:28113458,28107855:papier:3327:28108211'}, {'unwanted_material': 'papier', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.00813369996132629, 'nb_photo': 3192, 'list_port_cont': '27419381,27419697,27420359,27420765,27421098,27421460,27421500,27422891,27423802,27464704,27464708,27464921,27465069,27465296,27465505,27465625,27465954,27466602,27501487,27501848,27501932,27502242,27502376,27502693,27502946,27503456,27503946,27509212,27510361,27582865,27583288,27584012,27584717,27592770,27593263,27593706,27594100,27594586,27595481,27595797,27606472,27608782,27641945,27642333,27686199,27686650,27691921,27692571,27693729,27696275,27696619,27697227,27697486,27697785,27698272,27700871,27708277,27710398,27710998,27711856,27715472,27724726,27727328,27727736,27728095,27729645,27734416,27735015,27735966,27739527,27750071,27750338,27756641,27756764,27756858,27757480,27766907,27767805,27771140,27771763,27774153,27774738,27795786,27799604,27805571,27805807,27810673,27825621,27827428,27827733,27828039,27830438,27830638,27836604,27836724,27837543,27837743,27838098,27839496,27844343,27868751,27870059,27875841,27875997,27876256,27878340,27878818,27879624,27879969,27880178,27886737,27888903,27891180,2790960', 'assoc_port': '27418730:27420765,27418735:27421500,27418743:27421460,27418745:27421098,27418746:27423802,27418755:27420359,27418757:27422891,27418761:27419697,27418798:27419381,27463472:27464708,27463474:27465954,27463475:27465069,27463477:27465505,27463481:27465625,27463483:27465296,27463485:27464921,27463488:27464704,27463504:27466602,27499690:27503456,27499694:27501932,27499699:27502242,27499705:27503946,27499708:27501848,27499736:27501487,27499750:27502946,27499754:27502693,27499758:27502376,27508924:27509212,27508932:27510361,27582559:27584717,27582565:27584012,27582577:27583288,27582586:27582865,27592179:27595797,27592183:27594586,27592186:27595481,27592214:27594100,27592223:27593706,27592225:27593263,27592231:27592770,27606148:27608782,27606150:27606472,27641624:27642333,27641629:27641945,27685658:27686650,27685685:27686199,27691548:27698272,27691563:27697785,27691577:27696275,27691699:27700871,27691701:27697486,27691707:27697227,27691710:27693729,27691756:27696619,27691760:27692571,27691762:27691921,27704755:2770827', 'assoc_mat': '27418730:papier:3594:27420765,27418735:papier:3594:27421500,27418743:papier:3594:27421460,27418745:papier:3594:27421098,27418746:papier:3594:27423802,27418755:papier:3594:27420359,27418757:papier:3594:27422891,27418761:papier:3594:27419697,27418798:papier:3594:27419381,27463472:papier:3594:27464708,27463474:papier:3594:27465954,27463475:papier:3594:27465069,27463477:papier:3594:27465505,27463481:papier:3594:27465625,27463483:papier:3594:27465296,27463485:papier:3594:27464921,27463488:papier:3594:27464704,27463504:papier:3594:27466602,27499690:papier:3594:27503456,27499694:papier:3594:27501932,27499699:papier:3594:27502242,27499705:papier:3594:27503946,27499708:papier:3594:27501848,27499736:papier:3594:27501487,27499750:papier:3594:27502946,27499754:papier:3594:27502693,27499758:papier:3594:27502376,27508924:papier:3594:27509212,27508932:papier:3594:27510361,27582559:papier:3594:27584717,27582565:papier:3594:27584012,27582577:papier:3594:27583288,27582586:papier:3594:27582865,27592179:papier:3594:27595797,2759'}, {'unwanted_material': 'pehd', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00016997771030768203, 'nb_photo': 40, 'list_port_cont': '27421334,27464899,27466120,27466299,27503888,27505144,27506886,27582728,27629773,27630031,27686734,27689223,27698194,27708678,27709639,27730441,27736060,27740479,27772565,27830684,27843069,27868931,27909533,27919390,28021258,28265179,28267020,28268066,28268202,28272480,28279654,28284212', 'assoc_port': '27418734:27421334,27463484:27466120,27463487:27466299,27463508:27464899,27499687:27505144,27499718:27506886,27499756:27503888,27582588:27582728,27606141:27629773,27606143:27630031,27641588:27686734,27641632:27689223,27691661:27708678,27691705:27709639,27697995:27698194,27730218:27730441,27735873:27736060,27740472:27740479,27770955:27772565,27830129:27830684,27842452:27843069,27868456:27868931,27909530:27909533,27918330:27919390,27958871:28021258,28106535:28265179,28106645:28267020,28106778:28268066,28106782:28268202,28106783:28279654,28107769:28272480,28108532:28284212', 'assoc_mat': '27418734:pehd:4207:27421334,27463484:pehd:4207:27466120,27463487:pehd:4207:27466299,27463508:pehd:4207:27464899,27499687:pehd:4207:27505144,27499718:pehd:4207:27506886,27499756:pehd:4207:27503888,27582588:pehd:4207:27582728,27606141:pehd:4207:27629773,27606143:pehd:4207:27630031,27641588:pehd:4207:27686734,27641632:pehd:4207:27689223,27691661:pehd:4207:27708678,27691705:pehd:4207:27709639,27697995:pehd:4207:27698194,27730218:pehd:4207:27730441,27735873:pehd:4207:27736060,27740472:pehd:4207:27740479,27770955:pehd:4207:27772565,27830129:pehd:4207:27830684,27842452:pehd:4207:27843069,27868456:pehd:4207:27868931,27909530:pehd:4207:27909533,27918330:pehd:4207:27919390,27958871:pehd:4207:28021258,28106535:pehd:4207:28265179,28106645:pehd:4207:28267020,28106778:pehd:4207:28268066,28106782:pehd:4207:28268202,28106783:pehd:4207:28279654,28107769:pehd:4207:28272480,28108532:pehd:4207:28284212'}, {'unwanted_material': 'pehd', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0006817943984943475, 'nb_photo': 40, 'list_port_cont': '27421105,27501849,27503953,27509221,27594582,27697786,27700877,27727331,27756855,27757481,27868748,27909633,27947260,28020308,28109964,28117413,28120113,28125353,28126015', 'assoc_port': '27418745:27421105,27499705:27503953,27499708:27501849,27508924:27509221,27592183:27594582,27691563:27697786,27691699:27700877,27727085:27727331,27756449:27757481,27756455:27756855,27868453:27868748,27909528:27909633,27944806:27947260,28012680:28020308,28106544:28126015,28106546:28125353,28107403:28120113,28107832:28117413,28108372:28109964', 'assoc_mat': '27418745:pehd:3594:27421105,27499705:pehd:3594:27503953,27499708:pehd:3594:27501849,27508924:pehd:3594:27509221,27592183:pehd:3594:27594582,27691563:pehd:3594:27697786,27691699:pehd:3594:27700877,27727085:pehd:3594:27727331,27756449:pehd:3594:27757481,27756455:pehd:3594:27756855,27868453:pehd:3594:27868748,27909528:pehd:3594:27909633,27944806:pehd:3594:27947260,28012680:pehd:3594:28020308,28106544:pehd:3594:28126015,28106546:pehd:3594:28125353,28107403:pehd:3594:28120113,28107832:pehd:3594:28117413,28108372:pehd:3594:28109964'}, {'unwanted_material': 'pet_clair', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0003459939884055656, 'nb_photo': 1, 'list_port_cont': '27830277', 'assoc_port': '27830132:27830277', 'assoc_mat': '27830132:pet_clair:4461:27830277'}, {'unwanted_material': 'pet_clair', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.001969832205376704, 'nb_photo': 1063, 'list_port_cont': '27418943,27420097,27420181,27420396,27420937,27421130,27421870,27422250,27422430,27423411,27423996,27424248,27428712,27428936,27464347,27464484,27464588,27464901,27465310,27465831,27466300,27466444,27466657,27466853,27466999,27467399,27467938,27468985,27470109,27499779,27500580,27500850,27501182,27502418,27502729,27502845,27502991,27503108,27503328,27503761,27503880,27504858,27505152,27506132,27506739,27506882,27508985,27510534,27510599,27510720,27510907,27516623,27516745,27582738,27595489,27596204,27596415,27596534,27602955,27603075,27603292,27603311,27603347,27603370,27603386,27606277,27608952,27609078,27609639,27609815,27610108,27611569,27612258,27616465,27622870,27629774,27630033,27630550,27641795,27686450,27686733,27687072,27687338,27687577,27688306,27688594,27688850,27689228,27689608,27689804,27691891,27695885,27698311,27705023,27708346,27708501,27708681,27709161,27709518,27709632,27709690,27710109,27710250,27710387,27710552,27711951,27712154,27712415,27712566,27712788,27712897,27715365,27715529,2771562', 'assoc_port': '27418726:27420097,27418727:27420181,27418728:27420396,27418731:27420937,27418732:27421130,27418740:27422250,27418742:27422430,27418750:27423411,27418759:27423996,27418763:27424248,27418767:27428712,27418792:27428936,27418795:27421870,27418800:27418943,27463445:27464347,27463446:27464484,27463447:27464588,27463476:27470109,27463480:27465831,27463482:27468985,27463487:27466300,27463489:27466444,27463491:27466657,27463492:27466853,27463493:27466999,27463498:27467399,27463506:27467938,27463508:27464901,27463510:27465310,27499684:27500580,27499685:27504858,27499686:27500850,27499687:27505152,27499688:27501182,27499695:27506132,27499698:27502418,27499701:27502729,27499707:27502845,27499710:27502991,27499711:27503108,27499714:27506739,27499717:27503328,27499718:27506882,27499753:27503761,27499756:27503880,27499760:27499779,27508926:27510599,27508927:27510720,27508929:27510534,27508931:27510907,27508934:27508985,27516594:27516623,27516595:27516745,27582561:27608952,27582563:27609078,27582579:27609639,27582580:2760981', 'assoc_mat': '27418726:pet_clair:4207:27420097,27418727:pet_clair:4207:27420181,27418728:pet_clair:4207:27420396,27418731:pet_clair:4207:27420937,27418732:pet_clair:4207:27421130,27418740:pet_clair:4207:27422250,27418742:pet_clair:4207:27422430,27418750:pet_clair:4207:27423411,27418759:pet_clair:4207:27423996,27418763:pet_clair:4207:27424248,27418767:pet_clair:4207:27428712,27418792:pet_clair:4207:27428936,27418795:pet_clair:4207:27421870,27418800:pet_clair:4207:27418943,27463445:pet_clair:4207:27464347,27463446:pet_clair:4207:27464484,27463447:pet_clair:4207:27464588,27463476:pet_clair:4207:27470109,27463480:pet_clair:4207:27465831,27463482:pet_clair:4207:27468985,27463487:pet_clair:4207:27466300,27463489:pet_clair:4207:27466444,27463491:pet_clair:4207:27466657,27463492:pet_clair:4207:27466853,27463493:pet_clair:4207:27466999,27463498:pet_clair:4207:27467399,27463506:pet_clair:4207:27467938,27463508:pet_clair:4207:27464901,27463510:pet_clair:4207:27465310,27499684:pet_clair:4207:27500580,27499685:pet_clair:4207:27504858,2'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.8972511864030355, 'nb_photo': 520, 'list_port_cont': '27463571,27766798,28010951,28107741,28108212,28113459', 'assoc_port': '27463495:27463571,27766720:27766798,28010441:28010951,28106529:28113459,28107402:28107741,28107855:28108212', 'assoc_mat': '27463495:pet_clair:3327:27463571,27766720:pet_clair:3327:27766798,28010441:pet_clair:3327:28010951,28106529:pet_clair:3327:28113459,28107402:pet_clair:3327:28107741,28107855:pet_clair:3327:28108212'}, {'unwanted_material': 'pet_clair', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.07413983167959405, 'nb_photo': 3080, 'list_port_cont': '27419380,27419694,27420357,27420766,27421099,27421461,27421502,27422897,27423799,27464697,27464707,27464914,27465080,27465298,27465497,27465626,27465963,27466601,27501477,27501853,27501929,27502238,27502377,27502562,27502692,27502950,27503453,27503952,27509214,27510370,27582863,27583285,27584017,27584721,27592765,27593264,27593712,27594101,27594590,27595480,27595792,27601080,27606479,27608775,27641939,27642328,27686191,27686672,27691920,27692574,27693735,27696270,27696620,27697228,27697478,27697781,27698270,27700880,27708284,27710397,27710990,27711855,27715474,27724728,27727325,27727739,27728096,27729640,27734422,27735020,27735967,27739529,27750076,27750333,27756624,27756772,27756861,27757487,27766915,27767802,27771132,27771759,27774156,27774744,27795781,27799610,27805572,27805798,27810671,27825624,27827429,27827736,27828032,27830443,27830644,27836601,27836725,27837544,27837749,27838095,27839501,27844341,27868745,27870056,27875829,27875981,27876257,27878341,27878814,27879623,27879971,27880185,27886720,2788891', 'assoc_port': '27418730:27420766,27418735:27421502,27418743:27421461,27418745:27421099,27418746:27423799,27418755:27420357,27418757:27422897,27418761:27419694,27418798:27419380,27463472:27464707,27463474:27465963,27463475:27465080,27463477:27465497,27463481:27465626,27463483:27465298,27463485:27464914,27463488:27464697,27463504:27466601,27499690:27503453,27499694:27501929,27499699:27502238,27499702:27502562,27499705:27503952,27499708:27501853,27499736:27501477,27499750:27502950,27499754:27502692,27499758:27502377,27508924:27509214,27508932:27510370,27582559:27584721,27582565:27584017,27582577:27583285,27582586:27582863,27592179:27595792,27592183:27594590,27592186:27595480,27592214:27594101,27592223:27593712,27592225:27593264,27592231:27592765,27600762:27601080,27606148:27608775,27606150:27606479,27641624:27642328,27641629:27641939,27685658:27686672,27685685:27686191,27691548:27698270,27691563:27697781,27691577:27696270,27691699:27700880,27691701:27697478,27691707:27697228,27691710:27693735,27691756:27696620,27691760:2769257', 'assoc_mat': '27418730:pet_clair:3594:27420766,27418735:pet_clair:3594:27421502,27418743:pet_clair:3594:27421461,27418745:pet_clair:3594:27421099,27418746:pet_clair:3594:27423799,27418755:pet_clair:3594:27420357,27418757:pet_clair:3594:27422897,27418761:pet_clair:3594:27419694,27418798:pet_clair:3594:27419380,27463472:pet_clair:3594:27464707,27463474:pet_clair:3594:27465963,27463475:pet_clair:3594:27465080,27463477:pet_clair:3594:27465497,27463481:pet_clair:3594:27465626,27463483:pet_clair:3594:27465298,27463485:pet_clair:3594:27464914,27463488:pet_clair:3594:27464697,27463504:pet_clair:3594:27466601,27499690:pet_clair:3594:27503453,27499694:pet_clair:3594:27501929,27499699:pet_clair:3594:27502238,27499702:pet_clair:3594:27502562,27499705:pet_clair:3594:27503952,27499708:pet_clair:3594:27501853,27499736:pet_clair:3594:27501477,27499750:pet_clair:3594:27502950,27499754:pet_clair:3594:27502692,27499758:pet_clair:3594:27502377,27508924:pet_clair:3594:27509214,27508932:pet_clair:3594:27510370,27582559:pet_clair:3594:27584721,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0010581292130120163, 'nb_photo': 1, 'list_port_cont': '28106694', 'assoc_port': '28106469:28106694', 'assoc_mat': '28106469:pet_fonce:4461:28106694'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00027397668626311236, 'nb_photo': 82, 'list_port_cont': '27421122,27421865,27422927,27424003,27466434,27466848,27467400,27470099,27500862,27502992,27503768,27504855,27510546,27582733,27596526,27603366,27603378,27629776,27641798,27686729,27687069,27688592,27691898,27695883,27711956,27715355,27715675,27718704,27740482,27750254,27767164,27775017,27778163,27778209,27789807,27799402,27812325,27813057,27839320,27847401,27849181,27875949,27876505,27876572,27878007,27880633,27884556,27945658,27945811,27949027,28050360,28053925,28260749,28260953,28264593,28265175,28266553,28267016,28269774,28279660,28284065,28287578,28288985', 'assoc_port': '27418732:27421122,27418747:27422927,27418759:27424003,27418795:27421865,27463476:27470099,27463489:27466434,27463492:27466848,27463498:27467400,27499685:27504855,27499686:27500862,27499710:27502992,27499753:27503768,27508929:27510546,27582588:27582733,27592177:27603378,27592181:27603366,27592228:27596526,27606141:27629776,27641588:27686729,27641591:27687069,27641627:27688592,27641644:27641798,27691763:27691898,27695052:27695883,27704747:27715355,27704753:27715675,27710100:27718704,27711755:27711956,27740472:27740482,27749757:27750254,27756447:27767164,27774009:27775017,27778157:27778163,27778158:27778209,27789755:27789807,27799347:27799402,27812254:27812325,27812918:27813057,27839272:27839320,27841473:27847401,27843158:27849181,27868449:27876572,27868452:27876505,27874711:27880633,27874713:27875949,27877950:27878007,27884188:27884556,27944822:27945811,27944827:27945658,27948338:27949027,28010438:28053925,28050281:28050360,28106272:28260749,28106274:28260953,28106530:28264593,28106535:28265175,28106585:2826655', 'assoc_mat': '27418732:pet_fonce:4207:27421122,27418747:pet_fonce:4207:27422927,27418759:pet_fonce:4207:27424003,27418795:pet_fonce:4207:27421865,27463476:pet_fonce:4207:27470099,27463489:pet_fonce:4207:27466434,27463492:pet_fonce:4207:27466848,27463498:pet_fonce:4207:27467400,27499685:pet_fonce:4207:27504855,27499686:pet_fonce:4207:27500862,27499710:pet_fonce:4207:27502992,27499753:pet_fonce:4207:27503768,27508929:pet_fonce:4207:27510546,27582588:pet_fonce:4207:27582733,27592177:pet_fonce:4207:27603378,27592181:pet_fonce:4207:27603366,27592228:pet_fonce:4207:27596526,27606141:pet_fonce:4207:27629776,27641588:pet_fonce:4207:27686729,27641591:pet_fonce:4207:27687069,27641627:pet_fonce:4207:27688592,27641644:pet_fonce:4207:27641798,27691763:pet_fonce:4207:27691898,27695052:pet_fonce:4207:27695883,27704747:pet_fonce:4207:27715355,27704753:pet_fonce:4207:27715675,27710100:pet_fonce:4207:27718704,27711755:pet_fonce:4207:27711956,27740472:pet_fonce:4207:27740482,27749757:pet_fonce:4207:27750254,27756447:pet_fonce:4207:27767164,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.037922203177391936, 'nb_photo': 4, 'list_port_cont': '27766801,28108215', 'assoc_port': '27766720:27766801,28107855:28108215', 'assoc_mat': '27766720:pet_fonce:3327:27766801,28107855:pet_fonce:3327:28108215'}, {'unwanted_material': 'pet_fonce', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0003514998697290363, 'nb_photo': 48, 'list_port_cont': '27421097,27465299,27501854,27594097,27594588,27686197,27686645,27697790,27698271,27700873,27710396,27710995,27727326,27729642,27739532,27757482,27799603,27825627,27827730,27878334,27888901,27945155,28020301,28036028,28044509,28117030,28117412,28125358,28126311,28127778,28131443,28132386', 'assoc_port': '27418745:27421097,27463483:27465299,27499708:27501854,27592183:27594588,27592214:27594097,27685658:27686645,27685685:27686197,27691548:27698271,27691563:27697790,27691699:27700873,27710099:27710995,27710102:27710396,27727085:27727326,27729545:27729642,27739475:27739532,27756449:27757482,27799345:27799603,27825271:27825627,27827191:27827730,27877954:27878334,27888879:27888901,27944829:27945155,28012680:28020301,28035723:28036028,28044330:28044509,28106429:28132386,28106434:28131443,28106526:28127778,28106543:28126311,28106546:28125358,28107832:28117412,28107853:28117030', 'assoc_mat': '27418745:pet_fonce:3594:27421097,27463483:pet_fonce:3594:27465299,27499708:pet_fonce:3594:27501854,27592183:pet_fonce:3594:27594588,27592214:pet_fonce:3594:27594097,27685658:pet_fonce:3594:27686645,27685685:pet_fonce:3594:27686197,27691548:pet_fonce:3594:27698271,27691563:pet_fonce:3594:27697790,27691699:pet_fonce:3594:27700873,27710099:pet_fonce:3594:27710995,27710102:pet_fonce:3594:27710396,27727085:pet_fonce:3594:27727326,27729545:pet_fonce:3594:27729642,27739475:pet_fonce:3594:27739532,27756449:pet_fonce:3594:27757482,27799345:pet_fonce:3594:27799603,27825271:pet_fonce:3594:27825627,27827191:pet_fonce:3594:27827730,27877954:pet_fonce:3594:27878334,27888879:pet_fonce:3594:27888901,27944829:pet_fonce:3594:27945155,28012680:pet_fonce:3594:28020301,28035723:pet_fonce:3594:28036028,28044330:pet_fonce:3594:28044509,28106429:pet_fonce:3594:28132386,28106434:pet_fonce:3594:28131443,28106526:pet_fonce:3594:28127778,28106543:pet_fonce:3594:28126311,28106546:pet_fonce:3594:28125358,28107832:pet_fonce:3594:28117412,2'}, {'unwanted_material': 'pet_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.005466676232154387, 'nb_photo': 1, 'list_port_cont': '28106883', 'assoc_port': '28106644:28106883', 'assoc_mat': '28106644:pet_opaque:4461:28106883'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0019003855730040326, 'nb_photo': 494, 'list_port_cont': '27420176,27420385,27420572,27421120,27421344,27421871,27422244,27422657,27422917,27423095,27424005,27428929,27464589,27464902,27465305,27466288,27466646,27467003,27467186,27467392,27467941,27468978,27470101,27499775,27500860,27501178,27502114,27502414,27502734,27503005,27503773,27503885,27504856,27505143,27506125,27506883,27510532,27510603,27510723,27516625,27582731,27596198,27596413,27596524,27602958,27603070,27603351,27603358,27603373,27603393,27606278,27608953,27609067,27609348,27609642,27609985,27611563,27612267,27616758,27617482,27629763,27630553,27641786,27670431,27671965,27686446,27687068,27687343,27688310,27689232,27689598,27691897,27695897,27698198,27698319,27708335,27708668,27710108,27710262,27710550,27711958,27712156,27712417,27712567,27712891,27715352,27715669,27718713,27719814,27720792,27723909,27728670,27729978,27730440,27730487,27734403,27736057,27736502,27737418,27740476,27749999,27750164,27750501,27762516,27767163,27767184,27767312,27774657,27775018,27775040,27778168,27778215,27789806,2779939', 'assoc_port': '27418727:27420176,27418728:27420385,27418729:27420572,27418732:27421120,27418734:27421344,27418740:27422244,27418744:27422657,27418747:27422917,27418749:27423095,27418759:27424005,27418792:27428929,27418795:27421871,27463447:27464589,27463476:27470101,27463482:27468978,27463487:27466288,27463491:27466646,27463493:27467003,27463496:27467186,27463498:27467392,27463506:27467941,27463508:27464902,27463510:27465305,27499685:27504856,27499686:27500860,27499687:27505143,27499688:27501178,27499695:27506125,27499697:27502114,27499698:27502414,27499701:27502734,27499710:27503005,27499718:27506883,27499753:27503773,27499756:27503885,27499760:27499775,27508926:27510603,27508927:27510723,27508929:27510532,27516594:27516625,27582561:27608953,27582563:27609067,27582571:27609348,27582579:27609642,27582582:27609985,27582588:27582731,27592177:27603373,27592178:27603393,27592181:27603358,27592211:27603351,27592218:27603070,27592224:27596198,27592227:27596413,27592228:27596524,27600763:27602958,27606141:27629763,27606146:2763055', 'assoc_mat': '27418727:pet_opaque:4207:27420176,27418728:pet_opaque:4207:27420385,27418729:pet_opaque:4207:27420572,27418732:pet_opaque:4207:27421120,27418734:pet_opaque:4207:27421344,27418740:pet_opaque:4207:27422244,27418744:pet_opaque:4207:27422657,27418747:pet_opaque:4207:27422917,27418749:pet_opaque:4207:27423095,27418759:pet_opaque:4207:27424005,27418792:pet_opaque:4207:27428929,27418795:pet_opaque:4207:27421871,27463447:pet_opaque:4207:27464589,27463476:pet_opaque:4207:27470101,27463482:pet_opaque:4207:27468978,27463487:pet_opaque:4207:27466288,27463491:pet_opaque:4207:27466646,27463493:pet_opaque:4207:27467003,27463496:pet_opaque:4207:27467186,27463498:pet_opaque:4207:27467392,27463506:pet_opaque:4207:27467941,27463508:pet_opaque:4207:27464902,27463510:pet_opaque:4207:27465305,27499685:pet_opaque:4207:27504856,27499686:pet_opaque:4207:27500860,27499687:pet_opaque:4207:27505143,27499688:pet_opaque:4207:27501178,27499695:pet_opaque:4207:27506125,27499697:pet_opaque:4207:27502114,27499698:pet_opaque:4207:27502414,2749'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 7.933477397620998e-05, 'nb_photo': 30, 'list_port_cont': '27420179,27423590,27467000,27506891,27510421,27630027,27686439,27687073,27689606,27712412,27715356,27715945,27730550,27830686,27847399,27849177,27876770,27878019,27880483,27909535,27949178,28021256,28044389,28279262,28284574', 'assoc_port': '27418727:27420179,27418753:27423590,27463493:27467000,27499718:27506891,27508925:27510421,27606143:27630027,27641591:27687073,27641635:27689606,27686322:27686439,27697990:27712412,27704747:27715356,27715882:27715945,27730217:27730550,27830129:27830686,27841473:27847399,27843158:27849177,27868448:27876770,27874705:27880483,27877950:27878019,27909530:27909535,27948335:27949178,27958871:28021256,28044320:28044389,28106470:28279262,28108436:28284574', 'assoc_mat': '27418727:textiles_sanitaires:4207:27420179,27418753:textiles_sanitaires:4207:27423590,27463493:textiles_sanitaires:4207:27467000,27499718:textiles_sanitaires:4207:27506891,27508925:textiles_sanitaires:4207:27510421,27606143:textiles_sanitaires:4207:27630027,27641591:textiles_sanitaires:4207:27687073,27641635:textiles_sanitaires:4207:27689606,27686322:textiles_sanitaires:4207:27686439,27697990:textiles_sanitaires:4207:27712412,27704747:textiles_sanitaires:4207:27715356,27715882:textiles_sanitaires:4207:27715945,27730217:textiles_sanitaires:4207:27730550,27830129:textiles_sanitaires:4207:27830686,27841473:textiles_sanitaires:4207:27847399,27843158:textiles_sanitaires:4207:27849177,27868448:textiles_sanitaires:4207:27876770,27874705:textiles_sanitaires:4207:27880483,27877950:textiles_sanitaires:4207:27878019,27909530:textiles_sanitaires:4207:27909535,27948335:textiles_sanitaires:4207:27949178,27958871:textiles_sanitaires:4207:28021256,28044320:textiles_sanitaires:4207:28044389,28106470:textiles_sanitaires:4207:2'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(2387085,2394417,2401783,2404349,2404603,2414459,2417591,2423633,2431413,2438025,2442299,2443095,2451685,2460067,2467723,2470113,2475127,2507777,2507779,2507941,2508051,2508105,2507813,2507817,2507849,2507897,2507905)); after get_hostname_from_raspi hasthag : pcnc hasthag that could be used but not yet : _______carton,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______pcnc' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-10-01' and date <= '2025-10-31') GROUP BY month order by month; hasthag : refus hasthag that could be used but not yet : _______refus,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______refus' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-10-01' and date <= '2025-10-31') GROUP BY month order by month; hasthag : film_pedb hasthag that could be used but not yet : _______film_plastique SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______film_pedb' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-10-01' and date <= '2025-10-31') GROUP BY month order by month; hasthag : pet_clair hasthag that could be used but not yet : _______pet_clair,bouchon,etiquette,barquette_avec_film,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______pet_clair' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-10-01' and date <= '2025-10-31') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((31915,),), 'unwanted_material_monthly_percentage': ((0.03377028182701559,),), 'material_repartition': (('pcnc', 20455), ('refus', 1853), ('film_pedb', 965), ('pet_clair', 19)), 'material_dict': {'pcnc': 20455, 'refus': 1853, 'autres': 984}, 'coverage_data': (('2025/10/31/', 0.0), ('2025/10/30/', 0.0), ('2025/10/29/', 0.0), ('2025/10/28/', 0.0), ('2025/10/27/', 0.0), ('2025/10/25/', 0.0), ('2025/10/24/', 0.0), ('2025/10/23/', 0.0), ('2025/10/18/', 0.0), ('2025/10/17/', 0.0), ('2025/10/16/', 0.0), ('2025/10/15/', 0.0), ('2025/10/14/', 0.0), ('2025/10/13/', 0.0), ('2025/10/11/', 0.0), ('2025/10/10/', 0.0), ('2025/10/09/', 0.0), ('2025/10/08/', 0.0), ('2025/10/07/', 0.0), ('2025/10/06/', 0.0), ('2025/10/04/', 0.0), ('2025/10/03/', 0.0), ('2025/10/02/', 0.0), ('2025/10/01/', 0.0)), 'impurety_average_data': ((datetime.date(2025, 10, 1), 0.03047079735116301, 9), (datetime.date(2025, 10, 2), 0.032563125591901304, 8), (datetime.date(2025, 10, 3), 0.033190392955016336, 37), (datetime.date(2025, 10, 4), 0.0191787406673183, 12), (datetime.date(2025, 10, 6), 0.02166285393424423, 9), (datetime.date(2025, 10, 7), 0.03624519829813158, 264), (datetime.date(2025, 10, 8), 0.02956766680335419, 15), (datetime.date(2025, 10, 9), 0.03851051620173753, 245), (datetime.date(2025, 10, 10), 0.04852099465184585, 621), (datetime.date(2025, 10, 11), 0.02921139924394423, 13), (datetime.date(2025, 10, 13), 0.029540529948775828, 11), (datetime.date(2025, 10, 14), 0.04214681514996028, 11), (datetime.date(2025, 10, 15), 0.03333524845938262, 53), (datetime.date(2025, 10, 16), 0.0439585101420121, 256), (datetime.date(2025, 10, 17), 0.02486024634868073, 49), (datetime.date(2025, 10, 18), 0.03320688824753461, 26), (datetime.date(2025, 10, 19), 0.0006011474452487174, 67), (datetime.date(2025, 10, 20), 0.04138215942278721, 56), (datetime.date(2025, 10, 21), 0.03783599915199182, 96), (datetime.date(2025, 10, 22), 0.02769197677402982, 9), (datetime.date(2025, 10, 27), 0.024750188245869154, 158), (datetime.date(2025, 10, 28), 0.062034902463103316, 62), (datetime.date(2025, 10, 29), 0.040594350287856816, 23), (datetime.date(2025, 10, 30), 0.02593760269525116, 325), (datetime.date(2025, 10, 31), 0.025733701743619216, 161)), 'impurety_average_data_per_hashtag': {'pcnc': ((datetime.date(2025, 10, 1), 0.02346134717141056, 9), (datetime.date(2025, 10, 2), 0.02605193787098246, 8), (datetime.date(2025, 10, 3), 0.024559393254799645, 37), (datetime.date(2025, 10, 4), 0.0191787406673183, 12), (datetime.date(2025, 10, 6), 0.008543810071287891, 9), (datetime.date(2025, 10, 7), 0.03269633937847861, 264), (datetime.date(2025, 10, 8), 0.022793915424389608, 15), (datetime.date(2025, 10, 9), 0.02876019097434975, 245), (datetime.date(2025, 10, 10), 0.04083093964280043, 621), (datetime.date(2025, 10, 11), 0.018820781989305712, 13), (datetime.date(2025, 10, 13), 0.020593870517580798, 11), (datetime.date(2025, 10, 14), 0.041535351530527134, 11), (datetime.date(2025, 10, 15), 0.02791970603456405, 53), (datetime.date(2025, 10, 16), 0.041229256760712284, 256), (datetime.date(2025, 10, 17), 0.016419756719764183, 49), (datetime.date(2025, 10, 18), 0.022977221674095723, 26), (datetime.date(2025, 10, 19), 0.0006011474452487174, 67), (datetime.date(2025, 10, 20), 0.03483403760352747, 56), (datetime.date(2025, 10, 21), 0.02812756211125899, 96), (datetime.date(2025, 10, 22), 0.0262130808040894, 9), (datetime.date(2025, 10, 27), 0.023310817290364536, 158), (datetime.date(2025, 10, 28), 0.02659461860651554, 62), (datetime.date(2025, 10, 29), 0.03861123703811612, 23), (datetime.date(2025, 10, 30), 0.01414713550905381, 325), (datetime.date(2025, 10, 31), 0.01753833071860241, 161)), 'refus': ((datetime.date(2025, 10, 1), 0.11539121977880656, 16), (datetime.date(2025, 10, 2), 0.07843930844907407, 11), (datetime.date(2025, 10, 3), 0.10035264384068346, 13), (datetime.date(2025, 10, 6), 0.1921756159060847, 9), (datetime.date(2025, 10, 7), 0.08291766443167306, 18), (datetime.date(2025, 10, 8), 0.07116197396403486, 8), (datetime.date(2025, 10, 9), 0.09969142976481989, 42), (datetime.date(2025, 10, 10), 0.13481613382491214, 12), (datetime.date(2025, 10, 11), 0.10704355501334667, 17), (datetime.date(2025, 10, 13), 0.09181306721846573, 14), (datetime.date(2025, 10, 14), 0.04701682204464739, 9), (datetime.date(2025, 10, 15), 0.07949759526507845, 17), (datetime.date(2025, 10, 16), 0.07115756197570434, 8), (datetime.date(2025, 10, 17), 0.06436148258923115, 12), (datetime.date(2025, 10, 18), 0.07083612427315668, 13), (datetime.date(2025, 10, 20), 0.08030917628980781, 12), (datetime.date(2025, 10, 21), 0.11646892850562005, 9), (datetime.date(2025, 10, 28), 0.16743623775496513, 10), (datetime.date(2025, 10, 29), 0.062325923076248596, 11), (datetime.date(2025, 10, 30), 0.1266182200644006, 9), (datetime.date(2025, 10, 31), 0.08834759141730032, 8)), 'film_pedb': ((datetime.date(2025, 10, 1), 0.07636549250548391, 27), (datetime.date(2025, 10, 2), 0.07312666916651167, 36), (datetime.date(2025, 10, 3), 0.07360202207526176, 10), (datetime.date(2025, 10, 6), 0.06201328671611222, 8), (datetime.date(2025, 10, 7), 0.08045683350791825, 27), (datetime.date(2025, 10, 8), 0.07837897193128233, 14), (datetime.date(2025, 10, 9), 0.06552826145710211, 11), (datetime.date(2025, 10, 10), 0.0683396594631419, 18), (datetime.date(2025, 10, 11), 0.04476573189558269, 26), (datetime.date(2025, 10, 13), 0.07713327555274926, 17), (datetime.date(2025, 10, 14), 0.04847387548405345, 18), (datetime.date(2025, 10, 15), 0.052570003762531264, 27), (datetime.date(2025, 10, 16), 0.05121518187885857, 9), (datetime.date(2025, 10, 17), 0.11523840014409713, 8), (datetime.date(2025, 10, 18), 0.08993800025386169, 11), (datetime.date(2025, 10, 20), 0.07001936123102188, 13), (datetime.date(2025, 10, 21), 0.05920966544629597, 11), (datetime.date(2025, 10, 22), 0.06804470966811847, 14), (datetime.date(2025, 10, 27), 0.06111324396388057, 19), (datetime.date(2025, 10, 28), 0.07050348686781897, 21), (datetime.date(2025, 10, 29), 0.05678979986932012, 9), (datetime.date(2025, 10, 30), 0.08016653425644577, 9), (datetime.date(2025, 10, 31), 0.050058675528796545, 14)), 'pet_clair': ((datetime.date(2025, 10, 2), 0.22366325346918656, 9), (datetime.date(2025, 10, 13), 0.16950628959705577, 10), (datetime.date(2025, 10, 18), 0.2444010541702677, 9), (datetime.date(2025, 10, 20), 0.14722206828493276, 8), (datetime.date(2025, 10, 30), 0.009599178480755142, 8), (datetime.date(2025, 10, 31), 0.017846162611329333, 17))}, 'quality_array': [['0.9877836297999346', '01102025'], ['0.5797989678536857', '02102025'], ['0.7476694589305041', '03102025'], ['0.43954673543678613', '04102025'], ['0.48504927315301727', '06102025'], ['0.5113435455223586', '07102025'], ['0.545070298174353', '08102025'], ['0.45855952609618394', '09102025'], ['0.48291709885628303', '10102025'], ['0.6331614613881166', '11102025'], ['0.5062319909379956', '13102025'], ['0.7632468632188871', '14102025'], ['1.0290408194957643', '15102025'], ['1.1336685240167912', '16102025'], ['1.3196162071860704', '17102025'], ['1.067170057648991', '18102025'], ['-0.51947067489091', '19102025'], ['0.47493272681732196', '20102025'], ['0.5362462479349779', '21102025'], ['1.1848262370858118', '22102025'], ['1.0738756897195803', '27102025'], ['1.2287941926381256', '28102025'], ['1.3455326613197958', '29102025'], ['1.017456423644107', '30102025'], ['1.116457648178445', '31102025']], 'number_of_batch': ((732,),), 'datou_id_sts': 4101, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.012918205022582627, 'nb_photo': 5, 'list_port_cont': '27463580,28108207', 'assoc_port': '27463495:27463580,28107855:28108207', 'assoc_mat': '27463495:autre:3327:27463580,28107855:autre:3327:28108207'}, {'unwanted_material': 'autre', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0013341026203662505, 'nb_photo': 334, 'list_port_cont': '27420354,27421103,27421493,27422890,27423794,27464702,27464706,27464912,27465076,27465292,27465618,27465960,27501479,27501851,27501934,27502239,27502374,27502556,27502674,27503452,27503951,27509211,27510363,27584011,27592768,27593254,27594099,27594587,27595476,27601087,27608774,27641941,27642332,27686193,27691923,27692566,27693736,27696625,27697234,27697488,27697788,27698266,27700879,27708285,27710400,27711862,27715471,27724731,27727323,27728093,27729650,27735013,27735964,27739528,27750073,27756621,27756765,27756853,27757483,27766909,27771139,27771760,27774735,27795790,27799611,27805802,27827728,27828029,27836605,27836727,27837545,27837752,27839495,27844340,27868749,27875838,27875994,27876255,27879627,27886729,27888908,27891182,27909611,27909640,27930553,27945512,27947028,28020305,28025692,28044516,28107784,28108298,28108747,28109214,28109516,28109958,28113232,28113623,28115916,28116271,28116615,28117028,28117408,28118105,28119308,28120108,28121845,28122432,28122742,28123043,28123372,28123926,28124936,2812535', 'assoc_port': '27418735:27421493,27418745:27421103,27418746:27423794,27418755:27420354,27418757:27422890,27463472:27464706,27463474:27465960,27463475:27465076,27463481:27465618,27463483:27465292,27463485:27464912,27463488:27464702,27499690:27503452,27499694:27501934,27499699:27502239,27499702:27502556,27499705:27503951,27499708:27501851,27499736:27501479,27499754:27502674,27499758:27502374,27508924:27509211,27508932:27510363,27582565:27584011,27592183:27594587,27592186:27595476,27592214:27594099,27592225:27593254,27592231:27592768,27600762:27601087,27606148:27608774,27641624:27642332,27641629:27641941,27685685:27686193,27691548:27698266,27691563:27697788,27691699:27700879,27691701:27697488,27691707:27697234,27691710:27693736,27691756:27696625,27691760:27692566,27691762:27691923,27704755:27708285,27710102:27710400,27710103:27715471,27711758:27711862,27724672:27724731,27727085:27727323,27727917:27728093,27729545:27729650,27734955:27735013,27735875:27735964,27739475:27739528,27749761:27750073,27756449:27757483,27756454:2775676', 'assoc_mat': '27418735:autre:3594:27421493,27418745:autre:3594:27421103,27418746:autre:3594:27423794,27418755:autre:3594:27420354,27418757:autre:3594:27422890,27463472:autre:3594:27464706,27463474:autre:3594:27465960,27463475:autre:3594:27465076,27463481:autre:3594:27465618,27463483:autre:3594:27465292,27463485:autre:3594:27464912,27463488:autre:3594:27464702,27499690:autre:3594:27503452,27499694:autre:3594:27501934,27499699:autre:3594:27502239,27499702:autre:3594:27502556,27499705:autre:3594:27503951,27499708:autre:3594:27501851,27499736:autre:3594:27501479,27499754:autre:3594:27502674,27499758:autre:3594:27502374,27508924:autre:3594:27509211,27508932:autre:3594:27510363,27582565:autre:3594:27584011,27592183:autre:3594:27594587,27592186:autre:3594:27595476,27592214:autre:3594:27594099,27592225:autre:3594:27593254,27592231:autre:3594:27592768,27600762:autre:3594:27601087,27606148:autre:3594:27608774,27641624:autre:3594:27642332,27641629:autre:3594:27641941,27685685:autre:3594:27686193,27691548:autre:3594:27698266,27691563:'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.016687255950586448, 'nb_photo': 6, 'list_port_cont': '27418977,27606298,27771566,27918712,28108828', 'assoc_port': '27418793:27418977,27606180:27606298,27770943:27771566,27918365:27918712,28108431:28108828', 'assoc_mat': '27418793:barquette_opaque:4461:27418977,27606180:barquette_opaque:4461:27606298,27770943:barquette_opaque:4461:27771566,27918365:barquette_opaque:4461:27918712,28108431:barquette_opaque:4461:28108828'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.001050001707800891, 'nb_photo': 2734, 'list_port_cont': '27418938,27420094,27420184,27420400,27420568,27420932,27421128,27421338,27421737,27421864,27421934,27422251,27422436,27422662,27422918,27423099,27423594,27423998,27424254,27428711,27428928,27432684,27463637,27464355,27464490,27464602,27464804,27464896,27465303,27466124,27466302,27466435,27466841,27466997,27467192,27467540,27467928,27468983,27470103,27499780,27500586,27500859,27501179,27501371,27501501,27501669,27502413,27502721,27502847,27503003,27503104,27503774,27503890,27504853,27505150,27506136,27506738,27506880,27508984,27510424,27510541,27510601,27510729,27510915,27516627,27516734,27582730,27595498,27596194,27596417,27596530,27602959,27603078,27603298,27603312,27603336,27603348,27603368,27603369,27603390,27606234,27606275,27606490,27608948,27609072,27609192,27609349,27609485,27609645,27609810,27609978,27610110,27611558,27612259,27616464,27616764,27617481,27622883,27623500,27629770,27630028,27630254,27630556,27641783,27671980,27686447,27686493,27686730,27687067,27687342,27687589,27688317,27688599,2768923', 'assoc_port': '27418726:27420094,27418727:27420184,27418728:27420400,27418729:27420568,27418731:27420932,27418732:27421128,27418734:27421338,27418737:27421737,27418739:27421934,27418740:27422251,27418742:27422436,27418744:27422662,27418747:27422918,27418749:27423099,27418753:27423594,27418759:27423998,27418763:27424254,27418767:27428711,27418792:27428928,27418795:27421864,27418800:27418938,27432639:27432684,27463445:27464355,27463446:27464490,27463447:27464602,27463473:27464804,27463476:27470103,27463482:27468983,27463484:27466124,27463487:27466302,27463489:27466435,27463492:27466841,27463493:27466997,27463496:27467192,27463499:27467540,27463506:27467928,27463508:27464896,27463510:27465303,27463512:27463637,27499684:27500586,27499685:27504853,27499686:27500859,27499687:27505150,27499688:27501179,27499689:27501371,27499691:27501501,27499692:27501669,27499695:27506136,27499698:27502413,27499701:27502721,27499707:27502847,27499710:27503003,27499711:27503104,27499714:27506738,27499718:27506880,27499753:27503774,27499756:2750389', 'assoc_mat': '27418726:barquette_opaque:4207:27420094,27418727:barquette_opaque:4207:27420184,27418728:barquette_opaque:4207:27420400,27418729:barquette_opaque:4207:27420568,27418731:barquette_opaque:4207:27420932,27418732:barquette_opaque:4207:27421128,27418734:barquette_opaque:4207:27421338,27418737:barquette_opaque:4207:27421737,27418739:barquette_opaque:4207:27421934,27418740:barquette_opaque:4207:27422251,27418742:barquette_opaque:4207:27422436,27418744:barquette_opaque:4207:27422662,27418747:barquette_opaque:4207:27422918,27418749:barquette_opaque:4207:27423099,27418753:barquette_opaque:4207:27423594,27418759:barquette_opaque:4207:27423998,27418763:barquette_opaque:4207:27424254,27418767:barquette_opaque:4207:27428711,27418792:barquette_opaque:4207:27428928,27418795:barquette_opaque:4207:27421864,27418800:barquette_opaque:4207:27418938,27432639:barquette_opaque:4207:27432684,27463445:barquette_opaque:4207:27464355,27463446:barquette_opaque:4207:27464490,27463447:barquette_opaque:4207:27464602,27463473:barquette_opaqu'}, {'unwanted_material': 'bouchon', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.004054244229126342, 'nb_photo': 5, 'list_port_cont': '27463584,28107739,28108206', 'assoc_port': '27463495:27463584,28107402:28107739,28107855:28108206', 'assoc_mat': '27463495:bouchon:3327:27463584,28107402:bouchon:3327:28107739,28107855:bouchon:3327:28108206'}, {'unwanted_material': 'carton', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.005690070892308352, 'nb_photo': 137, 'list_port_cont': '27418975,27419136,27419435,27463602,27463881,27463940,27499841,27500136,27583087,27583664,27583992,27592467,27606296,27606423,27641714,27641962,27686002,27686248,27686351,27691799,27692072,27711913,27728725,27749877,27749962,27766769,27771558,27771853,27805484,27808574,27830281,27868497,27875044,27930396,27948490,28022417,28022890,28031876,28034094,28049312,28106709,28106889,28107522,28107979,28108052,28108834,28109224,28111126,28111308,28116180,28116823,28117426,28117695,28118421,28118778,28119066,28119575,28121573,28128326', 'assoc_port': '27418738:27419435,27418764:27419136,27418793:27418975,27463478:27463940,27463486:27463881,27463501:27463602,27499715:27500136,27499761:27499841,27582568:27583992,27582573:27583664,27582585:27583087,27592220:27592467,27606142:27606423,27606180:27606296,27641634:27641962,27641639:27641714,27685670:27686248,27685683:27686351,27685684:27686002,27691582:27691799,27691729:27692072,27711756:27711913,27728621:27728725,27749755:27749962,27749756:27749877,27766715:27766769,27770943:27771558,27770946:27771853,27805407:27805484,27808484:27808574,27830132:27830281,27868455:27868497,27874707:27875044,27930306:27930396,27948341:27948490,28022255:28022890,28022262:28022417,28024764:28034094,28031589:28031876,28033123:28049312,28106269:28119575,28106430:28111308,28106431:28111126,28106436:28116180,28106456:28121573,28106469:28106709,28106532:28119066,28106536:28128326,28106550:28107522,28106644:28106889,28106780:28118421,28107405:28118778,28107442:28107979,28107445:28116823,28107780:28117695,28107836:28109224,28107873:2810805', 'assoc_mat': '27418738:carton:4461:27419435,27418764:carton:4461:27419136,27418793:carton:4461:27418975,27463478:carton:4461:27463940,27463486:carton:4461:27463881,27463501:carton:4461:27463602,27499715:carton:4461:27500136,27499761:carton:4461:27499841,27582568:carton:4461:27583992,27582573:carton:4461:27583664,27582585:carton:4461:27583087,27592220:carton:4461:27592467,27606142:carton:4461:27606423,27606180:carton:4461:27606296,27641634:carton:4461:27641962,27641639:carton:4461:27641714,27685670:carton:4461:27686248,27685683:carton:4461:27686351,27685684:carton:4461:27686002,27691582:carton:4461:27691799,27691729:carton:4461:27692072,27711756:carton:4461:27711913,27728621:carton:4461:27728725,27749755:carton:4461:27749962,27749756:carton:4461:27749877,27766715:carton:4461:27766769,27770943:carton:4461:27771558,27770946:carton:4461:27771853,27805407:carton:4461:27805484,27808484:carton:4461:27808574,27830132:carton:4461:27830281,27868455:carton:4461:27868497,27874707:carton:4461:27875044,27930306:carton:4461:27930396,2794'}, {'unwanted_material': 'carton', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.9823530899579359, 'nb_photo': 5218, 'list_port_cont': '27418948,27420095,27420188,27420375,27420559,27421118,27421347,27421748,27421875,27422249,27422424,27422677,27422925,27423101,27423584,27423814,27424011,27424239,27424409,27428698,27428941,27432679,27463627,27464475,27464593,27464808,27464895,27465665,27466292,27466652,27466844,27466989,27467183,27467403,27467535,27467740,27467936,27468989,27470111,27499774,27500587,27500857,27501184,27501379,27501504,27501664,27502113,27502425,27502733,27502996,27503119,27503327,27503765,27503887,27504863,27505154,27506133,27506744,27506887,27508980,27510422,27510537,27510591,27510717,27510913,27516624,27516739,27582736,27594737,27595490,27596191,27596419,27596525,27602944,27603066,27603287,27603317,27603324,27603341,27603355,27603387,27606274,27608954,27609066,27609355,27609483,27609649,27609820,27610000,27610111,27611564,27612263,27616462,27616766,27617478,27623497,27629766,27630026,27630253,27630559,27641788,27670436,27671969,27686440,27686494,27686724,27687080,27687337,27687782,27688305,27688844,27689222,27689594,2769189', 'assoc_port': '27418726:27420095,27418727:27420188,27418728:27420375,27418729:27420559,27418732:27421118,27418734:27421347,27418737:27421748,27418740:27422249,27418742:27422424,27418744:27422677,27418747:27422925,27418749:27423101,27418753:27423584,27418756:27423814,27418759:27424011,27418763:27424239,27418766:27424409,27418767:27428698,27418792:27428941,27418795:27421875,27418800:27418948,27432639:27432679,27463446:27464475,27463447:27464593,27463473:27464808,27463476:27470111,27463479:27465665,27463482:27468989,27463487:27466292,27463491:27466652,27463492:27466844,27463493:27466989,27463496:27467183,27463498:27467403,27463499:27467535,27463502:27467740,27463506:27467936,27463508:27464895,27463512:27463627,27499684:27500587,27499685:27504863,27499686:27500857,27499687:27505154,27499688:27501184,27499689:27501379,27499691:27501504,27499692:27501664,27499695:27506133,27499697:27502113,27499698:27502425,27499701:27502733,27499710:27502996,27499711:27503119,27499714:27506744,27499717:27503327,27499718:27506887,27499753:2750376', 'assoc_mat': '27418726:carton:4207:27420095,27418727:carton:4207:27420188,27418728:carton:4207:27420375,27418729:carton:4207:27420559,27418732:carton:4207:27421118,27418734:carton:4207:27421347,27418737:carton:4207:27421748,27418740:carton:4207:27422249,27418742:carton:4207:27422424,27418744:carton:4207:27422677,27418747:carton:4207:27422925,27418749:carton:4207:27423101,27418753:carton:4207:27423584,27418756:carton:4207:27423814,27418759:carton:4207:27424011,27418763:carton:4207:27424239,27418766:carton:4207:27424409,27418767:carton:4207:27428698,27418792:carton:4207:27428941,27418795:carton:4207:27421875,27418800:carton:4207:27418948,27432639:carton:4207:27432679,27463446:carton:4207:27464475,27463447:carton:4207:27464593,27463473:carton:4207:27464808,27463476:carton:4207:27470111,27463479:carton:4207:27465665,27463482:carton:4207:27468989,27463487:carton:4207:27466292,27463491:carton:4207:27466652,27463492:carton:4207:27466844,27463493:carton:4207:27466989,27463496:carton:4207:27467183,27463498:carton:4207:27467403,2746'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.11880826110040273, 'nb_photo': 17, 'list_port_cont': '27463576,27766795,28010959,28108213,28113457', 'assoc_port': '27463495:27463576,27766720:27766795,28010441:28010959,28106529:28113457,28107855:28108213', 'assoc_mat': '27463495:carton:3327:27463576,27766720:carton:3327:27766795,28010441:carton:3327:28010959,28106529:carton:3327:28113457,28107855:carton:3327:28108213'}, {'unwanted_material': 'carton', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.004491002284790919, 'nb_photo': 602, 'list_port_cont': '27419388,27419704,27420361,27420759,27421104,27421456,27421495,27422896,27423796,27464695,27464710,27465074,27465300,27465498,27465620,27465964,27466603,27501486,27501846,27501931,27502234,27502378,27502555,27502691,27502948,27503459,27503950,27509213,27510367,27582866,27583295,27584014,27584715,27592773,27593257,27593709,27594103,27594581,27595793,27601086,27606471,27608779,27641940,27642324,27686198,27691927,27692575,27693737,27696272,27697237,27697481,27697782,27698263,27700872,27708282,27710395,27710997,27711861,27724732,27727329,27727735,27728092,27729644,27734421,27735018,27735963,27739525,27750337,27756619,27756762,27756854,27757486,27766906,27767799,27774158,27795784,27799609,27805800,27810676,27825619,27827433,27827734,27828030,27830439,27830635,27836600,27836723,27837549,27837745,27838103,27839494,27844344,27868754,27870057,27875814,27875991,27876260,27878337,27878816,27879628,27879962,27880180,27886733,27888902,27891188,27909608,27909635,27918612,27922420,27930550,27945159,27945508,27945692,2794726', 'assoc_port': '27418730:27420759,27418735:27421495,27418743:27421456,27418745:27421104,27418746:27423796,27418755:27420361,27418757:27422896,27418761:27419704,27418798:27419388,27463472:27464710,27463474:27465964,27463475:27465074,27463477:27465498,27463481:27465620,27463483:27465300,27463488:27464695,27463504:27466603,27499690:27503459,27499694:27501931,27499699:27502234,27499702:27502555,27499705:27503950,27499708:27501846,27499736:27501486,27499750:27502948,27499754:27502691,27499758:27502378,27508924:27509213,27508932:27510367,27582559:27584715,27582565:27584014,27582577:27583295,27582586:27582866,27592179:27595793,27592183:27594581,27592214:27594103,27592223:27593709,27592225:27593257,27592231:27592773,27600762:27601086,27606148:27608779,27606150:27606471,27641624:27642324,27641629:27641940,27685685:27686198,27691548:27698263,27691563:27697782,27691577:27696272,27691699:27700872,27691701:27697481,27691707:27697237,27691710:27693737,27691760:27692575,27691762:27691927,27704755:27708282,27710099:27710997,27710102:2771039', 'assoc_mat': '27418730:carton:3594:27420759,27418735:carton:3594:27421495,27418743:carton:3594:27421456,27418745:carton:3594:27421104,27418746:carton:3594:27423796,27418755:carton:3594:27420361,27418757:carton:3594:27422896,27418761:carton:3594:27419704,27418798:carton:3594:27419388,27463472:carton:3594:27464710,27463474:carton:3594:27465964,27463475:carton:3594:27465074,27463477:carton:3594:27465498,27463481:carton:3594:27465620,27463483:carton:3594:27465300,27463488:carton:3594:27464695,27463504:carton:3594:27466603,27499690:carton:3594:27503459,27499694:carton:3594:27501931,27499699:carton:3594:27502234,27499702:carton:3594:27502555,27499705:carton:3594:27503950,27499708:carton:3594:27501846,27499736:carton:3594:27501486,27499750:carton:3594:27502948,27499754:carton:3594:27502691,27499758:carton:3594:27502378,27508924:carton:3594:27509213,27508932:carton:3594:27510367,27582559:carton:3594:27584715,27582565:carton:3594:27584014,27582577:carton:3594:27583295,27582586:carton:3594:27582866,27592179:carton:3594:27595793,2759'}, {'unwanted_material': 'ela', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 1.1134562887965346e-05, 'nb_photo': 30, 'list_port_cont': '27421863,27715360,27909542,27909553,27949172,28021269', 'assoc_port': '27418795:27421863,27704747:27715360,27909527:27909553,27909530:27909542,27948335:27949172,27958871:28021269', 'assoc_mat': '27418795:ela:4207:27421863,27704747:ela:4207:27715360,27909527:ela:4207:27909553,27909530:ela:4207:27909542,27948335:ela:4207:27949172,27958871:ela:4207:28021269'}, {'unwanted_material': 'etiquette', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.000268508604521373, 'nb_photo': 2, 'list_port_cont': '27727992,28117796', 'assoc_port': '27727916:27727992,28107777:28117796', 'assoc_mat': '27727916:etiquette:4461:27727992,28107777:etiquette:4461:28117796'}, {'unwanted_material': 'etiquette', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.000331231933872294, 'nb_photo': 1147, 'list_port_cont': '27420177,27420373,27421123,27421336,27421862,27421928,27422253,27422425,27422652,27422912,27423090,27423410,27424010,27424243,27428704,27432682,27464595,27464900,27465307,27466122,27466298,27466850,27466990,27467189,27467396,27468981,27470112,27499773,27500584,27500858,27501381,27501505,27502995,27503114,27503766,27503886,27504860,27505155,27506878,27508981,27510430,27510542,27510589,27510716,27510918,27516747,27582740,27595487,27596425,27596532,27602950,27603064,27603190,27603304,27603333,27603346,27603367,27603392,27606280,27608788,27608956,27609077,27609351,27609640,27609819,27609964,27617474,27623505,27629762,27630029,27641787,27670440,27686491,27687065,27688303,27688586,27689233,27689595,27691905,27695886,27698313,27705024,27708516,27708670,27709170,27709353,27709520,27709902,27710110,27710264,27710544,27711960,27712406,27712902,27715366,27715526,27715950,27719824,27720785,27728632,27730044,27730415,27730442,27730491,27731071,27733362,27734398,27735958,27736070,27737413,27740473,27740500,27749148,2775001', 'assoc_port': '27418727:27420177,27418728:27420373,27418732:27421123,27418734:27421336,27418739:27421928,27418740:27422253,27418742:27422425,27418744:27422652,27418747:27422912,27418749:27423090,27418750:27423410,27418759:27424010,27418763:27424243,27418767:27428704,27418795:27421862,27432639:27432682,27463447:27464595,27463476:27470112,27463482:27468981,27463484:27466122,27463487:27466298,27463492:27466850,27463493:27466990,27463496:27467189,27463498:27467396,27463508:27464900,27463510:27465307,27499684:27500584,27499685:27504860,27499686:27500858,27499687:27505155,27499689:27501381,27499691:27501505,27499710:27502995,27499711:27503114,27499718:27506878,27499753:27503766,27499756:27503886,27499760:27499773,27508925:27510430,27508926:27510589,27508927:27510716,27508929:27510542,27508931:27510918,27508934:27508981,27516595:27516747,27582558:27608788,27582561:27608956,27582563:27609077,27582571:27609351,27582579:27609640,27582580:27609819,27582582:27609964,27582588:27582740,27592178:27603392,27592181:27603367,27592185:2760333', 'assoc_mat': '27418727:etiquette:4207:27420177,27418728:etiquette:4207:27420373,27418732:etiquette:4207:27421123,27418734:etiquette:4207:27421336,27418739:etiquette:4207:27421928,27418740:etiquette:4207:27422253,27418742:etiquette:4207:27422425,27418744:etiquette:4207:27422652,27418747:etiquette:4207:27422912,27418749:etiquette:4207:27423090,27418750:etiquette:4207:27423410,27418759:etiquette:4207:27424010,27418763:etiquette:4207:27424243,27418767:etiquette:4207:27428704,27418795:etiquette:4207:27421862,27432639:etiquette:4207:27432682,27463447:etiquette:4207:27464595,27463476:etiquette:4207:27470112,27463482:etiquette:4207:27468981,27463484:etiquette:4207:27466122,27463487:etiquette:4207:27466298,27463492:etiquette:4207:27466850,27463493:etiquette:4207:27466990,27463496:etiquette:4207:27467189,27463498:etiquette:4207:27467396,27463508:etiquette:4207:27464900,27463510:etiquette:4207:27465307,27499684:etiquette:4207:27500584,27499685:etiquette:4207:27504860,27499686:etiquette:4207:27500858,27499687:etiquette:4207:27505155,2'}, {'unwanted_material': 'film_plastique', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.9275231751574334, 'nb_photo': 1495, 'list_port_cont': '27418881,27418967,27419133,27419294,27419442,27463601,27463808,27463886,27463943,27499842,27500027,27500130,27500214,27583084,27583669,27583981,27584118,27592464,27592658,27606294,27606331,27606431,27641713,27641961,27642092,27686000,27686262,27686350,27691795,27692064,27692253,27710171,27711926,27727991,27728719,27728835,27734452,27738514,27749874,27749963,27756571,27756625,27766770,27771356,27771565,27771843,27805481,27808571,27825466,27830270,27839448,27868494,27868655,27875046,27886576,27918701,27918941,27930390,27946924,27946997,27948494,28007036,28022404,28022801,28022900,28031878,28033568,28034102,28044536,28049310,28106712,28106886,28107333,28107512,28107981,28108038,28108101,28108833,28109000,28109229,28109639,28110050,28110259,28111066,28111130,28111315,28112431,28116174,28116818,28117422,28117458,28117689,28117795,28118232,28118417,28118771,28119080,28119573,28121576,28128334,28132613', 'assoc_port': '27418738:27419442,27418752:27419294,27418764:27419133,27418793:27418967,27418799:27418881,27463478:27463943,27463486:27463886,27463490:27463808,27463501:27463601,27499704:27500214,27499715:27500130,27499751:27500027,27499761:27499842,27582566:27584118,27582568:27583981,27582573:27583669,27582585:27583084,27592213:27592658,27592220:27592464,27606142:27606431,27606147:27606331,27606180:27606294,27641626:27642092,27641634:27641961,27641639:27641713,27685670:27686262,27685683:27686350,27685684:27686000,27691582:27691795,27691704:27692253,27691729:27692064,27710104:27710171,27711756:27711926,27727916:27727991,27728617:27728835,27728621:27728719,27734386:27734452,27738493:27738514,27749755:27749963,27749756:27749874,27756451:27756571,27756452:27756625,27766715:27766770,27770943:27771565,27770946:27771843,27770950:27771356,27805407:27805481,27808484:27808571,27825269:27825466,27830132:27830270,27839273:27839448,27868454:27868655,27868455:27868494,27874707:27875046,27886513:27886576,27918334:27918941,27918365:2791870', 'assoc_mat': '27418738:film_plastique:4461:27419442,27418752:film_plastique:4461:27419294,27418764:film_plastique:4461:27419133,27418793:film_plastique:4461:27418967,27418799:film_plastique:4461:27418881,27463478:film_plastique:4461:27463943,27463486:film_plastique:4461:27463886,27463490:film_plastique:4461:27463808,27463501:film_plastique:4461:27463601,27499704:film_plastique:4461:27500214,27499715:film_plastique:4461:27500130,27499751:film_plastique:4461:27500027,27499761:film_plastique:4461:27499842,27582566:film_plastique:4461:27584118,27582568:film_plastique:4461:27583981,27582573:film_plastique:4461:27583669,27582585:film_plastique:4461:27583084,27592213:film_plastique:4461:27592658,27592220:film_plastique:4461:27592464,27606142:film_plastique:4461:27606431,27606147:film_plastique:4461:27606331,27606180:film_plastique:4461:27606294,27641626:film_plastique:4461:27642092,27641634:film_plastique:4461:27641961,27641639:film_plastique:4461:27641713,27685670:film_plastique:4461:27686262,27685683:film_plastique:4461:2768635'}, {'unwanted_material': 'film_plastique', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.005738575542220781, 'nb_photo': 14864, 'list_port_cont': '27418941,27419862,27420096,27420186,27420371,27420561,27420928,27421121,27421342,27421739,27421866,27421924,27422240,27422421,27422679,27422922,27423096,27423425,27423595,27423824,27424008,27424249,27424399,27428705,27428942,27432680,27463629,27464357,27464478,27464596,27464805,27464892,27465302,27465666,27465835,27466116,27466294,27466436,27466656,27466840,27466993,27467180,27467404,27467536,27467733,27467927,27468977,27470114,27499787,27500590,27500852,27501176,27501373,27501500,27501660,27502119,27502416,27502724,27502839,27502997,27503112,27503319,27503759,27503891,27504854,27505146,27506130,27506736,27506888,27508988,27510428,27510543,27510600,27510719,27510846,27510910,27516626,27516737,27582741,27594731,27595492,27596193,27596421,27596535,27602945,27603071,27603191,27603295,27603315,27603328,27603350,27603361,27603384,27603400,27606226,27606268,27606487,27608955,27609074,27609200,27609347,27609492,27609635,27609821,27609979,27610100,27611571,27612252,27616466,27616755,27617485,27622878,27623496,2762977', 'assoc_port': '27418725:27419862,27418726:27420096,27418727:27420186,27418728:27420371,27418729:27420561,27418731:27420928,27418732:27421121,27418734:27421342,27418737:27421739,27418739:27421924,27418740:27422240,27418742:27422421,27418744:27422679,27418747:27422922,27418749:27423096,27418750:27423425,27418753:27423595,27418756:27423824,27418759:27424008,27418763:27424249,27418766:27424399,27418767:27428705,27418792:27428942,27418795:27421866,27418800:27418941,27432639:27432680,27463445:27464357,27463446:27464478,27463447:27464596,27463473:27464805,27463476:27470114,27463479:27465666,27463480:27465835,27463482:27468977,27463484:27466116,27463487:27466294,27463489:27466436,27463491:27466656,27463492:27466840,27463493:27466993,27463496:27467180,27463498:27467404,27463499:27467536,27463502:27467733,27463506:27467927,27463508:27464892,27463510:27465302,27463512:27463629,27499684:27500590,27499685:27504854,27499686:27500852,27499687:27505146,27499688:27501176,27499689:27501373,27499691:27501500,27499692:27501660,27499695:2750613', 'assoc_mat': '27418725:film_plastique:4207:27419862,27418726:film_plastique:4207:27420096,27418727:film_plastique:4207:27420186,27418728:film_plastique:4207:27420371,27418729:film_plastique:4207:27420561,27418731:film_plastique:4207:27420928,27418732:film_plastique:4207:27421121,27418734:film_plastique:4207:27421342,27418737:film_plastique:4207:27421739,27418739:film_plastique:4207:27421924,27418740:film_plastique:4207:27422240,27418742:film_plastique:4207:27422421,27418744:film_plastique:4207:27422679,27418747:film_plastique:4207:27422922,27418749:film_plastique:4207:27423096,27418750:film_plastique:4207:27423425,27418753:film_plastique:4207:27423595,27418756:film_plastique:4207:27423824,27418759:film_plastique:4207:27424008,27418763:film_plastique:4207:27424249,27418766:film_plastique:4207:27424399,27418767:film_plastique:4207:27428705,27418792:film_plastique:4207:27428942,27418795:film_plastique:4207:27421866,27418800:film_plastique:4207:27418941,27432639:film_plastique:4207:27432680,27463445:film_plastique:4207:2746435'}, {'unwanted_material': 'kraft', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00014453050925727272, 'nb_photo': 23, 'list_port_cont': '27421126,27424240,27506889,27629768,27709521,27710251,27740488,27791005,27812306,27884565,27909540,28021268,28062659,28279649', 'assoc_port': '27418732:27421126,27418763:27424240,27499718:27506889,27606141:27629768,27691703:27709521,27691727:27710251,27740472:27740488,27789756:27791005,27812255:27812306,27884188:27884565,27909530:27909540,27958871:28021268,28006905:28062659,28106783:28279649', 'assoc_mat': '27418732:kraft:4207:27421126,27418763:kraft:4207:27424240,27499718:kraft:4207:27506889,27606141:kraft:4207:27629768,27691703:kraft:4207:27709521,27691727:kraft:4207:27710251,27740472:kraft:4207:27740488,27789756:kraft:4207:27791005,27812255:kraft:4207:27812306,27884188:kraft:4207:27884565,27909530:kraft:4207:27909540,27958871:kraft:4207:28021268,28006905:kraft:4207:28062659,28106783:kraft:4207:28279649'}, {'unwanted_material': 'metal', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.011692036280533944, 'nb_photo': 1, 'list_port_cont': '27583663', 'assoc_port': '27582573:27583663', 'assoc_mat': '27582573:metal:4461:27583663'}, {'unwanted_material': 'metal', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0051882316820514975, 'nb_photo': 803, 'list_port_cont': '27418937,27420185,27420376,27420558,27421129,27421346,27421867,27421939,27422241,27422428,27422646,27422924,27423103,27423999,27432678,27464597,27464898,27465832,27466301,27466655,27466852,27466996,27467394,27467735,27467933,27468974,27470104,27499781,27500589,27501183,27501497,27503105,27503771,27503877,27504851,27505147,27506128,27506881,27508977,27510721,27510917,27516740,27595493,27596424,27602948,27603074,27603296,27603310,27603364,27603385,27606271,27608949,27609064,27609636,27609980,27612266,27616460,27616769,27617480,27622879,27623492,27629764,27630039,27630564,27641785,27686448,27686489,27687071,27687341,27688309,27689231,27689812,27691901,27695884,27698189,27698321,27705013,27708347,27708509,27708675,27709517,27709628,27709691,27709906,27710117,27710539,27712419,27712785,27712904,27715367,27715617,27715951,27719829,27720798,27727128,27727284,27728316,27730379,27730433,27730484,27730546,27731073,27733369,27733569,27734401,27735956,27736064,27736509,27737422,27740487,27740497,27750080,27750102,2775015', 'assoc_port': '27418727:27420185,27418728:27420376,27418729:27420558,27418732:27421129,27418734:27421346,27418739:27421939,27418740:27422241,27418742:27422428,27418744:27422646,27418747:27422924,27418749:27423103,27418759:27423999,27418795:27421867,27418800:27418937,27432639:27432678,27463447:27464597,27463476:27470104,27463480:27465832,27463482:27468974,27463487:27466301,27463491:27466655,27463492:27466852,27463493:27466996,27463498:27467394,27463502:27467735,27463506:27467933,27463508:27464898,27499684:27500589,27499685:27504851,27499687:27505147,27499688:27501183,27499691:27501497,27499695:27506128,27499711:27503105,27499718:27506881,27499753:27503771,27499756:27503877,27499760:27499781,27508927:27510721,27508931:27510917,27508934:27508977,27516595:27516740,27582561:27608949,27582563:27609064,27582579:27609636,27582582:27609980,27592178:27603385,27592181:27603364,27592216:27603296,27592217:27603310,27592218:27603074,27592227:27596424,27595363:27595493,27600763:27602948,27606141:27629764,27606143:27630039,27606145:2762349', 'assoc_mat': '27418727:metal:4207:27420185,27418728:metal:4207:27420376,27418729:metal:4207:27420558,27418732:metal:4207:27421129,27418734:metal:4207:27421346,27418739:metal:4207:27421939,27418740:metal:4207:27422241,27418742:metal:4207:27422428,27418744:metal:4207:27422646,27418747:metal:4207:27422924,27418749:metal:4207:27423103,27418759:metal:4207:27423999,27418795:metal:4207:27421867,27418800:metal:4207:27418937,27432639:metal:4207:27432678,27463447:metal:4207:27464597,27463476:metal:4207:27470104,27463480:metal:4207:27465832,27463482:metal:4207:27468974,27463487:metal:4207:27466301,27463491:metal:4207:27466655,27463492:metal:4207:27466852,27463493:metal:4207:27466996,27463498:metal:4207:27467394,27463502:metal:4207:27467735,27463506:metal:4207:27467933,27463508:metal:4207:27464898,27499684:metal:4207:27500589,27499685:metal:4207:27504851,27499687:metal:4207:27505147,27499688:metal:4207:27501183,27499691:metal:4207:27501497,27499695:metal:4207:27506128,27499711:metal:4207:27503105,27499718:metal:4207:27506881,27499753:'}, {'unwanted_material': 'metal', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.00031845171456874557, 'nb_photo': 144, 'list_port_cont': '27419696,27421102,27465504,27501856,27502381,27502672,27503948,27509219,27583289,27592767,27594589,27608776,27641943,27642329,27686195,27686651,27692576,27693732,27696269,27696627,27697233,27697789,27700875,27710402,27715467,27727332,27729647,27756857,27757484,27766908,27767801,27771141,27799606,27827731,27830441,27836603,27838101,27839500,27868747,27875833,27879620,27888904,27909612,27945162,27945513,27947259,28013640,28020309,28044518,28045012,28108303,28109206,28109526,28112376,28112819,28115918,28117407,28118100,28120111,28121851,28122737,28123049,28123367,28125349,28126017,28128441,28128842,28129225', 'assoc_port': '27418745:27421102,27418761:27419696,27463477:27465504,27499705:27503948,27499708:27501856,27499754:27502672,27499758:27502381,27508924:27509219,27582577:27583289,27592183:27594589,27592231:27592767,27606148:27608776,27641624:27642329,27641629:27641943,27685658:27686651,27685685:27686195,27691563:27697789,27691577:27696269,27691699:27700875,27691707:27697233,27691710:27693732,27691756:27696627,27691760:27692576,27710102:27710402,27710103:27715467,27727085:27727332,27729545:27729647,27756449:27757484,27756455:27756857,27766717:27767801,27766721:27766908,27770948:27771141,27799345:27799606,27827191:27827731,27830135:27830441,27831149:27838101,27836511:27836603,27839271:27839500,27868453:27868747,27874751:27875833,27877920:27879620,27888879:27888904,27909529:27909612,27944806:27947259,27944828:27945513,27944829:27945162,28012680:28020309,28012681:28013640,28044321:28045012,28044330:28044518,28106440:28128842,28106523:28128441,28106540:28129225,28106544:28126017,28106546:28125349,28106603:28122737,28107399:2812185', 'assoc_mat': '27418745:metal:3594:27421102,27418761:metal:3594:27419696,27463477:metal:3594:27465504,27499705:metal:3594:27503948,27499708:metal:3594:27501856,27499754:metal:3594:27502672,27499758:metal:3594:27502381,27508924:metal:3594:27509219,27582577:metal:3594:27583289,27592183:metal:3594:27594589,27592231:metal:3594:27592767,27606148:metal:3594:27608776,27641624:metal:3594:27642329,27641629:metal:3594:27641943,27685658:metal:3594:27686651,27685685:metal:3594:27686195,27691563:metal:3594:27697789,27691577:metal:3594:27696269,27691699:metal:3594:27700875,27691707:metal:3594:27697233,27691710:metal:3594:27693732,27691756:metal:3594:27696627,27691760:metal:3594:27692576,27710102:metal:3594:27710402,27710103:metal:3594:27715467,27727085:metal:3594:27727332,27729545:metal:3594:27729647,27756449:metal:3594:27757484,27756455:metal:3594:27756857,27766717:metal:3594:27767801,27766721:metal:3594:27766908,27770948:metal:3594:27771141,27799345:metal:3594:27799606,27827191:metal:3594:27827731,27830135:metal:3594:27830441,27831149:'}, {'unwanted_material': 'papier', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.07153413732892204, 'nb_photo': 5023, 'list_port_cont': '27418871,27418973,27419124,27419295,27419447,27463588,27463798,27463889,27463938,27499839,27500025,27500123,27500208,27583089,27583668,27583986,27584121,27592476,27592659,27606287,27606325,27606422,27641717,27641954,27642082,27686001,27686249,27686356,27691792,27692067,27692261,27710174,27711920,27727993,27728727,27728842,27734457,27738523,27749881,27749967,27756577,27756631,27766758,27771358,27771553,27771852,27805485,27808562,27825476,27830275,27839441,27868493,27868652,27875041,27886577,27918702,27918947,27930398,27946913,27947001,27948489,28007037,28022411,28022806,28022896,28031871,28033558,28034100,28044528,28049314,28106696,28106862,28107335,28107520,28107977,28108041,28108094,28108831,28108998,28109222,28109649,28110051,28110256,28111073,28111132,28111314,28112446,28116178,28116812,28117427,28117466,28117693,28117798,28118223,28118409,28118774,28119073,28119564,28121567,28128333,28132615', 'assoc_port': '27418738:27419447,27418752:27419295,27418764:27419124,27418793:27418973,27418799:27418871,27463478:27463938,27463486:27463889,27463490:27463798,27463501:27463588,27499704:27500208,27499715:27500123,27499751:27500025,27499761:27499839,27582566:27584121,27582568:27583986,27582573:27583668,27582585:27583089,27592213:27592659,27592220:27592476,27606142:27606422,27606147:27606325,27606180:27606287,27641626:27642082,27641634:27641954,27641639:27641717,27685670:27686249,27685683:27686356,27685684:27686001,27691582:27691792,27691704:27692261,27691729:27692067,27710104:27710174,27711756:27711920,27727916:27727993,27728617:27728842,27728621:27728727,27734386:27734457,27738493:27738523,27749755:27749967,27749756:27749881,27756451:27756577,27756452:27756631,27766715:27766758,27770943:27771553,27770946:27771852,27770950:27771358,27805407:27805485,27808484:27808562,27825269:27825476,27830132:27830275,27839273:27839441,27868454:27868652,27868455:27868493,27874707:27875041,27886513:27886577,27918334:27918947,27918365:2791870', 'assoc_mat': '27418738:papier:4461:27419447,27418752:papier:4461:27419295,27418764:papier:4461:27419124,27418793:papier:4461:27418973,27418799:papier:4461:27418871,27463478:papier:4461:27463938,27463486:papier:4461:27463889,27463490:papier:4461:27463798,27463501:papier:4461:27463588,27499704:papier:4461:27500208,27499715:papier:4461:27500123,27499751:papier:4461:27500025,27499761:papier:4461:27499839,27582566:papier:4461:27584121,27582568:papier:4461:27583986,27582573:papier:4461:27583668,27582585:papier:4461:27583089,27592213:papier:4461:27592659,27592220:papier:4461:27592476,27606142:papier:4461:27606422,27606147:papier:4461:27606325,27606180:papier:4461:27606287,27641626:papier:4461:27642082,27641634:papier:4461:27641954,27641639:papier:4461:27641717,27685670:papier:4461:27686249,27685683:papier:4461:27686356,27685684:papier:4461:27686001,27691582:papier:4461:27691792,27691704:papier:4461:27692261,27691729:papier:4461:27692067,27710104:papier:4461:27710174,27711756:papier:4461:27711920,27727916:papier:4461:27727993,2772'}, {'unwanted_material': 'papier', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.006848099963115994, 'nb_photo': 20149, 'list_port_cont': '27418946,27419865,27420102,27420174,27420369,27420560,27420930,27421127,27421345,27421740,27421869,27421937,27422254,27422437,27422674,27422926,27423092,27423424,27423585,27424002,27424250,27424400,27428699,27428938,27432685,27463638,27464350,27464480,27464600,27464816,27464906,27465311,27465659,27465826,27466114,27466287,27466445,27466653,27466847,27467004,27467188,27467391,27467541,27467736,27467939,27468975,27470107,27499784,27500855,27501177,27501367,27501499,27501668,27502123,27502420,27502727,27502842,27503001,27503117,27503321,27503764,27503883,27504864,27505140,27506137,27506734,27506890,27508986,27510434,27510545,27510590,27510731,27510847,27510908,27516635,27516735,27582727,27594738,27595497,27596201,27596420,27596527,27602952,27603072,27603196,27603301,27603306,27603323,27603338,27603365,27603372,27603398,27606235,27606270,27606495,27608789,27608946,27609069,27609188,27609345,27609497,27609648,27609812,27610002,27610101,27611560,27612264,27616461,27616759,27617484,27622884,27623498,27629769,2763003', 'assoc_port': '27418725:27419865,27418726:27420102,27418727:27420174,27418728:27420369,27418729:27420560,27418731:27420930,27418732:27421127,27418734:27421345,27418737:27421740,27418739:27421937,27418740:27422254,27418742:27422437,27418744:27422674,27418747:27422926,27418749:27423092,27418750:27423424,27418753:27423585,27418759:27424002,27418763:27424250,27418766:27424400,27418767:27428699,27418792:27428938,27418795:27421869,27418800:27418946,27432639:27432685,27463445:27464350,27463446:27464480,27463447:27464600,27463473:27464816,27463476:27470107,27463479:27465659,27463480:27465826,27463482:27468975,27463484:27466114,27463487:27466287,27463489:27466445,27463491:27466653,27463492:27466847,27463493:27467004,27463496:27467188,27463498:27467391,27463499:27467541,27463502:27467736,27463506:27467939,27463508:27464906,27463510:27465311,27463512:27463638,27499685:27504864,27499686:27500855,27499687:27505140,27499688:27501177,27499689:27501367,27499691:27501499,27499692:27501668,27499695:27506137,27499697:27502123,27499698:2750242', 'assoc_mat': '27418725:papier:4207:27419865,27418726:papier:4207:27420102,27418727:papier:4207:27420174,27418728:papier:4207:27420369,27418729:papier:4207:27420560,27418731:papier:4207:27420930,27418732:papier:4207:27421127,27418734:papier:4207:27421345,27418737:papier:4207:27421740,27418739:papier:4207:27421937,27418740:papier:4207:27422254,27418742:papier:4207:27422437,27418744:papier:4207:27422674,27418747:papier:4207:27422926,27418749:papier:4207:27423092,27418750:papier:4207:27423424,27418753:papier:4207:27423585,27418759:papier:4207:27424002,27418763:papier:4207:27424250,27418766:papier:4207:27424400,27418767:papier:4207:27428699,27418792:papier:4207:27428938,27418795:papier:4207:27421869,27418800:papier:4207:27418946,27432639:papier:4207:27432685,27463445:papier:4207:27464350,27463446:papier:4207:27464480,27463447:papier:4207:27464600,27463473:papier:4207:27464816,27463476:papier:4207:27470107,27463479:papier:4207:27465659,27463480:papier:4207:27465826,27463482:papier:4207:27468975,27463484:papier:4207:27466114,2746'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.04079768424702879, 'nb_photo': 21, 'list_port_cont': '27463583,27766794,28010958,28108211,28113458', 'assoc_port': '27463495:27463583,27766720:27766794,28010441:28010958,28106529:28113458,28107855:28108211', 'assoc_mat': '27463495:papier:3327:27463583,27766720:papier:3327:27766794,28010441:papier:3327:28010958,28106529:papier:3327:28113458,28107855:papier:3327:28108211'}, {'unwanted_material': 'papier', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.00813369996132629, 'nb_photo': 3192, 'list_port_cont': '27419381,27419697,27420359,27420765,27421098,27421460,27421500,27422891,27423802,27464704,27464708,27464921,27465069,27465296,27465505,27465625,27465954,27466602,27501487,27501848,27501932,27502242,27502376,27502693,27502946,27503456,27503946,27509212,27510361,27582865,27583288,27584012,27584717,27592770,27593263,27593706,27594100,27594586,27595481,27595797,27606472,27608782,27641945,27642333,27686199,27686650,27691921,27692571,27693729,27696275,27696619,27697227,27697486,27697785,27698272,27700871,27708277,27710398,27710998,27711856,27715472,27724726,27727328,27727736,27728095,27729645,27734416,27735015,27735966,27739527,27750071,27750338,27756641,27756764,27756858,27757480,27766907,27767805,27771140,27771763,27774153,27774738,27795786,27799604,27805571,27805807,27810673,27825621,27827428,27827733,27828039,27830438,27830638,27836604,27836724,27837543,27837743,27838098,27839496,27844343,27868751,27870059,27875841,27875997,27876256,27878340,27878818,27879624,27879969,27880178,27886737,27888903,27891180,2790960', 'assoc_port': '27418730:27420765,27418735:27421500,27418743:27421460,27418745:27421098,27418746:27423802,27418755:27420359,27418757:27422891,27418761:27419697,27418798:27419381,27463472:27464708,27463474:27465954,27463475:27465069,27463477:27465505,27463481:27465625,27463483:27465296,27463485:27464921,27463488:27464704,27463504:27466602,27499690:27503456,27499694:27501932,27499699:27502242,27499705:27503946,27499708:27501848,27499736:27501487,27499750:27502946,27499754:27502693,27499758:27502376,27508924:27509212,27508932:27510361,27582559:27584717,27582565:27584012,27582577:27583288,27582586:27582865,27592179:27595797,27592183:27594586,27592186:27595481,27592214:27594100,27592223:27593706,27592225:27593263,27592231:27592770,27606148:27608782,27606150:27606472,27641624:27642333,27641629:27641945,27685658:27686650,27685685:27686199,27691548:27698272,27691563:27697785,27691577:27696275,27691699:27700871,27691701:27697486,27691707:27697227,27691710:27693729,27691756:27696619,27691760:27692571,27691762:27691921,27704755:2770827', 'assoc_mat': '27418730:papier:3594:27420765,27418735:papier:3594:27421500,27418743:papier:3594:27421460,27418745:papier:3594:27421098,27418746:papier:3594:27423802,27418755:papier:3594:27420359,27418757:papier:3594:27422891,27418761:papier:3594:27419697,27418798:papier:3594:27419381,27463472:papier:3594:27464708,27463474:papier:3594:27465954,27463475:papier:3594:27465069,27463477:papier:3594:27465505,27463481:papier:3594:27465625,27463483:papier:3594:27465296,27463485:papier:3594:27464921,27463488:papier:3594:27464704,27463504:papier:3594:27466602,27499690:papier:3594:27503456,27499694:papier:3594:27501932,27499699:papier:3594:27502242,27499705:papier:3594:27503946,27499708:papier:3594:27501848,27499736:papier:3594:27501487,27499750:papier:3594:27502946,27499754:papier:3594:27502693,27499758:papier:3594:27502376,27508924:papier:3594:27509212,27508932:papier:3594:27510361,27582559:papier:3594:27584717,27582565:papier:3594:27584012,27582577:papier:3594:27583288,27582586:papier:3594:27582865,27592179:papier:3594:27595797,2759'}, {'unwanted_material': 'pehd', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00016997771030768203, 'nb_photo': 40, 'list_port_cont': '27421334,27464899,27466120,27466299,27503888,27505144,27506886,27582728,27629773,27630031,27686734,27689223,27698194,27708678,27709639,27730441,27736060,27740479,27772565,27830684,27843069,27868931,27909533,27919390,28021258,28265179,28267020,28268066,28268202,28272480,28279654,28284212', 'assoc_port': '27418734:27421334,27463484:27466120,27463487:27466299,27463508:27464899,27499687:27505144,27499718:27506886,27499756:27503888,27582588:27582728,27606141:27629773,27606143:27630031,27641588:27686734,27641632:27689223,27691661:27708678,27691705:27709639,27697995:27698194,27730218:27730441,27735873:27736060,27740472:27740479,27770955:27772565,27830129:27830684,27842452:27843069,27868456:27868931,27909530:27909533,27918330:27919390,27958871:28021258,28106535:28265179,28106645:28267020,28106778:28268066,28106782:28268202,28106783:28279654,28107769:28272480,28108532:28284212', 'assoc_mat': '27418734:pehd:4207:27421334,27463484:pehd:4207:27466120,27463487:pehd:4207:27466299,27463508:pehd:4207:27464899,27499687:pehd:4207:27505144,27499718:pehd:4207:27506886,27499756:pehd:4207:27503888,27582588:pehd:4207:27582728,27606141:pehd:4207:27629773,27606143:pehd:4207:27630031,27641588:pehd:4207:27686734,27641632:pehd:4207:27689223,27691661:pehd:4207:27708678,27691705:pehd:4207:27709639,27697995:pehd:4207:27698194,27730218:pehd:4207:27730441,27735873:pehd:4207:27736060,27740472:pehd:4207:27740479,27770955:pehd:4207:27772565,27830129:pehd:4207:27830684,27842452:pehd:4207:27843069,27868456:pehd:4207:27868931,27909530:pehd:4207:27909533,27918330:pehd:4207:27919390,27958871:pehd:4207:28021258,28106535:pehd:4207:28265179,28106645:pehd:4207:28267020,28106778:pehd:4207:28268066,28106782:pehd:4207:28268202,28106783:pehd:4207:28279654,28107769:pehd:4207:28272480,28108532:pehd:4207:28284212'}, {'unwanted_material': 'pehd', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0006817943984943475, 'nb_photo': 40, 'list_port_cont': '27421105,27501849,27503953,27509221,27594582,27697786,27700877,27727331,27756855,27757481,27868748,27909633,27947260,28020308,28109964,28117413,28120113,28125353,28126015', 'assoc_port': '27418745:27421105,27499705:27503953,27499708:27501849,27508924:27509221,27592183:27594582,27691563:27697786,27691699:27700877,27727085:27727331,27756449:27757481,27756455:27756855,27868453:27868748,27909528:27909633,27944806:27947260,28012680:28020308,28106544:28126015,28106546:28125353,28107403:28120113,28107832:28117413,28108372:28109964', 'assoc_mat': '27418745:pehd:3594:27421105,27499705:pehd:3594:27503953,27499708:pehd:3594:27501849,27508924:pehd:3594:27509221,27592183:pehd:3594:27594582,27691563:pehd:3594:27697786,27691699:pehd:3594:27700877,27727085:pehd:3594:27727331,27756449:pehd:3594:27757481,27756455:pehd:3594:27756855,27868453:pehd:3594:27868748,27909528:pehd:3594:27909633,27944806:pehd:3594:27947260,28012680:pehd:3594:28020308,28106544:pehd:3594:28126015,28106546:pehd:3594:28125353,28107403:pehd:3594:28120113,28107832:pehd:3594:28117413,28108372:pehd:3594:28109964'}, {'unwanted_material': 'pet_clair', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0003459939884055656, 'nb_photo': 1, 'list_port_cont': '27830277', 'assoc_port': '27830132:27830277', 'assoc_mat': '27830132:pet_clair:4461:27830277'}, {'unwanted_material': 'pet_clair', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.001969832205376704, 'nb_photo': 1063, 'list_port_cont': '27418943,27420097,27420181,27420396,27420937,27421130,27421870,27422250,27422430,27423411,27423996,27424248,27428712,27428936,27464347,27464484,27464588,27464901,27465310,27465831,27466300,27466444,27466657,27466853,27466999,27467399,27467938,27468985,27470109,27499779,27500580,27500850,27501182,27502418,27502729,27502845,27502991,27503108,27503328,27503761,27503880,27504858,27505152,27506132,27506739,27506882,27508985,27510534,27510599,27510720,27510907,27516623,27516745,27582738,27595489,27596204,27596415,27596534,27602955,27603075,27603292,27603311,27603347,27603370,27603386,27606277,27608952,27609078,27609639,27609815,27610108,27611569,27612258,27616465,27622870,27629774,27630033,27630550,27641795,27686450,27686733,27687072,27687338,27687577,27688306,27688594,27688850,27689228,27689608,27689804,27691891,27695885,27698311,27705023,27708346,27708501,27708681,27709161,27709518,27709632,27709690,27710109,27710250,27710387,27710552,27711951,27712154,27712415,27712566,27712788,27712897,27715365,27715529,2771562', 'assoc_port': '27418726:27420097,27418727:27420181,27418728:27420396,27418731:27420937,27418732:27421130,27418740:27422250,27418742:27422430,27418750:27423411,27418759:27423996,27418763:27424248,27418767:27428712,27418792:27428936,27418795:27421870,27418800:27418943,27463445:27464347,27463446:27464484,27463447:27464588,27463476:27470109,27463480:27465831,27463482:27468985,27463487:27466300,27463489:27466444,27463491:27466657,27463492:27466853,27463493:27466999,27463498:27467399,27463506:27467938,27463508:27464901,27463510:27465310,27499684:27500580,27499685:27504858,27499686:27500850,27499687:27505152,27499688:27501182,27499695:27506132,27499698:27502418,27499701:27502729,27499707:27502845,27499710:27502991,27499711:27503108,27499714:27506739,27499717:27503328,27499718:27506882,27499753:27503761,27499756:27503880,27499760:27499779,27508926:27510599,27508927:27510720,27508929:27510534,27508931:27510907,27508934:27508985,27516594:27516623,27516595:27516745,27582561:27608952,27582563:27609078,27582579:27609639,27582580:2760981', 'assoc_mat': '27418726:pet_clair:4207:27420097,27418727:pet_clair:4207:27420181,27418728:pet_clair:4207:27420396,27418731:pet_clair:4207:27420937,27418732:pet_clair:4207:27421130,27418740:pet_clair:4207:27422250,27418742:pet_clair:4207:27422430,27418750:pet_clair:4207:27423411,27418759:pet_clair:4207:27423996,27418763:pet_clair:4207:27424248,27418767:pet_clair:4207:27428712,27418792:pet_clair:4207:27428936,27418795:pet_clair:4207:27421870,27418800:pet_clair:4207:27418943,27463445:pet_clair:4207:27464347,27463446:pet_clair:4207:27464484,27463447:pet_clair:4207:27464588,27463476:pet_clair:4207:27470109,27463480:pet_clair:4207:27465831,27463482:pet_clair:4207:27468985,27463487:pet_clair:4207:27466300,27463489:pet_clair:4207:27466444,27463491:pet_clair:4207:27466657,27463492:pet_clair:4207:27466853,27463493:pet_clair:4207:27466999,27463498:pet_clair:4207:27467399,27463506:pet_clair:4207:27467938,27463508:pet_clair:4207:27464901,27463510:pet_clair:4207:27465310,27499684:pet_clair:4207:27500580,27499685:pet_clair:4207:27504858,2'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.8972511864030355, 'nb_photo': 520, 'list_port_cont': '27463571,27766798,28010951,28107741,28108212,28113459', 'assoc_port': '27463495:27463571,27766720:27766798,28010441:28010951,28106529:28113459,28107402:28107741,28107855:28108212', 'assoc_mat': '27463495:pet_clair:3327:27463571,27766720:pet_clair:3327:27766798,28010441:pet_clair:3327:28010951,28106529:pet_clair:3327:28113459,28107402:pet_clair:3327:28107741,28107855:pet_clair:3327:28108212'}, {'unwanted_material': 'pet_clair', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.07413983167959405, 'nb_photo': 3080, 'list_port_cont': '27419380,27419694,27420357,27420766,27421099,27421461,27421502,27422897,27423799,27464697,27464707,27464914,27465080,27465298,27465497,27465626,27465963,27466601,27501477,27501853,27501929,27502238,27502377,27502562,27502692,27502950,27503453,27503952,27509214,27510370,27582863,27583285,27584017,27584721,27592765,27593264,27593712,27594101,27594590,27595480,27595792,27601080,27606479,27608775,27641939,27642328,27686191,27686672,27691920,27692574,27693735,27696270,27696620,27697228,27697478,27697781,27698270,27700880,27708284,27710397,27710990,27711855,27715474,27724728,27727325,27727739,27728096,27729640,27734422,27735020,27735967,27739529,27750076,27750333,27756624,27756772,27756861,27757487,27766915,27767802,27771132,27771759,27774156,27774744,27795781,27799610,27805572,27805798,27810671,27825624,27827429,27827736,27828032,27830443,27830644,27836601,27836725,27837544,27837749,27838095,27839501,27844341,27868745,27870056,27875829,27875981,27876257,27878341,27878814,27879623,27879971,27880185,27886720,2788891', 'assoc_port': '27418730:27420766,27418735:27421502,27418743:27421461,27418745:27421099,27418746:27423799,27418755:27420357,27418757:27422897,27418761:27419694,27418798:27419380,27463472:27464707,27463474:27465963,27463475:27465080,27463477:27465497,27463481:27465626,27463483:27465298,27463485:27464914,27463488:27464697,27463504:27466601,27499690:27503453,27499694:27501929,27499699:27502238,27499702:27502562,27499705:27503952,27499708:27501853,27499736:27501477,27499750:27502950,27499754:27502692,27499758:27502377,27508924:27509214,27508932:27510370,27582559:27584721,27582565:27584017,27582577:27583285,27582586:27582863,27592179:27595792,27592183:27594590,27592186:27595480,27592214:27594101,27592223:27593712,27592225:27593264,27592231:27592765,27600762:27601080,27606148:27608775,27606150:27606479,27641624:27642328,27641629:27641939,27685658:27686672,27685685:27686191,27691548:27698270,27691563:27697781,27691577:27696270,27691699:27700880,27691701:27697478,27691707:27697228,27691710:27693735,27691756:27696620,27691760:2769257', 'assoc_mat': '27418730:pet_clair:3594:27420766,27418735:pet_clair:3594:27421502,27418743:pet_clair:3594:27421461,27418745:pet_clair:3594:27421099,27418746:pet_clair:3594:27423799,27418755:pet_clair:3594:27420357,27418757:pet_clair:3594:27422897,27418761:pet_clair:3594:27419694,27418798:pet_clair:3594:27419380,27463472:pet_clair:3594:27464707,27463474:pet_clair:3594:27465963,27463475:pet_clair:3594:27465080,27463477:pet_clair:3594:27465497,27463481:pet_clair:3594:27465626,27463483:pet_clair:3594:27465298,27463485:pet_clair:3594:27464914,27463488:pet_clair:3594:27464697,27463504:pet_clair:3594:27466601,27499690:pet_clair:3594:27503453,27499694:pet_clair:3594:27501929,27499699:pet_clair:3594:27502238,27499702:pet_clair:3594:27502562,27499705:pet_clair:3594:27503952,27499708:pet_clair:3594:27501853,27499736:pet_clair:3594:27501477,27499750:pet_clair:3594:27502950,27499754:pet_clair:3594:27502692,27499758:pet_clair:3594:27502377,27508924:pet_clair:3594:27509214,27508932:pet_clair:3594:27510370,27582559:pet_clair:3594:27584721,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0010581292130120163, 'nb_photo': 1, 'list_port_cont': '28106694', 'assoc_port': '28106469:28106694', 'assoc_mat': '28106469:pet_fonce:4461:28106694'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00027397668626311236, 'nb_photo': 82, 'list_port_cont': '27421122,27421865,27422927,27424003,27466434,27466848,27467400,27470099,27500862,27502992,27503768,27504855,27510546,27582733,27596526,27603366,27603378,27629776,27641798,27686729,27687069,27688592,27691898,27695883,27711956,27715355,27715675,27718704,27740482,27750254,27767164,27775017,27778163,27778209,27789807,27799402,27812325,27813057,27839320,27847401,27849181,27875949,27876505,27876572,27878007,27880633,27884556,27945658,27945811,27949027,28050360,28053925,28260749,28260953,28264593,28265175,28266553,28267016,28269774,28279660,28284065,28287578,28288985', 'assoc_port': '27418732:27421122,27418747:27422927,27418759:27424003,27418795:27421865,27463476:27470099,27463489:27466434,27463492:27466848,27463498:27467400,27499685:27504855,27499686:27500862,27499710:27502992,27499753:27503768,27508929:27510546,27582588:27582733,27592177:27603378,27592181:27603366,27592228:27596526,27606141:27629776,27641588:27686729,27641591:27687069,27641627:27688592,27641644:27641798,27691763:27691898,27695052:27695883,27704747:27715355,27704753:27715675,27710100:27718704,27711755:27711956,27740472:27740482,27749757:27750254,27756447:27767164,27774009:27775017,27778157:27778163,27778158:27778209,27789755:27789807,27799347:27799402,27812254:27812325,27812918:27813057,27839272:27839320,27841473:27847401,27843158:27849181,27868449:27876572,27868452:27876505,27874711:27880633,27874713:27875949,27877950:27878007,27884188:27884556,27944822:27945811,27944827:27945658,27948338:27949027,28010438:28053925,28050281:28050360,28106272:28260749,28106274:28260953,28106530:28264593,28106535:28265175,28106585:2826655', 'assoc_mat': '27418732:pet_fonce:4207:27421122,27418747:pet_fonce:4207:27422927,27418759:pet_fonce:4207:27424003,27418795:pet_fonce:4207:27421865,27463476:pet_fonce:4207:27470099,27463489:pet_fonce:4207:27466434,27463492:pet_fonce:4207:27466848,27463498:pet_fonce:4207:27467400,27499685:pet_fonce:4207:27504855,27499686:pet_fonce:4207:27500862,27499710:pet_fonce:4207:27502992,27499753:pet_fonce:4207:27503768,27508929:pet_fonce:4207:27510546,27582588:pet_fonce:4207:27582733,27592177:pet_fonce:4207:27603378,27592181:pet_fonce:4207:27603366,27592228:pet_fonce:4207:27596526,27606141:pet_fonce:4207:27629776,27641588:pet_fonce:4207:27686729,27641591:pet_fonce:4207:27687069,27641627:pet_fonce:4207:27688592,27641644:pet_fonce:4207:27641798,27691763:pet_fonce:4207:27691898,27695052:pet_fonce:4207:27695883,27704747:pet_fonce:4207:27715355,27704753:pet_fonce:4207:27715675,27710100:pet_fonce:4207:27718704,27711755:pet_fonce:4207:27711956,27740472:pet_fonce:4207:27740482,27749757:pet_fonce:4207:27750254,27756447:pet_fonce:4207:27767164,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.037922203177391936, 'nb_photo': 4, 'list_port_cont': '27766801,28108215', 'assoc_port': '27766720:27766801,28107855:28108215', 'assoc_mat': '27766720:pet_fonce:3327:27766801,28107855:pet_fonce:3327:28108215'}, {'unwanted_material': 'pet_fonce', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0003514998697290363, 'nb_photo': 48, 'list_port_cont': '27421097,27465299,27501854,27594097,27594588,27686197,27686645,27697790,27698271,27700873,27710396,27710995,27727326,27729642,27739532,27757482,27799603,27825627,27827730,27878334,27888901,27945155,28020301,28036028,28044509,28117030,28117412,28125358,28126311,28127778,28131443,28132386', 'assoc_port': '27418745:27421097,27463483:27465299,27499708:27501854,27592183:27594588,27592214:27594097,27685658:27686645,27685685:27686197,27691548:27698271,27691563:27697790,27691699:27700873,27710099:27710995,27710102:27710396,27727085:27727326,27729545:27729642,27739475:27739532,27756449:27757482,27799345:27799603,27825271:27825627,27827191:27827730,27877954:27878334,27888879:27888901,27944829:27945155,28012680:28020301,28035723:28036028,28044330:28044509,28106429:28132386,28106434:28131443,28106526:28127778,28106543:28126311,28106546:28125358,28107832:28117412,28107853:28117030', 'assoc_mat': '27418745:pet_fonce:3594:27421097,27463483:pet_fonce:3594:27465299,27499708:pet_fonce:3594:27501854,27592183:pet_fonce:3594:27594588,27592214:pet_fonce:3594:27594097,27685658:pet_fonce:3594:27686645,27685685:pet_fonce:3594:27686197,27691548:pet_fonce:3594:27698271,27691563:pet_fonce:3594:27697790,27691699:pet_fonce:3594:27700873,27710099:pet_fonce:3594:27710995,27710102:pet_fonce:3594:27710396,27727085:pet_fonce:3594:27727326,27729545:pet_fonce:3594:27729642,27739475:pet_fonce:3594:27739532,27756449:pet_fonce:3594:27757482,27799345:pet_fonce:3594:27799603,27825271:pet_fonce:3594:27825627,27827191:pet_fonce:3594:27827730,27877954:pet_fonce:3594:27878334,27888879:pet_fonce:3594:27888901,27944829:pet_fonce:3594:27945155,28012680:pet_fonce:3594:28020301,28035723:pet_fonce:3594:28036028,28044330:pet_fonce:3594:28044509,28106429:pet_fonce:3594:28132386,28106434:pet_fonce:3594:28131443,28106526:pet_fonce:3594:28127778,28106543:pet_fonce:3594:28126311,28106546:pet_fonce:3594:28125358,28107832:pet_fonce:3594:28117412,2'}, {'unwanted_material': 'pet_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.005466676232154387, 'nb_photo': 1, 'list_port_cont': '28106883', 'assoc_port': '28106644:28106883', 'assoc_mat': '28106644:pet_opaque:4461:28106883'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0019003855730040326, 'nb_photo': 494, 'list_port_cont': '27420176,27420385,27420572,27421120,27421344,27421871,27422244,27422657,27422917,27423095,27424005,27428929,27464589,27464902,27465305,27466288,27466646,27467003,27467186,27467392,27467941,27468978,27470101,27499775,27500860,27501178,27502114,27502414,27502734,27503005,27503773,27503885,27504856,27505143,27506125,27506883,27510532,27510603,27510723,27516625,27582731,27596198,27596413,27596524,27602958,27603070,27603351,27603358,27603373,27603393,27606278,27608953,27609067,27609348,27609642,27609985,27611563,27612267,27616758,27617482,27629763,27630553,27641786,27670431,27671965,27686446,27687068,27687343,27688310,27689232,27689598,27691897,27695897,27698198,27698319,27708335,27708668,27710108,27710262,27710550,27711958,27712156,27712417,27712567,27712891,27715352,27715669,27718713,27719814,27720792,27723909,27728670,27729978,27730440,27730487,27734403,27736057,27736502,27737418,27740476,27749999,27750164,27750501,27762516,27767163,27767184,27767312,27774657,27775018,27775040,27778168,27778215,27789806,2779939', 'assoc_port': '27418727:27420176,27418728:27420385,27418729:27420572,27418732:27421120,27418734:27421344,27418740:27422244,27418744:27422657,27418747:27422917,27418749:27423095,27418759:27424005,27418792:27428929,27418795:27421871,27463447:27464589,27463476:27470101,27463482:27468978,27463487:27466288,27463491:27466646,27463493:27467003,27463496:27467186,27463498:27467392,27463506:27467941,27463508:27464902,27463510:27465305,27499685:27504856,27499686:27500860,27499687:27505143,27499688:27501178,27499695:27506125,27499697:27502114,27499698:27502414,27499701:27502734,27499710:27503005,27499718:27506883,27499753:27503773,27499756:27503885,27499760:27499775,27508926:27510603,27508927:27510723,27508929:27510532,27516594:27516625,27582561:27608953,27582563:27609067,27582571:27609348,27582579:27609642,27582582:27609985,27582588:27582731,27592177:27603373,27592178:27603393,27592181:27603358,27592211:27603351,27592218:27603070,27592224:27596198,27592227:27596413,27592228:27596524,27600763:27602958,27606141:27629763,27606146:2763055', 'assoc_mat': '27418727:pet_opaque:4207:27420176,27418728:pet_opaque:4207:27420385,27418729:pet_opaque:4207:27420572,27418732:pet_opaque:4207:27421120,27418734:pet_opaque:4207:27421344,27418740:pet_opaque:4207:27422244,27418744:pet_opaque:4207:27422657,27418747:pet_opaque:4207:27422917,27418749:pet_opaque:4207:27423095,27418759:pet_opaque:4207:27424005,27418792:pet_opaque:4207:27428929,27418795:pet_opaque:4207:27421871,27463447:pet_opaque:4207:27464589,27463476:pet_opaque:4207:27470101,27463482:pet_opaque:4207:27468978,27463487:pet_opaque:4207:27466288,27463491:pet_opaque:4207:27466646,27463493:pet_opaque:4207:27467003,27463496:pet_opaque:4207:27467186,27463498:pet_opaque:4207:27467392,27463506:pet_opaque:4207:27467941,27463508:pet_opaque:4207:27464902,27463510:pet_opaque:4207:27465305,27499685:pet_opaque:4207:27504856,27499686:pet_opaque:4207:27500860,27499687:pet_opaque:4207:27505143,27499688:pet_opaque:4207:27501178,27499695:pet_opaque:4207:27506125,27499697:pet_opaque:4207:27502114,27499698:pet_opaque:4207:27502414,2749'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 7.933477397620998e-05, 'nb_photo': 30, 'list_port_cont': '27420179,27423590,27467000,27506891,27510421,27630027,27686439,27687073,27689606,27712412,27715356,27715945,27730550,27830686,27847399,27849177,27876770,27878019,27880483,27909535,27949178,28021256,28044389,28279262,28284574', 'assoc_port': '27418727:27420179,27418753:27423590,27463493:27467000,27499718:27506891,27508925:27510421,27606143:27630027,27641591:27687073,27641635:27689606,27686322:27686439,27697990:27712412,27704747:27715356,27715882:27715945,27730217:27730550,27830129:27830686,27841473:27847399,27843158:27849177,27868448:27876770,27874705:27880483,27877950:27878019,27909530:27909535,27948335:27949178,27958871:28021256,28044320:28044389,28106470:28279262,28108436:28284574', 'assoc_mat': '27418727:textiles_sanitaires:4207:27420179,27418753:textiles_sanitaires:4207:27423590,27463493:textiles_sanitaires:4207:27467000,27499718:textiles_sanitaires:4207:27506891,27508925:textiles_sanitaires:4207:27510421,27606143:textiles_sanitaires:4207:27630027,27641591:textiles_sanitaires:4207:27687073,27641635:textiles_sanitaires:4207:27689606,27686322:textiles_sanitaires:4207:27686439,27697990:textiles_sanitaires:4207:27712412,27704747:textiles_sanitaires:4207:27715356,27715882:textiles_sanitaires:4207:27715945,27730217:textiles_sanitaires:4207:27730550,27830129:textiles_sanitaires:4207:27830686,27841473:textiles_sanitaires:4207:27847399,27843158:textiles_sanitaires:4207:27849177,27868448:textiles_sanitaires:4207:27876770,27874705:textiles_sanitaires:4207:27880483,27877950:textiles_sanitaires:4207:27878019,27909530:textiles_sanitaires:4207:27909535,27948335:textiles_sanitaires:4207:27949178,27958871:textiles_sanitaires:4207:28021256,28044320:textiles_sanitaires:4207:28044389,28106470:textiles_sanitaires:4207:2'}), 'main_stat': {'nb_photos': 35793}}, 'hostname': (('jetson-5',),), 'impurety_average_per_hashtag': [(('pcnc', '2025-10', 0.025868034404724412),), (('refus', '2025-10', 0.0974146879287623),), (('film_pedb', '2025-10', 0.06785934408607135),), (('pet_clair', '2025-10', 0.12238682628268438),)]} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4887 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4887 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4887 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4887 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Sevran"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4101 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4101 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4101 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4101 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((31915,),), 'unwanted_material_monthly_percentage': ((0.03377028182701559,),), 'material_repartition': (('pcnc', 20455), ('refus', 1853), ('film_pedb', 965), ('pet_clair', 19)), 'material_dict': {'pcnc': 20455, 'refus': 1853, 'autres': 984}, 'coverage_data': (('2025/10/31/', 0.0), ('2025/10/30/', 0.0), ('2025/10/29/', 0.0), ('2025/10/28/', 0.0), ('2025/10/27/', 0.0), ('2025/10/25/', 0.0), ('2025/10/24/', 0.0), ('2025/10/23/', 0.0), ('2025/10/18/', 0.0), ('2025/10/17/', 0.0), ('2025/10/16/', 0.0), ('2025/10/15/', 0.0), ('2025/10/14/', 0.0), ('2025/10/13/', 0.0), ('2025/10/11/', 0.0), ('2025/10/10/', 0.0), ('2025/10/09/', 0.0), ('2025/10/08/', 0.0), ('2025/10/07/', 0.0), ('2025/10/06/', 0.0), ('2025/10/04/', 0.0), ('2025/10/03/', 0.0), ('2025/10/02/', 0.0), ('2025/10/01/', 0.0)), 'impurety_average_data': ((datetime.date(2025, 10, 1), 0.03047079735116301, 9), (datetime.date(2025, 10, 2), 0.032563125591901304, 8), (datetime.date(2025, 10, 3), 0.033190392955016336, 37), (datetime.date(2025, 10, 4), 0.0191787406673183, 12), (datetime.date(2025, 10, 6), 0.02166285393424423, 9), (datetime.date(2025, 10, 7), 0.03624519829813158, 264), (datetime.date(2025, 10, 8), 0.02956766680335419, 15), (datetime.date(2025, 10, 9), 0.03851051620173753, 245), (datetime.date(2025, 10, 10), 0.04852099465184585, 621), (datetime.date(2025, 10, 11), 0.02921139924394423, 13), (datetime.date(2025, 10, 13), 0.029540529948775828, 11), (datetime.date(2025, 10, 14), 0.04214681514996028, 11), (datetime.date(2025, 10, 15), 0.03333524845938262, 53), (datetime.date(2025, 10, 16), 0.0439585101420121, 256), (datetime.date(2025, 10, 17), 0.02486024634868073, 49), (datetime.date(2025, 10, 18), 0.03320688824753461, 26), (datetime.date(2025, 10, 19), 0.0006011474452487174, 67), (datetime.date(2025, 10, 20), 0.04138215942278721, 56), (datetime.date(2025, 10, 21), 0.03783599915199182, 96), (datetime.date(2025, 10, 22), 0.02769197677402982, 9), (datetime.date(2025, 10, 27), 0.024750188245869154, 158), (datetime.date(2025, 10, 28), 0.062034902463103316, 62), (datetime.date(2025, 10, 29), 0.040594350287856816, 23), (datetime.date(2025, 10, 30), 0.02593760269525116, 325), (datetime.date(2025, 10, 31), 0.025733701743619216, 161)), 'impurety_average_data_per_hashtag': {'pcnc': ((datetime.date(2025, 10, 1), 0.02346134717141056, 9), (datetime.date(2025, 10, 2), 0.02605193787098246, 8), (datetime.date(2025, 10, 3), 0.024559393254799645, 37), (datetime.date(2025, 10, 4), 0.0191787406673183, 12), (datetime.date(2025, 10, 6), 0.008543810071287891, 9), (datetime.date(2025, 10, 7), 0.03269633937847861, 264), (datetime.date(2025, 10, 8), 0.022793915424389608, 15), (datetime.date(2025, 10, 9), 0.02876019097434975, 245), (datetime.date(2025, 10, 10), 0.04083093964280043, 621), (datetime.date(2025, 10, 11), 0.018820781989305712, 13), (datetime.date(2025, 10, 13), 0.020593870517580798, 11), (datetime.date(2025, 10, 14), 0.041535351530527134, 11), (datetime.date(2025, 10, 15), 0.02791970603456405, 53), (datetime.date(2025, 10, 16), 0.041229256760712284, 256), (datetime.date(2025, 10, 17), 0.016419756719764183, 49), (datetime.date(2025, 10, 18), 0.022977221674095723, 26), (datetime.date(2025, 10, 19), 0.0006011474452487174, 67), (datetime.date(2025, 10, 20), 0.03483403760352747, 56), (datetime.date(2025, 10, 21), 0.02812756211125899, 96), (datetime.date(2025, 10, 22), 0.0262130808040894, 9), (datetime.date(2025, 10, 27), 0.023310817290364536, 158), (datetime.date(2025, 10, 28), 0.02659461860651554, 62), (datetime.date(2025, 10, 29), 0.03861123703811612, 23), (datetime.date(2025, 10, 30), 0.01414713550905381, 325), (datetime.date(2025, 10, 31), 0.01753833071860241, 161)), 'refus': ((datetime.date(2025, 10, 1), 0.11539121977880656, 16), (datetime.date(2025, 10, 2), 0.07843930844907407, 11), (datetime.date(2025, 10, 3), 0.10035264384068346, 13), (datetime.date(2025, 10, 6), 0.1921756159060847, 9), (datetime.date(2025, 10, 7), 0.08291766443167306, 18), (datetime.date(2025, 10, 8), 0.07116197396403486, 8), (datetime.date(2025, 10, 9), 0.09969142976481989, 42), (datetime.date(2025, 10, 10), 0.13481613382491214, 12), (datetime.date(2025, 10, 11), 0.10704355501334667, 17), (datetime.date(2025, 10, 13), 0.09181306721846573, 14), (datetime.date(2025, 10, 14), 0.04701682204464739, 9), (datetime.date(2025, 10, 15), 0.07949759526507845, 17), (datetime.date(2025, 10, 16), 0.07115756197570434, 8), (datetime.date(2025, 10, 17), 0.06436148258923115, 12), (datetime.date(2025, 10, 18), 0.07083612427315668, 13), (datetime.date(2025, 10, 20), 0.08030917628980781, 12), (datetime.date(2025, 10, 21), 0.11646892850562005, 9), (datetime.date(2025, 10, 28), 0.16743623775496513, 10), (datetime.date(2025, 10, 29), 0.062325923076248596, 11), (datetime.date(2025, 10, 30), 0.1266182200644006, 9), (datetime.date(2025, 10, 31), 0.08834759141730032, 8)), 'film_pedb': ((datetime.date(2025, 10, 1), 0.07636549250548391, 27), (datetime.date(2025, 10, 2), 0.07312666916651167, 36), (datetime.date(2025, 10, 3), 0.07360202207526176, 10), (datetime.date(2025, 10, 6), 0.06201328671611222, 8), (datetime.date(2025, 10, 7), 0.08045683350791825, 27), (datetime.date(2025, 10, 8), 0.07837897193128233, 14), (datetime.date(2025, 10, 9), 0.06552826145710211, 11), (datetime.date(2025, 10, 10), 0.0683396594631419, 18), (datetime.date(2025, 10, 11), 0.04476573189558269, 26), (datetime.date(2025, 10, 13), 0.07713327555274926, 17), (datetime.date(2025, 10, 14), 0.04847387548405345, 18), (datetime.date(2025, 10, 15), 0.052570003762531264, 27), (datetime.date(2025, 10, 16), 0.05121518187885857, 9), (datetime.date(2025, 10, 17), 0.11523840014409713, 8), (datetime.date(2025, 10, 18), 0.08993800025386169, 11), (datetime.date(2025, 10, 20), 0.07001936123102188, 13), (datetime.date(2025, 10, 21), 0.05920966544629597, 11), (datetime.date(2025, 10, 22), 0.06804470966811847, 14), (datetime.date(2025, 10, 27), 0.06111324396388057, 19), (datetime.date(2025, 10, 28), 0.07050348686781897, 21), (datetime.date(2025, 10, 29), 0.05678979986932012, 9), (datetime.date(2025, 10, 30), 0.08016653425644577, 9), (datetime.date(2025, 10, 31), 0.050058675528796545, 14)), 'pet_clair': ((datetime.date(2025, 10, 2), 0.22366325346918656, 9), (datetime.date(2025, 10, 13), 0.16950628959705577, 10), (datetime.date(2025, 10, 18), 0.2444010541702677, 9), (datetime.date(2025, 10, 20), 0.14722206828493276, 8), (datetime.date(2025, 10, 30), 0.009599178480755142, 8), (datetime.date(2025, 10, 31), 0.017846162611329333, 17))}, 'quality_array': [['0.9877836297999346', '01102025'], ['0.5797989678536857', '02102025'], ['0.7476694589305041', '03102025'], ['0.43954673543678613', '04102025'], ['0.48504927315301727', '06102025'], ['0.5113435455223586', '07102025'], ['0.545070298174353', '08102025'], ['0.45855952609618394', '09102025'], ['0.48291709885628303', '10102025'], ['0.6331614613881166', '11102025'], ['0.5062319909379956', '13102025'], ['0.7632468632188871', '14102025'], ['1.0290408194957643', '15102025'], ['1.1336685240167912', '16102025'], ['1.3196162071860704', '17102025'], ['1.067170057648991', '18102025'], ['-0.51947067489091', '19102025'], ['0.47493272681732196', '20102025'], ['0.5362462479349779', '21102025'], ['1.1848262370858118', '22102025'], ['1.0738756897195803', '27102025'], ['1.2287941926381256', '28102025'], ['1.3455326613197958', '29102025'], ['1.017456423644107', '30102025'], ['1.116457648178445', '31102025']], 'number_of_batch': ((732,),), 'datou_id_sts': 4101, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.012918205022582627, 'nb_photo': 5, 'list_port_cont': '27463580,28108207', 'assoc_port': '27463495:27463580,28107855:28108207', 'assoc_mat': '27463495:autre:3327:27463580,28107855:autre:3327:28108207'}, {'unwanted_material': 'autre', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0013341026203662505, 'nb_photo': 334, 'list_port_cont': '27420354,27421103,27421493,27422890,27423794,27464702,27464706,27464912,27465076,27465292,27465618,27465960,27501479,27501851,27501934,27502239,27502374,27502556,27502674,27503452,27503951,27509211,27510363,27584011,27592768,27593254,27594099,27594587,27595476,27601087,27608774,27641941,27642332,27686193,27691923,27692566,27693736,27696625,27697234,27697488,27697788,27698266,27700879,27708285,27710400,27711862,27715471,27724731,27727323,27728093,27729650,27735013,27735964,27739528,27750073,27756621,27756765,27756853,27757483,27766909,27771139,27771760,27774735,27795790,27799611,27805802,27827728,27828029,27836605,27836727,27837545,27837752,27839495,27844340,27868749,27875838,27875994,27876255,27879627,27886729,27888908,27891182,27909611,27909640,27930553,27945512,27947028,28020305,28025692,28044516,28107784,28108298,28108747,28109214,28109516,28109958,28113232,28113623,28115916,28116271,28116615,28117028,28117408,28118105,28119308,28120108,28121845,28122432,28122742,28123043,28123372,28123926,28124936,2812535', 'assoc_port': '27418735:27421493,27418745:27421103,27418746:27423794,27418755:27420354,27418757:27422890,27463472:27464706,27463474:27465960,27463475:27465076,27463481:27465618,27463483:27465292,27463485:27464912,27463488:27464702,27499690:27503452,27499694:27501934,27499699:27502239,27499702:27502556,27499705:27503951,27499708:27501851,27499736:27501479,27499754:27502674,27499758:27502374,27508924:27509211,27508932:27510363,27582565:27584011,27592183:27594587,27592186:27595476,27592214:27594099,27592225:27593254,27592231:27592768,27600762:27601087,27606148:27608774,27641624:27642332,27641629:27641941,27685685:27686193,27691548:27698266,27691563:27697788,27691699:27700879,27691701:27697488,27691707:27697234,27691710:27693736,27691756:27696625,27691760:27692566,27691762:27691923,27704755:27708285,27710102:27710400,27710103:27715471,27711758:27711862,27724672:27724731,27727085:27727323,27727917:27728093,27729545:27729650,27734955:27735013,27735875:27735964,27739475:27739528,27749761:27750073,27756449:27757483,27756454:2775676', 'assoc_mat': '27418735:autre:3594:27421493,27418745:autre:3594:27421103,27418746:autre:3594:27423794,27418755:autre:3594:27420354,27418757:autre:3594:27422890,27463472:autre:3594:27464706,27463474:autre:3594:27465960,27463475:autre:3594:27465076,27463481:autre:3594:27465618,27463483:autre:3594:27465292,27463485:autre:3594:27464912,27463488:autre:3594:27464702,27499690:autre:3594:27503452,27499694:autre:3594:27501934,27499699:autre:3594:27502239,27499702:autre:3594:27502556,27499705:autre:3594:27503951,27499708:autre:3594:27501851,27499736:autre:3594:27501479,27499754:autre:3594:27502674,27499758:autre:3594:27502374,27508924:autre:3594:27509211,27508932:autre:3594:27510363,27582565:autre:3594:27584011,27592183:autre:3594:27594587,27592186:autre:3594:27595476,27592214:autre:3594:27594099,27592225:autre:3594:27593254,27592231:autre:3594:27592768,27600762:autre:3594:27601087,27606148:autre:3594:27608774,27641624:autre:3594:27642332,27641629:autre:3594:27641941,27685685:autre:3594:27686193,27691548:autre:3594:27698266,27691563:'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.016687255950586448, 'nb_photo': 6, 'list_port_cont': '27418977,27606298,27771566,27918712,28108828', 'assoc_port': '27418793:27418977,27606180:27606298,27770943:27771566,27918365:27918712,28108431:28108828', 'assoc_mat': '27418793:barquette_opaque:4461:27418977,27606180:barquette_opaque:4461:27606298,27770943:barquette_opaque:4461:27771566,27918365:barquette_opaque:4461:27918712,28108431:barquette_opaque:4461:28108828'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.001050001707800891, 'nb_photo': 2734, 'list_port_cont': '27418938,27420094,27420184,27420400,27420568,27420932,27421128,27421338,27421737,27421864,27421934,27422251,27422436,27422662,27422918,27423099,27423594,27423998,27424254,27428711,27428928,27432684,27463637,27464355,27464490,27464602,27464804,27464896,27465303,27466124,27466302,27466435,27466841,27466997,27467192,27467540,27467928,27468983,27470103,27499780,27500586,27500859,27501179,27501371,27501501,27501669,27502413,27502721,27502847,27503003,27503104,27503774,27503890,27504853,27505150,27506136,27506738,27506880,27508984,27510424,27510541,27510601,27510729,27510915,27516627,27516734,27582730,27595498,27596194,27596417,27596530,27602959,27603078,27603298,27603312,27603336,27603348,27603368,27603369,27603390,27606234,27606275,27606490,27608948,27609072,27609192,27609349,27609485,27609645,27609810,27609978,27610110,27611558,27612259,27616464,27616764,27617481,27622883,27623500,27629770,27630028,27630254,27630556,27641783,27671980,27686447,27686493,27686730,27687067,27687342,27687589,27688317,27688599,2768923', 'assoc_port': '27418726:27420094,27418727:27420184,27418728:27420400,27418729:27420568,27418731:27420932,27418732:27421128,27418734:27421338,27418737:27421737,27418739:27421934,27418740:27422251,27418742:27422436,27418744:27422662,27418747:27422918,27418749:27423099,27418753:27423594,27418759:27423998,27418763:27424254,27418767:27428711,27418792:27428928,27418795:27421864,27418800:27418938,27432639:27432684,27463445:27464355,27463446:27464490,27463447:27464602,27463473:27464804,27463476:27470103,27463482:27468983,27463484:27466124,27463487:27466302,27463489:27466435,27463492:27466841,27463493:27466997,27463496:27467192,27463499:27467540,27463506:27467928,27463508:27464896,27463510:27465303,27463512:27463637,27499684:27500586,27499685:27504853,27499686:27500859,27499687:27505150,27499688:27501179,27499689:27501371,27499691:27501501,27499692:27501669,27499695:27506136,27499698:27502413,27499701:27502721,27499707:27502847,27499710:27503003,27499711:27503104,27499714:27506738,27499718:27506880,27499753:27503774,27499756:2750389', 'assoc_mat': '27418726:barquette_opaque:4207:27420094,27418727:barquette_opaque:4207:27420184,27418728:barquette_opaque:4207:27420400,27418729:barquette_opaque:4207:27420568,27418731:barquette_opaque:4207:27420932,27418732:barquette_opaque:4207:27421128,27418734:barquette_opaque:4207:27421338,27418737:barquette_opaque:4207:27421737,27418739:barquette_opaque:4207:27421934,27418740:barquette_opaque:4207:27422251,27418742:barquette_opaque:4207:27422436,27418744:barquette_opaque:4207:27422662,27418747:barquette_opaque:4207:27422918,27418749:barquette_opaque:4207:27423099,27418753:barquette_opaque:4207:27423594,27418759:barquette_opaque:4207:27423998,27418763:barquette_opaque:4207:27424254,27418767:barquette_opaque:4207:27428711,27418792:barquette_opaque:4207:27428928,27418795:barquette_opaque:4207:27421864,27418800:barquette_opaque:4207:27418938,27432639:barquette_opaque:4207:27432684,27463445:barquette_opaque:4207:27464355,27463446:barquette_opaque:4207:27464490,27463447:barquette_opaque:4207:27464602,27463473:barquette_opaqu'}, {'unwanted_material': 'bouchon', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.004054244229126342, 'nb_photo': 5, 'list_port_cont': '27463584,28107739,28108206', 'assoc_port': '27463495:27463584,28107402:28107739,28107855:28108206', 'assoc_mat': '27463495:bouchon:3327:27463584,28107402:bouchon:3327:28107739,28107855:bouchon:3327:28108206'}, {'unwanted_material': 'carton', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.005690070892308352, 'nb_photo': 137, 'list_port_cont': '27418975,27419136,27419435,27463602,27463881,27463940,27499841,27500136,27583087,27583664,27583992,27592467,27606296,27606423,27641714,27641962,27686002,27686248,27686351,27691799,27692072,27711913,27728725,27749877,27749962,27766769,27771558,27771853,27805484,27808574,27830281,27868497,27875044,27930396,27948490,28022417,28022890,28031876,28034094,28049312,28106709,28106889,28107522,28107979,28108052,28108834,28109224,28111126,28111308,28116180,28116823,28117426,28117695,28118421,28118778,28119066,28119575,28121573,28128326', 'assoc_port': '27418738:27419435,27418764:27419136,27418793:27418975,27463478:27463940,27463486:27463881,27463501:27463602,27499715:27500136,27499761:27499841,27582568:27583992,27582573:27583664,27582585:27583087,27592220:27592467,27606142:27606423,27606180:27606296,27641634:27641962,27641639:27641714,27685670:27686248,27685683:27686351,27685684:27686002,27691582:27691799,27691729:27692072,27711756:27711913,27728621:27728725,27749755:27749962,27749756:27749877,27766715:27766769,27770943:27771558,27770946:27771853,27805407:27805484,27808484:27808574,27830132:27830281,27868455:27868497,27874707:27875044,27930306:27930396,27948341:27948490,28022255:28022890,28022262:28022417,28024764:28034094,28031589:28031876,28033123:28049312,28106269:28119575,28106430:28111308,28106431:28111126,28106436:28116180,28106456:28121573,28106469:28106709,28106532:28119066,28106536:28128326,28106550:28107522,28106644:28106889,28106780:28118421,28107405:28118778,28107442:28107979,28107445:28116823,28107780:28117695,28107836:28109224,28107873:2810805', 'assoc_mat': '27418738:carton:4461:27419435,27418764:carton:4461:27419136,27418793:carton:4461:27418975,27463478:carton:4461:27463940,27463486:carton:4461:27463881,27463501:carton:4461:27463602,27499715:carton:4461:27500136,27499761:carton:4461:27499841,27582568:carton:4461:27583992,27582573:carton:4461:27583664,27582585:carton:4461:27583087,27592220:carton:4461:27592467,27606142:carton:4461:27606423,27606180:carton:4461:27606296,27641634:carton:4461:27641962,27641639:carton:4461:27641714,27685670:carton:4461:27686248,27685683:carton:4461:27686351,27685684:carton:4461:27686002,27691582:carton:4461:27691799,27691729:carton:4461:27692072,27711756:carton:4461:27711913,27728621:carton:4461:27728725,27749755:carton:4461:27749962,27749756:carton:4461:27749877,27766715:carton:4461:27766769,27770943:carton:4461:27771558,27770946:carton:4461:27771853,27805407:carton:4461:27805484,27808484:carton:4461:27808574,27830132:carton:4461:27830281,27868455:carton:4461:27868497,27874707:carton:4461:27875044,27930306:carton:4461:27930396,2794'}, {'unwanted_material': 'carton', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.9823530899579359, 'nb_photo': 5218, 'list_port_cont': '27418948,27420095,27420188,27420375,27420559,27421118,27421347,27421748,27421875,27422249,27422424,27422677,27422925,27423101,27423584,27423814,27424011,27424239,27424409,27428698,27428941,27432679,27463627,27464475,27464593,27464808,27464895,27465665,27466292,27466652,27466844,27466989,27467183,27467403,27467535,27467740,27467936,27468989,27470111,27499774,27500587,27500857,27501184,27501379,27501504,27501664,27502113,27502425,27502733,27502996,27503119,27503327,27503765,27503887,27504863,27505154,27506133,27506744,27506887,27508980,27510422,27510537,27510591,27510717,27510913,27516624,27516739,27582736,27594737,27595490,27596191,27596419,27596525,27602944,27603066,27603287,27603317,27603324,27603341,27603355,27603387,27606274,27608954,27609066,27609355,27609483,27609649,27609820,27610000,27610111,27611564,27612263,27616462,27616766,27617478,27623497,27629766,27630026,27630253,27630559,27641788,27670436,27671969,27686440,27686494,27686724,27687080,27687337,27687782,27688305,27688844,27689222,27689594,2769189', 'assoc_port': '27418726:27420095,27418727:27420188,27418728:27420375,27418729:27420559,27418732:27421118,27418734:27421347,27418737:27421748,27418740:27422249,27418742:27422424,27418744:27422677,27418747:27422925,27418749:27423101,27418753:27423584,27418756:27423814,27418759:27424011,27418763:27424239,27418766:27424409,27418767:27428698,27418792:27428941,27418795:27421875,27418800:27418948,27432639:27432679,27463446:27464475,27463447:27464593,27463473:27464808,27463476:27470111,27463479:27465665,27463482:27468989,27463487:27466292,27463491:27466652,27463492:27466844,27463493:27466989,27463496:27467183,27463498:27467403,27463499:27467535,27463502:27467740,27463506:27467936,27463508:27464895,27463512:27463627,27499684:27500587,27499685:27504863,27499686:27500857,27499687:27505154,27499688:27501184,27499689:27501379,27499691:27501504,27499692:27501664,27499695:27506133,27499697:27502113,27499698:27502425,27499701:27502733,27499710:27502996,27499711:27503119,27499714:27506744,27499717:27503327,27499718:27506887,27499753:2750376', 'assoc_mat': '27418726:carton:4207:27420095,27418727:carton:4207:27420188,27418728:carton:4207:27420375,27418729:carton:4207:27420559,27418732:carton:4207:27421118,27418734:carton:4207:27421347,27418737:carton:4207:27421748,27418740:carton:4207:27422249,27418742:carton:4207:27422424,27418744:carton:4207:27422677,27418747:carton:4207:27422925,27418749:carton:4207:27423101,27418753:carton:4207:27423584,27418756:carton:4207:27423814,27418759:carton:4207:27424011,27418763:carton:4207:27424239,27418766:carton:4207:27424409,27418767:carton:4207:27428698,27418792:carton:4207:27428941,27418795:carton:4207:27421875,27418800:carton:4207:27418948,27432639:carton:4207:27432679,27463446:carton:4207:27464475,27463447:carton:4207:27464593,27463473:carton:4207:27464808,27463476:carton:4207:27470111,27463479:carton:4207:27465665,27463482:carton:4207:27468989,27463487:carton:4207:27466292,27463491:carton:4207:27466652,27463492:carton:4207:27466844,27463493:carton:4207:27466989,27463496:carton:4207:27467183,27463498:carton:4207:27467403,2746'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.11880826110040273, 'nb_photo': 17, 'list_port_cont': '27463576,27766795,28010959,28108213,28113457', 'assoc_port': '27463495:27463576,27766720:27766795,28010441:28010959,28106529:28113457,28107855:28108213', 'assoc_mat': '27463495:carton:3327:27463576,27766720:carton:3327:27766795,28010441:carton:3327:28010959,28106529:carton:3327:28113457,28107855:carton:3327:28108213'}, {'unwanted_material': 'carton', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.004491002284790919, 'nb_photo': 602, 'list_port_cont': '27419388,27419704,27420361,27420759,27421104,27421456,27421495,27422896,27423796,27464695,27464710,27465074,27465300,27465498,27465620,27465964,27466603,27501486,27501846,27501931,27502234,27502378,27502555,27502691,27502948,27503459,27503950,27509213,27510367,27582866,27583295,27584014,27584715,27592773,27593257,27593709,27594103,27594581,27595793,27601086,27606471,27608779,27641940,27642324,27686198,27691927,27692575,27693737,27696272,27697237,27697481,27697782,27698263,27700872,27708282,27710395,27710997,27711861,27724732,27727329,27727735,27728092,27729644,27734421,27735018,27735963,27739525,27750337,27756619,27756762,27756854,27757486,27766906,27767799,27774158,27795784,27799609,27805800,27810676,27825619,27827433,27827734,27828030,27830439,27830635,27836600,27836723,27837549,27837745,27838103,27839494,27844344,27868754,27870057,27875814,27875991,27876260,27878337,27878816,27879628,27879962,27880180,27886733,27888902,27891188,27909608,27909635,27918612,27922420,27930550,27945159,27945508,27945692,2794726', 'assoc_port': '27418730:27420759,27418735:27421495,27418743:27421456,27418745:27421104,27418746:27423796,27418755:27420361,27418757:27422896,27418761:27419704,27418798:27419388,27463472:27464710,27463474:27465964,27463475:27465074,27463477:27465498,27463481:27465620,27463483:27465300,27463488:27464695,27463504:27466603,27499690:27503459,27499694:27501931,27499699:27502234,27499702:27502555,27499705:27503950,27499708:27501846,27499736:27501486,27499750:27502948,27499754:27502691,27499758:27502378,27508924:27509213,27508932:27510367,27582559:27584715,27582565:27584014,27582577:27583295,27582586:27582866,27592179:27595793,27592183:27594581,27592214:27594103,27592223:27593709,27592225:27593257,27592231:27592773,27600762:27601086,27606148:27608779,27606150:27606471,27641624:27642324,27641629:27641940,27685685:27686198,27691548:27698263,27691563:27697782,27691577:27696272,27691699:27700872,27691701:27697481,27691707:27697237,27691710:27693737,27691760:27692575,27691762:27691927,27704755:27708282,27710099:27710997,27710102:2771039', 'assoc_mat': '27418730:carton:3594:27420759,27418735:carton:3594:27421495,27418743:carton:3594:27421456,27418745:carton:3594:27421104,27418746:carton:3594:27423796,27418755:carton:3594:27420361,27418757:carton:3594:27422896,27418761:carton:3594:27419704,27418798:carton:3594:27419388,27463472:carton:3594:27464710,27463474:carton:3594:27465964,27463475:carton:3594:27465074,27463477:carton:3594:27465498,27463481:carton:3594:27465620,27463483:carton:3594:27465300,27463488:carton:3594:27464695,27463504:carton:3594:27466603,27499690:carton:3594:27503459,27499694:carton:3594:27501931,27499699:carton:3594:27502234,27499702:carton:3594:27502555,27499705:carton:3594:27503950,27499708:carton:3594:27501846,27499736:carton:3594:27501486,27499750:carton:3594:27502948,27499754:carton:3594:27502691,27499758:carton:3594:27502378,27508924:carton:3594:27509213,27508932:carton:3594:27510367,27582559:carton:3594:27584715,27582565:carton:3594:27584014,27582577:carton:3594:27583295,27582586:carton:3594:27582866,27592179:carton:3594:27595793,2759'}, {'unwanted_material': 'ela', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 1.1134562887965346e-05, 'nb_photo': 30, 'list_port_cont': '27421863,27715360,27909542,27909553,27949172,28021269', 'assoc_port': '27418795:27421863,27704747:27715360,27909527:27909553,27909530:27909542,27948335:27949172,27958871:28021269', 'assoc_mat': '27418795:ela:4207:27421863,27704747:ela:4207:27715360,27909527:ela:4207:27909553,27909530:ela:4207:27909542,27948335:ela:4207:27949172,27958871:ela:4207:28021269'}, {'unwanted_material': 'etiquette', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.000268508604521373, 'nb_photo': 2, 'list_port_cont': '27727992,28117796', 'assoc_port': '27727916:27727992,28107777:28117796', 'assoc_mat': '27727916:etiquette:4461:27727992,28107777:etiquette:4461:28117796'}, {'unwanted_material': 'etiquette', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.000331231933872294, 'nb_photo': 1147, 'list_port_cont': '27420177,27420373,27421123,27421336,27421862,27421928,27422253,27422425,27422652,27422912,27423090,27423410,27424010,27424243,27428704,27432682,27464595,27464900,27465307,27466122,27466298,27466850,27466990,27467189,27467396,27468981,27470112,27499773,27500584,27500858,27501381,27501505,27502995,27503114,27503766,27503886,27504860,27505155,27506878,27508981,27510430,27510542,27510589,27510716,27510918,27516747,27582740,27595487,27596425,27596532,27602950,27603064,27603190,27603304,27603333,27603346,27603367,27603392,27606280,27608788,27608956,27609077,27609351,27609640,27609819,27609964,27617474,27623505,27629762,27630029,27641787,27670440,27686491,27687065,27688303,27688586,27689233,27689595,27691905,27695886,27698313,27705024,27708516,27708670,27709170,27709353,27709520,27709902,27710110,27710264,27710544,27711960,27712406,27712902,27715366,27715526,27715950,27719824,27720785,27728632,27730044,27730415,27730442,27730491,27731071,27733362,27734398,27735958,27736070,27737413,27740473,27740500,27749148,2775001', 'assoc_port': '27418727:27420177,27418728:27420373,27418732:27421123,27418734:27421336,27418739:27421928,27418740:27422253,27418742:27422425,27418744:27422652,27418747:27422912,27418749:27423090,27418750:27423410,27418759:27424010,27418763:27424243,27418767:27428704,27418795:27421862,27432639:27432682,27463447:27464595,27463476:27470112,27463482:27468981,27463484:27466122,27463487:27466298,27463492:27466850,27463493:27466990,27463496:27467189,27463498:27467396,27463508:27464900,27463510:27465307,27499684:27500584,27499685:27504860,27499686:27500858,27499687:27505155,27499689:27501381,27499691:27501505,27499710:27502995,27499711:27503114,27499718:27506878,27499753:27503766,27499756:27503886,27499760:27499773,27508925:27510430,27508926:27510589,27508927:27510716,27508929:27510542,27508931:27510918,27508934:27508981,27516595:27516747,27582558:27608788,27582561:27608956,27582563:27609077,27582571:27609351,27582579:27609640,27582580:27609819,27582582:27609964,27582588:27582740,27592178:27603392,27592181:27603367,27592185:2760333', 'assoc_mat': '27418727:etiquette:4207:27420177,27418728:etiquette:4207:27420373,27418732:etiquette:4207:27421123,27418734:etiquette:4207:27421336,27418739:etiquette:4207:27421928,27418740:etiquette:4207:27422253,27418742:etiquette:4207:27422425,27418744:etiquette:4207:27422652,27418747:etiquette:4207:27422912,27418749:etiquette:4207:27423090,27418750:etiquette:4207:27423410,27418759:etiquette:4207:27424010,27418763:etiquette:4207:27424243,27418767:etiquette:4207:27428704,27418795:etiquette:4207:27421862,27432639:etiquette:4207:27432682,27463447:etiquette:4207:27464595,27463476:etiquette:4207:27470112,27463482:etiquette:4207:27468981,27463484:etiquette:4207:27466122,27463487:etiquette:4207:27466298,27463492:etiquette:4207:27466850,27463493:etiquette:4207:27466990,27463496:etiquette:4207:27467189,27463498:etiquette:4207:27467396,27463508:etiquette:4207:27464900,27463510:etiquette:4207:27465307,27499684:etiquette:4207:27500584,27499685:etiquette:4207:27504860,27499686:etiquette:4207:27500858,27499687:etiquette:4207:27505155,2'}, {'unwanted_material': 'film_plastique', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.9275231751574334, 'nb_photo': 1495, 'list_port_cont': '27418881,27418967,27419133,27419294,27419442,27463601,27463808,27463886,27463943,27499842,27500027,27500130,27500214,27583084,27583669,27583981,27584118,27592464,27592658,27606294,27606331,27606431,27641713,27641961,27642092,27686000,27686262,27686350,27691795,27692064,27692253,27710171,27711926,27727991,27728719,27728835,27734452,27738514,27749874,27749963,27756571,27756625,27766770,27771356,27771565,27771843,27805481,27808571,27825466,27830270,27839448,27868494,27868655,27875046,27886576,27918701,27918941,27930390,27946924,27946997,27948494,28007036,28022404,28022801,28022900,28031878,28033568,28034102,28044536,28049310,28106712,28106886,28107333,28107512,28107981,28108038,28108101,28108833,28109000,28109229,28109639,28110050,28110259,28111066,28111130,28111315,28112431,28116174,28116818,28117422,28117458,28117689,28117795,28118232,28118417,28118771,28119080,28119573,28121576,28128334,28132613', 'assoc_port': '27418738:27419442,27418752:27419294,27418764:27419133,27418793:27418967,27418799:27418881,27463478:27463943,27463486:27463886,27463490:27463808,27463501:27463601,27499704:27500214,27499715:27500130,27499751:27500027,27499761:27499842,27582566:27584118,27582568:27583981,27582573:27583669,27582585:27583084,27592213:27592658,27592220:27592464,27606142:27606431,27606147:27606331,27606180:27606294,27641626:27642092,27641634:27641961,27641639:27641713,27685670:27686262,27685683:27686350,27685684:27686000,27691582:27691795,27691704:27692253,27691729:27692064,27710104:27710171,27711756:27711926,27727916:27727991,27728617:27728835,27728621:27728719,27734386:27734452,27738493:27738514,27749755:27749963,27749756:27749874,27756451:27756571,27756452:27756625,27766715:27766770,27770943:27771565,27770946:27771843,27770950:27771356,27805407:27805481,27808484:27808571,27825269:27825466,27830132:27830270,27839273:27839448,27868454:27868655,27868455:27868494,27874707:27875046,27886513:27886576,27918334:27918941,27918365:2791870', 'assoc_mat': '27418738:film_plastique:4461:27419442,27418752:film_plastique:4461:27419294,27418764:film_plastique:4461:27419133,27418793:film_plastique:4461:27418967,27418799:film_plastique:4461:27418881,27463478:film_plastique:4461:27463943,27463486:film_plastique:4461:27463886,27463490:film_plastique:4461:27463808,27463501:film_plastique:4461:27463601,27499704:film_plastique:4461:27500214,27499715:film_plastique:4461:27500130,27499751:film_plastique:4461:27500027,27499761:film_plastique:4461:27499842,27582566:film_plastique:4461:27584118,27582568:film_plastique:4461:27583981,27582573:film_plastique:4461:27583669,27582585:film_plastique:4461:27583084,27592213:film_plastique:4461:27592658,27592220:film_plastique:4461:27592464,27606142:film_plastique:4461:27606431,27606147:film_plastique:4461:27606331,27606180:film_plastique:4461:27606294,27641626:film_plastique:4461:27642092,27641634:film_plastique:4461:27641961,27641639:film_plastique:4461:27641713,27685670:film_plastique:4461:27686262,27685683:film_plastique:4461:2768635'}, {'unwanted_material': 'film_plastique', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.005738575542220781, 'nb_photo': 14864, 'list_port_cont': '27418941,27419862,27420096,27420186,27420371,27420561,27420928,27421121,27421342,27421739,27421866,27421924,27422240,27422421,27422679,27422922,27423096,27423425,27423595,27423824,27424008,27424249,27424399,27428705,27428942,27432680,27463629,27464357,27464478,27464596,27464805,27464892,27465302,27465666,27465835,27466116,27466294,27466436,27466656,27466840,27466993,27467180,27467404,27467536,27467733,27467927,27468977,27470114,27499787,27500590,27500852,27501176,27501373,27501500,27501660,27502119,27502416,27502724,27502839,27502997,27503112,27503319,27503759,27503891,27504854,27505146,27506130,27506736,27506888,27508988,27510428,27510543,27510600,27510719,27510846,27510910,27516626,27516737,27582741,27594731,27595492,27596193,27596421,27596535,27602945,27603071,27603191,27603295,27603315,27603328,27603350,27603361,27603384,27603400,27606226,27606268,27606487,27608955,27609074,27609200,27609347,27609492,27609635,27609821,27609979,27610100,27611571,27612252,27616466,27616755,27617485,27622878,27623496,2762977', 'assoc_port': '27418725:27419862,27418726:27420096,27418727:27420186,27418728:27420371,27418729:27420561,27418731:27420928,27418732:27421121,27418734:27421342,27418737:27421739,27418739:27421924,27418740:27422240,27418742:27422421,27418744:27422679,27418747:27422922,27418749:27423096,27418750:27423425,27418753:27423595,27418756:27423824,27418759:27424008,27418763:27424249,27418766:27424399,27418767:27428705,27418792:27428942,27418795:27421866,27418800:27418941,27432639:27432680,27463445:27464357,27463446:27464478,27463447:27464596,27463473:27464805,27463476:27470114,27463479:27465666,27463480:27465835,27463482:27468977,27463484:27466116,27463487:27466294,27463489:27466436,27463491:27466656,27463492:27466840,27463493:27466993,27463496:27467180,27463498:27467404,27463499:27467536,27463502:27467733,27463506:27467927,27463508:27464892,27463510:27465302,27463512:27463629,27499684:27500590,27499685:27504854,27499686:27500852,27499687:27505146,27499688:27501176,27499689:27501373,27499691:27501500,27499692:27501660,27499695:2750613', 'assoc_mat': '27418725:film_plastique:4207:27419862,27418726:film_plastique:4207:27420096,27418727:film_plastique:4207:27420186,27418728:film_plastique:4207:27420371,27418729:film_plastique:4207:27420561,27418731:film_plastique:4207:27420928,27418732:film_plastique:4207:27421121,27418734:film_plastique:4207:27421342,27418737:film_plastique:4207:27421739,27418739:film_plastique:4207:27421924,27418740:film_plastique:4207:27422240,27418742:film_plastique:4207:27422421,27418744:film_plastique:4207:27422679,27418747:film_plastique:4207:27422922,27418749:film_plastique:4207:27423096,27418750:film_plastique:4207:27423425,27418753:film_plastique:4207:27423595,27418756:film_plastique:4207:27423824,27418759:film_plastique:4207:27424008,27418763:film_plastique:4207:27424249,27418766:film_plastique:4207:27424399,27418767:film_plastique:4207:27428705,27418792:film_plastique:4207:27428942,27418795:film_plastique:4207:27421866,27418800:film_plastique:4207:27418941,27432639:film_plastique:4207:27432680,27463445:film_plastique:4207:2746435'}, {'unwanted_material': 'kraft', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00014453050925727272, 'nb_photo': 23, 'list_port_cont': '27421126,27424240,27506889,27629768,27709521,27710251,27740488,27791005,27812306,27884565,27909540,28021268,28062659,28279649', 'assoc_port': '27418732:27421126,27418763:27424240,27499718:27506889,27606141:27629768,27691703:27709521,27691727:27710251,27740472:27740488,27789756:27791005,27812255:27812306,27884188:27884565,27909530:27909540,27958871:28021268,28006905:28062659,28106783:28279649', 'assoc_mat': '27418732:kraft:4207:27421126,27418763:kraft:4207:27424240,27499718:kraft:4207:27506889,27606141:kraft:4207:27629768,27691703:kraft:4207:27709521,27691727:kraft:4207:27710251,27740472:kraft:4207:27740488,27789756:kraft:4207:27791005,27812255:kraft:4207:27812306,27884188:kraft:4207:27884565,27909530:kraft:4207:27909540,27958871:kraft:4207:28021268,28006905:kraft:4207:28062659,28106783:kraft:4207:28279649'}, {'unwanted_material': 'metal', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.011692036280533944, 'nb_photo': 1, 'list_port_cont': '27583663', 'assoc_port': '27582573:27583663', 'assoc_mat': '27582573:metal:4461:27583663'}, {'unwanted_material': 'metal', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0051882316820514975, 'nb_photo': 803, 'list_port_cont': '27418937,27420185,27420376,27420558,27421129,27421346,27421867,27421939,27422241,27422428,27422646,27422924,27423103,27423999,27432678,27464597,27464898,27465832,27466301,27466655,27466852,27466996,27467394,27467735,27467933,27468974,27470104,27499781,27500589,27501183,27501497,27503105,27503771,27503877,27504851,27505147,27506128,27506881,27508977,27510721,27510917,27516740,27595493,27596424,27602948,27603074,27603296,27603310,27603364,27603385,27606271,27608949,27609064,27609636,27609980,27612266,27616460,27616769,27617480,27622879,27623492,27629764,27630039,27630564,27641785,27686448,27686489,27687071,27687341,27688309,27689231,27689812,27691901,27695884,27698189,27698321,27705013,27708347,27708509,27708675,27709517,27709628,27709691,27709906,27710117,27710539,27712419,27712785,27712904,27715367,27715617,27715951,27719829,27720798,27727128,27727284,27728316,27730379,27730433,27730484,27730546,27731073,27733369,27733569,27734401,27735956,27736064,27736509,27737422,27740487,27740497,27750080,27750102,2775015', 'assoc_port': '27418727:27420185,27418728:27420376,27418729:27420558,27418732:27421129,27418734:27421346,27418739:27421939,27418740:27422241,27418742:27422428,27418744:27422646,27418747:27422924,27418749:27423103,27418759:27423999,27418795:27421867,27418800:27418937,27432639:27432678,27463447:27464597,27463476:27470104,27463480:27465832,27463482:27468974,27463487:27466301,27463491:27466655,27463492:27466852,27463493:27466996,27463498:27467394,27463502:27467735,27463506:27467933,27463508:27464898,27499684:27500589,27499685:27504851,27499687:27505147,27499688:27501183,27499691:27501497,27499695:27506128,27499711:27503105,27499718:27506881,27499753:27503771,27499756:27503877,27499760:27499781,27508927:27510721,27508931:27510917,27508934:27508977,27516595:27516740,27582561:27608949,27582563:27609064,27582579:27609636,27582582:27609980,27592178:27603385,27592181:27603364,27592216:27603296,27592217:27603310,27592218:27603074,27592227:27596424,27595363:27595493,27600763:27602948,27606141:27629764,27606143:27630039,27606145:2762349', 'assoc_mat': '27418727:metal:4207:27420185,27418728:metal:4207:27420376,27418729:metal:4207:27420558,27418732:metal:4207:27421129,27418734:metal:4207:27421346,27418739:metal:4207:27421939,27418740:metal:4207:27422241,27418742:metal:4207:27422428,27418744:metal:4207:27422646,27418747:metal:4207:27422924,27418749:metal:4207:27423103,27418759:metal:4207:27423999,27418795:metal:4207:27421867,27418800:metal:4207:27418937,27432639:metal:4207:27432678,27463447:metal:4207:27464597,27463476:metal:4207:27470104,27463480:metal:4207:27465832,27463482:metal:4207:27468974,27463487:metal:4207:27466301,27463491:metal:4207:27466655,27463492:metal:4207:27466852,27463493:metal:4207:27466996,27463498:metal:4207:27467394,27463502:metal:4207:27467735,27463506:metal:4207:27467933,27463508:metal:4207:27464898,27499684:metal:4207:27500589,27499685:metal:4207:27504851,27499687:metal:4207:27505147,27499688:metal:4207:27501183,27499691:metal:4207:27501497,27499695:metal:4207:27506128,27499711:metal:4207:27503105,27499718:metal:4207:27506881,27499753:'}, {'unwanted_material': 'metal', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.00031845171456874557, 'nb_photo': 144, 'list_port_cont': '27419696,27421102,27465504,27501856,27502381,27502672,27503948,27509219,27583289,27592767,27594589,27608776,27641943,27642329,27686195,27686651,27692576,27693732,27696269,27696627,27697233,27697789,27700875,27710402,27715467,27727332,27729647,27756857,27757484,27766908,27767801,27771141,27799606,27827731,27830441,27836603,27838101,27839500,27868747,27875833,27879620,27888904,27909612,27945162,27945513,27947259,28013640,28020309,28044518,28045012,28108303,28109206,28109526,28112376,28112819,28115918,28117407,28118100,28120111,28121851,28122737,28123049,28123367,28125349,28126017,28128441,28128842,28129225', 'assoc_port': '27418745:27421102,27418761:27419696,27463477:27465504,27499705:27503948,27499708:27501856,27499754:27502672,27499758:27502381,27508924:27509219,27582577:27583289,27592183:27594589,27592231:27592767,27606148:27608776,27641624:27642329,27641629:27641943,27685658:27686651,27685685:27686195,27691563:27697789,27691577:27696269,27691699:27700875,27691707:27697233,27691710:27693732,27691756:27696627,27691760:27692576,27710102:27710402,27710103:27715467,27727085:27727332,27729545:27729647,27756449:27757484,27756455:27756857,27766717:27767801,27766721:27766908,27770948:27771141,27799345:27799606,27827191:27827731,27830135:27830441,27831149:27838101,27836511:27836603,27839271:27839500,27868453:27868747,27874751:27875833,27877920:27879620,27888879:27888904,27909529:27909612,27944806:27947259,27944828:27945513,27944829:27945162,28012680:28020309,28012681:28013640,28044321:28045012,28044330:28044518,28106440:28128842,28106523:28128441,28106540:28129225,28106544:28126017,28106546:28125349,28106603:28122737,28107399:2812185', 'assoc_mat': '27418745:metal:3594:27421102,27418761:metal:3594:27419696,27463477:metal:3594:27465504,27499705:metal:3594:27503948,27499708:metal:3594:27501856,27499754:metal:3594:27502672,27499758:metal:3594:27502381,27508924:metal:3594:27509219,27582577:metal:3594:27583289,27592183:metal:3594:27594589,27592231:metal:3594:27592767,27606148:metal:3594:27608776,27641624:metal:3594:27642329,27641629:metal:3594:27641943,27685658:metal:3594:27686651,27685685:metal:3594:27686195,27691563:metal:3594:27697789,27691577:metal:3594:27696269,27691699:metal:3594:27700875,27691707:metal:3594:27697233,27691710:metal:3594:27693732,27691756:metal:3594:27696627,27691760:metal:3594:27692576,27710102:metal:3594:27710402,27710103:metal:3594:27715467,27727085:metal:3594:27727332,27729545:metal:3594:27729647,27756449:metal:3594:27757484,27756455:metal:3594:27756857,27766717:metal:3594:27767801,27766721:metal:3594:27766908,27770948:metal:3594:27771141,27799345:metal:3594:27799606,27827191:metal:3594:27827731,27830135:metal:3594:27830441,27831149:'}, {'unwanted_material': 'papier', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.07153413732892204, 'nb_photo': 5023, 'list_port_cont': '27418871,27418973,27419124,27419295,27419447,27463588,27463798,27463889,27463938,27499839,27500025,27500123,27500208,27583089,27583668,27583986,27584121,27592476,27592659,27606287,27606325,27606422,27641717,27641954,27642082,27686001,27686249,27686356,27691792,27692067,27692261,27710174,27711920,27727993,27728727,27728842,27734457,27738523,27749881,27749967,27756577,27756631,27766758,27771358,27771553,27771852,27805485,27808562,27825476,27830275,27839441,27868493,27868652,27875041,27886577,27918702,27918947,27930398,27946913,27947001,27948489,28007037,28022411,28022806,28022896,28031871,28033558,28034100,28044528,28049314,28106696,28106862,28107335,28107520,28107977,28108041,28108094,28108831,28108998,28109222,28109649,28110051,28110256,28111073,28111132,28111314,28112446,28116178,28116812,28117427,28117466,28117693,28117798,28118223,28118409,28118774,28119073,28119564,28121567,28128333,28132615', 'assoc_port': '27418738:27419447,27418752:27419295,27418764:27419124,27418793:27418973,27418799:27418871,27463478:27463938,27463486:27463889,27463490:27463798,27463501:27463588,27499704:27500208,27499715:27500123,27499751:27500025,27499761:27499839,27582566:27584121,27582568:27583986,27582573:27583668,27582585:27583089,27592213:27592659,27592220:27592476,27606142:27606422,27606147:27606325,27606180:27606287,27641626:27642082,27641634:27641954,27641639:27641717,27685670:27686249,27685683:27686356,27685684:27686001,27691582:27691792,27691704:27692261,27691729:27692067,27710104:27710174,27711756:27711920,27727916:27727993,27728617:27728842,27728621:27728727,27734386:27734457,27738493:27738523,27749755:27749967,27749756:27749881,27756451:27756577,27756452:27756631,27766715:27766758,27770943:27771553,27770946:27771852,27770950:27771358,27805407:27805485,27808484:27808562,27825269:27825476,27830132:27830275,27839273:27839441,27868454:27868652,27868455:27868493,27874707:27875041,27886513:27886577,27918334:27918947,27918365:2791870', 'assoc_mat': '27418738:papier:4461:27419447,27418752:papier:4461:27419295,27418764:papier:4461:27419124,27418793:papier:4461:27418973,27418799:papier:4461:27418871,27463478:papier:4461:27463938,27463486:papier:4461:27463889,27463490:papier:4461:27463798,27463501:papier:4461:27463588,27499704:papier:4461:27500208,27499715:papier:4461:27500123,27499751:papier:4461:27500025,27499761:papier:4461:27499839,27582566:papier:4461:27584121,27582568:papier:4461:27583986,27582573:papier:4461:27583668,27582585:papier:4461:27583089,27592213:papier:4461:27592659,27592220:papier:4461:27592476,27606142:papier:4461:27606422,27606147:papier:4461:27606325,27606180:papier:4461:27606287,27641626:papier:4461:27642082,27641634:papier:4461:27641954,27641639:papier:4461:27641717,27685670:papier:4461:27686249,27685683:papier:4461:27686356,27685684:papier:4461:27686001,27691582:papier:4461:27691792,27691704:papier:4461:27692261,27691729:papier:4461:27692067,27710104:papier:4461:27710174,27711756:papier:4461:27711920,27727916:papier:4461:27727993,2772'}, {'unwanted_material': 'papier', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.006848099963115994, 'nb_photo': 20149, 'list_port_cont': '27418946,27419865,27420102,27420174,27420369,27420560,27420930,27421127,27421345,27421740,27421869,27421937,27422254,27422437,27422674,27422926,27423092,27423424,27423585,27424002,27424250,27424400,27428699,27428938,27432685,27463638,27464350,27464480,27464600,27464816,27464906,27465311,27465659,27465826,27466114,27466287,27466445,27466653,27466847,27467004,27467188,27467391,27467541,27467736,27467939,27468975,27470107,27499784,27500855,27501177,27501367,27501499,27501668,27502123,27502420,27502727,27502842,27503001,27503117,27503321,27503764,27503883,27504864,27505140,27506137,27506734,27506890,27508986,27510434,27510545,27510590,27510731,27510847,27510908,27516635,27516735,27582727,27594738,27595497,27596201,27596420,27596527,27602952,27603072,27603196,27603301,27603306,27603323,27603338,27603365,27603372,27603398,27606235,27606270,27606495,27608789,27608946,27609069,27609188,27609345,27609497,27609648,27609812,27610002,27610101,27611560,27612264,27616461,27616759,27617484,27622884,27623498,27629769,2763003', 'assoc_port': '27418725:27419865,27418726:27420102,27418727:27420174,27418728:27420369,27418729:27420560,27418731:27420930,27418732:27421127,27418734:27421345,27418737:27421740,27418739:27421937,27418740:27422254,27418742:27422437,27418744:27422674,27418747:27422926,27418749:27423092,27418750:27423424,27418753:27423585,27418759:27424002,27418763:27424250,27418766:27424400,27418767:27428699,27418792:27428938,27418795:27421869,27418800:27418946,27432639:27432685,27463445:27464350,27463446:27464480,27463447:27464600,27463473:27464816,27463476:27470107,27463479:27465659,27463480:27465826,27463482:27468975,27463484:27466114,27463487:27466287,27463489:27466445,27463491:27466653,27463492:27466847,27463493:27467004,27463496:27467188,27463498:27467391,27463499:27467541,27463502:27467736,27463506:27467939,27463508:27464906,27463510:27465311,27463512:27463638,27499685:27504864,27499686:27500855,27499687:27505140,27499688:27501177,27499689:27501367,27499691:27501499,27499692:27501668,27499695:27506137,27499697:27502123,27499698:2750242', 'assoc_mat': '27418725:papier:4207:27419865,27418726:papier:4207:27420102,27418727:papier:4207:27420174,27418728:papier:4207:27420369,27418729:papier:4207:27420560,27418731:papier:4207:27420930,27418732:papier:4207:27421127,27418734:papier:4207:27421345,27418737:papier:4207:27421740,27418739:papier:4207:27421937,27418740:papier:4207:27422254,27418742:papier:4207:27422437,27418744:papier:4207:27422674,27418747:papier:4207:27422926,27418749:papier:4207:27423092,27418750:papier:4207:27423424,27418753:papier:4207:27423585,27418759:papier:4207:27424002,27418763:papier:4207:27424250,27418766:papier:4207:27424400,27418767:papier:4207:27428699,27418792:papier:4207:27428938,27418795:papier:4207:27421869,27418800:papier:4207:27418946,27432639:papier:4207:27432685,27463445:papier:4207:27464350,27463446:papier:4207:27464480,27463447:papier:4207:27464600,27463473:papier:4207:27464816,27463476:papier:4207:27470107,27463479:papier:4207:27465659,27463480:papier:4207:27465826,27463482:papier:4207:27468975,27463484:papier:4207:27466114,2746'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.04079768424702879, 'nb_photo': 21, 'list_port_cont': '27463583,27766794,28010958,28108211,28113458', 'assoc_port': '27463495:27463583,27766720:27766794,28010441:28010958,28106529:28113458,28107855:28108211', 'assoc_mat': '27463495:papier:3327:27463583,27766720:papier:3327:27766794,28010441:papier:3327:28010958,28106529:papier:3327:28113458,28107855:papier:3327:28108211'}, {'unwanted_material': 'papier', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.00813369996132629, 'nb_photo': 3192, 'list_port_cont': '27419381,27419697,27420359,27420765,27421098,27421460,27421500,27422891,27423802,27464704,27464708,27464921,27465069,27465296,27465505,27465625,27465954,27466602,27501487,27501848,27501932,27502242,27502376,27502693,27502946,27503456,27503946,27509212,27510361,27582865,27583288,27584012,27584717,27592770,27593263,27593706,27594100,27594586,27595481,27595797,27606472,27608782,27641945,27642333,27686199,27686650,27691921,27692571,27693729,27696275,27696619,27697227,27697486,27697785,27698272,27700871,27708277,27710398,27710998,27711856,27715472,27724726,27727328,27727736,27728095,27729645,27734416,27735015,27735966,27739527,27750071,27750338,27756641,27756764,27756858,27757480,27766907,27767805,27771140,27771763,27774153,27774738,27795786,27799604,27805571,27805807,27810673,27825621,27827428,27827733,27828039,27830438,27830638,27836604,27836724,27837543,27837743,27838098,27839496,27844343,27868751,27870059,27875841,27875997,27876256,27878340,27878818,27879624,27879969,27880178,27886737,27888903,27891180,2790960', 'assoc_port': '27418730:27420765,27418735:27421500,27418743:27421460,27418745:27421098,27418746:27423802,27418755:27420359,27418757:27422891,27418761:27419697,27418798:27419381,27463472:27464708,27463474:27465954,27463475:27465069,27463477:27465505,27463481:27465625,27463483:27465296,27463485:27464921,27463488:27464704,27463504:27466602,27499690:27503456,27499694:27501932,27499699:27502242,27499705:27503946,27499708:27501848,27499736:27501487,27499750:27502946,27499754:27502693,27499758:27502376,27508924:27509212,27508932:27510361,27582559:27584717,27582565:27584012,27582577:27583288,27582586:27582865,27592179:27595797,27592183:27594586,27592186:27595481,27592214:27594100,27592223:27593706,27592225:27593263,27592231:27592770,27606148:27608782,27606150:27606472,27641624:27642333,27641629:27641945,27685658:27686650,27685685:27686199,27691548:27698272,27691563:27697785,27691577:27696275,27691699:27700871,27691701:27697486,27691707:27697227,27691710:27693729,27691756:27696619,27691760:27692571,27691762:27691921,27704755:2770827', 'assoc_mat': '27418730:papier:3594:27420765,27418735:papier:3594:27421500,27418743:papier:3594:27421460,27418745:papier:3594:27421098,27418746:papier:3594:27423802,27418755:papier:3594:27420359,27418757:papier:3594:27422891,27418761:papier:3594:27419697,27418798:papier:3594:27419381,27463472:papier:3594:27464708,27463474:papier:3594:27465954,27463475:papier:3594:27465069,27463477:papier:3594:27465505,27463481:papier:3594:27465625,27463483:papier:3594:27465296,27463485:papier:3594:27464921,27463488:papier:3594:27464704,27463504:papier:3594:27466602,27499690:papier:3594:27503456,27499694:papier:3594:27501932,27499699:papier:3594:27502242,27499705:papier:3594:27503946,27499708:papier:3594:27501848,27499736:papier:3594:27501487,27499750:papier:3594:27502946,27499754:papier:3594:27502693,27499758:papier:3594:27502376,27508924:papier:3594:27509212,27508932:papier:3594:27510361,27582559:papier:3594:27584717,27582565:papier:3594:27584012,27582577:papier:3594:27583288,27582586:papier:3594:27582865,27592179:papier:3594:27595797,2759'}, {'unwanted_material': 'pehd', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00016997771030768203, 'nb_photo': 40, 'list_port_cont': '27421334,27464899,27466120,27466299,27503888,27505144,27506886,27582728,27629773,27630031,27686734,27689223,27698194,27708678,27709639,27730441,27736060,27740479,27772565,27830684,27843069,27868931,27909533,27919390,28021258,28265179,28267020,28268066,28268202,28272480,28279654,28284212', 'assoc_port': '27418734:27421334,27463484:27466120,27463487:27466299,27463508:27464899,27499687:27505144,27499718:27506886,27499756:27503888,27582588:27582728,27606141:27629773,27606143:27630031,27641588:27686734,27641632:27689223,27691661:27708678,27691705:27709639,27697995:27698194,27730218:27730441,27735873:27736060,27740472:27740479,27770955:27772565,27830129:27830684,27842452:27843069,27868456:27868931,27909530:27909533,27918330:27919390,27958871:28021258,28106535:28265179,28106645:28267020,28106778:28268066,28106782:28268202,28106783:28279654,28107769:28272480,28108532:28284212', 'assoc_mat': '27418734:pehd:4207:27421334,27463484:pehd:4207:27466120,27463487:pehd:4207:27466299,27463508:pehd:4207:27464899,27499687:pehd:4207:27505144,27499718:pehd:4207:27506886,27499756:pehd:4207:27503888,27582588:pehd:4207:27582728,27606141:pehd:4207:27629773,27606143:pehd:4207:27630031,27641588:pehd:4207:27686734,27641632:pehd:4207:27689223,27691661:pehd:4207:27708678,27691705:pehd:4207:27709639,27697995:pehd:4207:27698194,27730218:pehd:4207:27730441,27735873:pehd:4207:27736060,27740472:pehd:4207:27740479,27770955:pehd:4207:27772565,27830129:pehd:4207:27830684,27842452:pehd:4207:27843069,27868456:pehd:4207:27868931,27909530:pehd:4207:27909533,27918330:pehd:4207:27919390,27958871:pehd:4207:28021258,28106535:pehd:4207:28265179,28106645:pehd:4207:28267020,28106778:pehd:4207:28268066,28106782:pehd:4207:28268202,28106783:pehd:4207:28279654,28107769:pehd:4207:28272480,28108532:pehd:4207:28284212'}, {'unwanted_material': 'pehd', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0006817943984943475, 'nb_photo': 40, 'list_port_cont': '27421105,27501849,27503953,27509221,27594582,27697786,27700877,27727331,27756855,27757481,27868748,27909633,27947260,28020308,28109964,28117413,28120113,28125353,28126015', 'assoc_port': '27418745:27421105,27499705:27503953,27499708:27501849,27508924:27509221,27592183:27594582,27691563:27697786,27691699:27700877,27727085:27727331,27756449:27757481,27756455:27756855,27868453:27868748,27909528:27909633,27944806:27947260,28012680:28020308,28106544:28126015,28106546:28125353,28107403:28120113,28107832:28117413,28108372:28109964', 'assoc_mat': '27418745:pehd:3594:27421105,27499705:pehd:3594:27503953,27499708:pehd:3594:27501849,27508924:pehd:3594:27509221,27592183:pehd:3594:27594582,27691563:pehd:3594:27697786,27691699:pehd:3594:27700877,27727085:pehd:3594:27727331,27756449:pehd:3594:27757481,27756455:pehd:3594:27756855,27868453:pehd:3594:27868748,27909528:pehd:3594:27909633,27944806:pehd:3594:27947260,28012680:pehd:3594:28020308,28106544:pehd:3594:28126015,28106546:pehd:3594:28125353,28107403:pehd:3594:28120113,28107832:pehd:3594:28117413,28108372:pehd:3594:28109964'}, {'unwanted_material': 'pet_clair', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0003459939884055656, 'nb_photo': 1, 'list_port_cont': '27830277', 'assoc_port': '27830132:27830277', 'assoc_mat': '27830132:pet_clair:4461:27830277'}, {'unwanted_material': 'pet_clair', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.001969832205376704, 'nb_photo': 1063, 'list_port_cont': '27418943,27420097,27420181,27420396,27420937,27421130,27421870,27422250,27422430,27423411,27423996,27424248,27428712,27428936,27464347,27464484,27464588,27464901,27465310,27465831,27466300,27466444,27466657,27466853,27466999,27467399,27467938,27468985,27470109,27499779,27500580,27500850,27501182,27502418,27502729,27502845,27502991,27503108,27503328,27503761,27503880,27504858,27505152,27506132,27506739,27506882,27508985,27510534,27510599,27510720,27510907,27516623,27516745,27582738,27595489,27596204,27596415,27596534,27602955,27603075,27603292,27603311,27603347,27603370,27603386,27606277,27608952,27609078,27609639,27609815,27610108,27611569,27612258,27616465,27622870,27629774,27630033,27630550,27641795,27686450,27686733,27687072,27687338,27687577,27688306,27688594,27688850,27689228,27689608,27689804,27691891,27695885,27698311,27705023,27708346,27708501,27708681,27709161,27709518,27709632,27709690,27710109,27710250,27710387,27710552,27711951,27712154,27712415,27712566,27712788,27712897,27715365,27715529,2771562', 'assoc_port': '27418726:27420097,27418727:27420181,27418728:27420396,27418731:27420937,27418732:27421130,27418740:27422250,27418742:27422430,27418750:27423411,27418759:27423996,27418763:27424248,27418767:27428712,27418792:27428936,27418795:27421870,27418800:27418943,27463445:27464347,27463446:27464484,27463447:27464588,27463476:27470109,27463480:27465831,27463482:27468985,27463487:27466300,27463489:27466444,27463491:27466657,27463492:27466853,27463493:27466999,27463498:27467399,27463506:27467938,27463508:27464901,27463510:27465310,27499684:27500580,27499685:27504858,27499686:27500850,27499687:27505152,27499688:27501182,27499695:27506132,27499698:27502418,27499701:27502729,27499707:27502845,27499710:27502991,27499711:27503108,27499714:27506739,27499717:27503328,27499718:27506882,27499753:27503761,27499756:27503880,27499760:27499779,27508926:27510599,27508927:27510720,27508929:27510534,27508931:27510907,27508934:27508985,27516594:27516623,27516595:27516745,27582561:27608952,27582563:27609078,27582579:27609639,27582580:2760981', 'assoc_mat': '27418726:pet_clair:4207:27420097,27418727:pet_clair:4207:27420181,27418728:pet_clair:4207:27420396,27418731:pet_clair:4207:27420937,27418732:pet_clair:4207:27421130,27418740:pet_clair:4207:27422250,27418742:pet_clair:4207:27422430,27418750:pet_clair:4207:27423411,27418759:pet_clair:4207:27423996,27418763:pet_clair:4207:27424248,27418767:pet_clair:4207:27428712,27418792:pet_clair:4207:27428936,27418795:pet_clair:4207:27421870,27418800:pet_clair:4207:27418943,27463445:pet_clair:4207:27464347,27463446:pet_clair:4207:27464484,27463447:pet_clair:4207:27464588,27463476:pet_clair:4207:27470109,27463480:pet_clair:4207:27465831,27463482:pet_clair:4207:27468985,27463487:pet_clair:4207:27466300,27463489:pet_clair:4207:27466444,27463491:pet_clair:4207:27466657,27463492:pet_clair:4207:27466853,27463493:pet_clair:4207:27466999,27463498:pet_clair:4207:27467399,27463506:pet_clair:4207:27467938,27463508:pet_clair:4207:27464901,27463510:pet_clair:4207:27465310,27499684:pet_clair:4207:27500580,27499685:pet_clair:4207:27504858,2'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.8972511864030355, 'nb_photo': 520, 'list_port_cont': '27463571,27766798,28010951,28107741,28108212,28113459', 'assoc_port': '27463495:27463571,27766720:27766798,28010441:28010951,28106529:28113459,28107402:28107741,28107855:28108212', 'assoc_mat': '27463495:pet_clair:3327:27463571,27766720:pet_clair:3327:27766798,28010441:pet_clair:3327:28010951,28106529:pet_clair:3327:28113459,28107402:pet_clair:3327:28107741,28107855:pet_clair:3327:28108212'}, {'unwanted_material': 'pet_clair', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.07413983167959405, 'nb_photo': 3080, 'list_port_cont': '27419380,27419694,27420357,27420766,27421099,27421461,27421502,27422897,27423799,27464697,27464707,27464914,27465080,27465298,27465497,27465626,27465963,27466601,27501477,27501853,27501929,27502238,27502377,27502562,27502692,27502950,27503453,27503952,27509214,27510370,27582863,27583285,27584017,27584721,27592765,27593264,27593712,27594101,27594590,27595480,27595792,27601080,27606479,27608775,27641939,27642328,27686191,27686672,27691920,27692574,27693735,27696270,27696620,27697228,27697478,27697781,27698270,27700880,27708284,27710397,27710990,27711855,27715474,27724728,27727325,27727739,27728096,27729640,27734422,27735020,27735967,27739529,27750076,27750333,27756624,27756772,27756861,27757487,27766915,27767802,27771132,27771759,27774156,27774744,27795781,27799610,27805572,27805798,27810671,27825624,27827429,27827736,27828032,27830443,27830644,27836601,27836725,27837544,27837749,27838095,27839501,27844341,27868745,27870056,27875829,27875981,27876257,27878341,27878814,27879623,27879971,27880185,27886720,2788891', 'assoc_port': '27418730:27420766,27418735:27421502,27418743:27421461,27418745:27421099,27418746:27423799,27418755:27420357,27418757:27422897,27418761:27419694,27418798:27419380,27463472:27464707,27463474:27465963,27463475:27465080,27463477:27465497,27463481:27465626,27463483:27465298,27463485:27464914,27463488:27464697,27463504:27466601,27499690:27503453,27499694:27501929,27499699:27502238,27499702:27502562,27499705:27503952,27499708:27501853,27499736:27501477,27499750:27502950,27499754:27502692,27499758:27502377,27508924:27509214,27508932:27510370,27582559:27584721,27582565:27584017,27582577:27583285,27582586:27582863,27592179:27595792,27592183:27594590,27592186:27595480,27592214:27594101,27592223:27593712,27592225:27593264,27592231:27592765,27600762:27601080,27606148:27608775,27606150:27606479,27641624:27642328,27641629:27641939,27685658:27686672,27685685:27686191,27691548:27698270,27691563:27697781,27691577:27696270,27691699:27700880,27691701:27697478,27691707:27697228,27691710:27693735,27691756:27696620,27691760:2769257', 'assoc_mat': '27418730:pet_clair:3594:27420766,27418735:pet_clair:3594:27421502,27418743:pet_clair:3594:27421461,27418745:pet_clair:3594:27421099,27418746:pet_clair:3594:27423799,27418755:pet_clair:3594:27420357,27418757:pet_clair:3594:27422897,27418761:pet_clair:3594:27419694,27418798:pet_clair:3594:27419380,27463472:pet_clair:3594:27464707,27463474:pet_clair:3594:27465963,27463475:pet_clair:3594:27465080,27463477:pet_clair:3594:27465497,27463481:pet_clair:3594:27465626,27463483:pet_clair:3594:27465298,27463485:pet_clair:3594:27464914,27463488:pet_clair:3594:27464697,27463504:pet_clair:3594:27466601,27499690:pet_clair:3594:27503453,27499694:pet_clair:3594:27501929,27499699:pet_clair:3594:27502238,27499702:pet_clair:3594:27502562,27499705:pet_clair:3594:27503952,27499708:pet_clair:3594:27501853,27499736:pet_clair:3594:27501477,27499750:pet_clair:3594:27502950,27499754:pet_clair:3594:27502692,27499758:pet_clair:3594:27502377,27508924:pet_clair:3594:27509214,27508932:pet_clair:3594:27510370,27582559:pet_clair:3594:27584721,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0010581292130120163, 'nb_photo': 1, 'list_port_cont': '28106694', 'assoc_port': '28106469:28106694', 'assoc_mat': '28106469:pet_fonce:4461:28106694'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00027397668626311236, 'nb_photo': 82, 'list_port_cont': '27421122,27421865,27422927,27424003,27466434,27466848,27467400,27470099,27500862,27502992,27503768,27504855,27510546,27582733,27596526,27603366,27603378,27629776,27641798,27686729,27687069,27688592,27691898,27695883,27711956,27715355,27715675,27718704,27740482,27750254,27767164,27775017,27778163,27778209,27789807,27799402,27812325,27813057,27839320,27847401,27849181,27875949,27876505,27876572,27878007,27880633,27884556,27945658,27945811,27949027,28050360,28053925,28260749,28260953,28264593,28265175,28266553,28267016,28269774,28279660,28284065,28287578,28288985', 'assoc_port': '27418732:27421122,27418747:27422927,27418759:27424003,27418795:27421865,27463476:27470099,27463489:27466434,27463492:27466848,27463498:27467400,27499685:27504855,27499686:27500862,27499710:27502992,27499753:27503768,27508929:27510546,27582588:27582733,27592177:27603378,27592181:27603366,27592228:27596526,27606141:27629776,27641588:27686729,27641591:27687069,27641627:27688592,27641644:27641798,27691763:27691898,27695052:27695883,27704747:27715355,27704753:27715675,27710100:27718704,27711755:27711956,27740472:27740482,27749757:27750254,27756447:27767164,27774009:27775017,27778157:27778163,27778158:27778209,27789755:27789807,27799347:27799402,27812254:27812325,27812918:27813057,27839272:27839320,27841473:27847401,27843158:27849181,27868449:27876572,27868452:27876505,27874711:27880633,27874713:27875949,27877950:27878007,27884188:27884556,27944822:27945811,27944827:27945658,27948338:27949027,28010438:28053925,28050281:28050360,28106272:28260749,28106274:28260953,28106530:28264593,28106535:28265175,28106585:2826655', 'assoc_mat': '27418732:pet_fonce:4207:27421122,27418747:pet_fonce:4207:27422927,27418759:pet_fonce:4207:27424003,27418795:pet_fonce:4207:27421865,27463476:pet_fonce:4207:27470099,27463489:pet_fonce:4207:27466434,27463492:pet_fonce:4207:27466848,27463498:pet_fonce:4207:27467400,27499685:pet_fonce:4207:27504855,27499686:pet_fonce:4207:27500862,27499710:pet_fonce:4207:27502992,27499753:pet_fonce:4207:27503768,27508929:pet_fonce:4207:27510546,27582588:pet_fonce:4207:27582733,27592177:pet_fonce:4207:27603378,27592181:pet_fonce:4207:27603366,27592228:pet_fonce:4207:27596526,27606141:pet_fonce:4207:27629776,27641588:pet_fonce:4207:27686729,27641591:pet_fonce:4207:27687069,27641627:pet_fonce:4207:27688592,27641644:pet_fonce:4207:27641798,27691763:pet_fonce:4207:27691898,27695052:pet_fonce:4207:27695883,27704747:pet_fonce:4207:27715355,27704753:pet_fonce:4207:27715675,27710100:pet_fonce:4207:27718704,27711755:pet_fonce:4207:27711956,27740472:pet_fonce:4207:27740482,27749757:pet_fonce:4207:27750254,27756447:pet_fonce:4207:27767164,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.037922203177391936, 'nb_photo': 4, 'list_port_cont': '27766801,28108215', 'assoc_port': '27766720:27766801,28107855:28108215', 'assoc_mat': '27766720:pet_fonce:3327:27766801,28107855:pet_fonce:3327:28108215'}, {'unwanted_material': 'pet_fonce', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0003514998697290363, 'nb_photo': 48, 'list_port_cont': '27421097,27465299,27501854,27594097,27594588,27686197,27686645,27697790,27698271,27700873,27710396,27710995,27727326,27729642,27739532,27757482,27799603,27825627,27827730,27878334,27888901,27945155,28020301,28036028,28044509,28117030,28117412,28125358,28126311,28127778,28131443,28132386', 'assoc_port': '27418745:27421097,27463483:27465299,27499708:27501854,27592183:27594588,27592214:27594097,27685658:27686645,27685685:27686197,27691548:27698271,27691563:27697790,27691699:27700873,27710099:27710995,27710102:27710396,27727085:27727326,27729545:27729642,27739475:27739532,27756449:27757482,27799345:27799603,27825271:27825627,27827191:27827730,27877954:27878334,27888879:27888901,27944829:27945155,28012680:28020301,28035723:28036028,28044330:28044509,28106429:28132386,28106434:28131443,28106526:28127778,28106543:28126311,28106546:28125358,28107832:28117412,28107853:28117030', 'assoc_mat': '27418745:pet_fonce:3594:27421097,27463483:pet_fonce:3594:27465299,27499708:pet_fonce:3594:27501854,27592183:pet_fonce:3594:27594588,27592214:pet_fonce:3594:27594097,27685658:pet_fonce:3594:27686645,27685685:pet_fonce:3594:27686197,27691548:pet_fonce:3594:27698271,27691563:pet_fonce:3594:27697790,27691699:pet_fonce:3594:27700873,27710099:pet_fonce:3594:27710995,27710102:pet_fonce:3594:27710396,27727085:pet_fonce:3594:27727326,27729545:pet_fonce:3594:27729642,27739475:pet_fonce:3594:27739532,27756449:pet_fonce:3594:27757482,27799345:pet_fonce:3594:27799603,27825271:pet_fonce:3594:27825627,27827191:pet_fonce:3594:27827730,27877954:pet_fonce:3594:27878334,27888879:pet_fonce:3594:27888901,27944829:pet_fonce:3594:27945155,28012680:pet_fonce:3594:28020301,28035723:pet_fonce:3594:28036028,28044330:pet_fonce:3594:28044509,28106429:pet_fonce:3594:28132386,28106434:pet_fonce:3594:28131443,28106526:pet_fonce:3594:28127778,28106543:pet_fonce:3594:28126311,28106546:pet_fonce:3594:28125358,28107832:pet_fonce:3594:28117412,2'}, {'unwanted_material': 'pet_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.005466676232154387, 'nb_photo': 1, 'list_port_cont': '28106883', 'assoc_port': '28106644:28106883', 'assoc_mat': '28106644:pet_opaque:4461:28106883'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0019003855730040326, 'nb_photo': 494, 'list_port_cont': '27420176,27420385,27420572,27421120,27421344,27421871,27422244,27422657,27422917,27423095,27424005,27428929,27464589,27464902,27465305,27466288,27466646,27467003,27467186,27467392,27467941,27468978,27470101,27499775,27500860,27501178,27502114,27502414,27502734,27503005,27503773,27503885,27504856,27505143,27506125,27506883,27510532,27510603,27510723,27516625,27582731,27596198,27596413,27596524,27602958,27603070,27603351,27603358,27603373,27603393,27606278,27608953,27609067,27609348,27609642,27609985,27611563,27612267,27616758,27617482,27629763,27630553,27641786,27670431,27671965,27686446,27687068,27687343,27688310,27689232,27689598,27691897,27695897,27698198,27698319,27708335,27708668,27710108,27710262,27710550,27711958,27712156,27712417,27712567,27712891,27715352,27715669,27718713,27719814,27720792,27723909,27728670,27729978,27730440,27730487,27734403,27736057,27736502,27737418,27740476,27749999,27750164,27750501,27762516,27767163,27767184,27767312,27774657,27775018,27775040,27778168,27778215,27789806,2779939', 'assoc_port': '27418727:27420176,27418728:27420385,27418729:27420572,27418732:27421120,27418734:27421344,27418740:27422244,27418744:27422657,27418747:27422917,27418749:27423095,27418759:27424005,27418792:27428929,27418795:27421871,27463447:27464589,27463476:27470101,27463482:27468978,27463487:27466288,27463491:27466646,27463493:27467003,27463496:27467186,27463498:27467392,27463506:27467941,27463508:27464902,27463510:27465305,27499685:27504856,27499686:27500860,27499687:27505143,27499688:27501178,27499695:27506125,27499697:27502114,27499698:27502414,27499701:27502734,27499710:27503005,27499718:27506883,27499753:27503773,27499756:27503885,27499760:27499775,27508926:27510603,27508927:27510723,27508929:27510532,27516594:27516625,27582561:27608953,27582563:27609067,27582571:27609348,27582579:27609642,27582582:27609985,27582588:27582731,27592177:27603373,27592178:27603393,27592181:27603358,27592211:27603351,27592218:27603070,27592224:27596198,27592227:27596413,27592228:27596524,27600763:27602958,27606141:27629763,27606146:2763055', 'assoc_mat': '27418727:pet_opaque:4207:27420176,27418728:pet_opaque:4207:27420385,27418729:pet_opaque:4207:27420572,27418732:pet_opaque:4207:27421120,27418734:pet_opaque:4207:27421344,27418740:pet_opaque:4207:27422244,27418744:pet_opaque:4207:27422657,27418747:pet_opaque:4207:27422917,27418749:pet_opaque:4207:27423095,27418759:pet_opaque:4207:27424005,27418792:pet_opaque:4207:27428929,27418795:pet_opaque:4207:27421871,27463447:pet_opaque:4207:27464589,27463476:pet_opaque:4207:27470101,27463482:pet_opaque:4207:27468978,27463487:pet_opaque:4207:27466288,27463491:pet_opaque:4207:27466646,27463493:pet_opaque:4207:27467003,27463496:pet_opaque:4207:27467186,27463498:pet_opaque:4207:27467392,27463506:pet_opaque:4207:27467941,27463508:pet_opaque:4207:27464902,27463510:pet_opaque:4207:27465305,27499685:pet_opaque:4207:27504856,27499686:pet_opaque:4207:27500860,27499687:pet_opaque:4207:27505143,27499688:pet_opaque:4207:27501178,27499695:pet_opaque:4207:27506125,27499697:pet_opaque:4207:27502114,27499698:pet_opaque:4207:27502414,2749'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 7.933477397620998e-05, 'nb_photo': 30, 'list_port_cont': '27420179,27423590,27467000,27506891,27510421,27630027,27686439,27687073,27689606,27712412,27715356,27715945,27730550,27830686,27847399,27849177,27876770,27878019,27880483,27909535,27949178,28021256,28044389,28279262,28284574', 'assoc_port': '27418727:27420179,27418753:27423590,27463493:27467000,27499718:27506891,27508925:27510421,27606143:27630027,27641591:27687073,27641635:27689606,27686322:27686439,27697990:27712412,27704747:27715356,27715882:27715945,27730217:27730550,27830129:27830686,27841473:27847399,27843158:27849177,27868448:27876770,27874705:27880483,27877950:27878019,27909530:27909535,27948335:27949178,27958871:28021256,28044320:28044389,28106470:28279262,28108436:28284574', 'assoc_mat': '27418727:textiles_sanitaires:4207:27420179,27418753:textiles_sanitaires:4207:27423590,27463493:textiles_sanitaires:4207:27467000,27499718:textiles_sanitaires:4207:27506891,27508925:textiles_sanitaires:4207:27510421,27606143:textiles_sanitaires:4207:27630027,27641591:textiles_sanitaires:4207:27687073,27641635:textiles_sanitaires:4207:27689606,27686322:textiles_sanitaires:4207:27686439,27697990:textiles_sanitaires:4207:27712412,27704747:textiles_sanitaires:4207:27715356,27715882:textiles_sanitaires:4207:27715945,27730217:textiles_sanitaires:4207:27730550,27830129:textiles_sanitaires:4207:27830686,27841473:textiles_sanitaires:4207:27847399,27843158:textiles_sanitaires:4207:27849177,27868448:textiles_sanitaires:4207:27876770,27874705:textiles_sanitaires:4207:27880483,27877950:textiles_sanitaires:4207:27878019,27909530:textiles_sanitaires:4207:27909535,27948335:textiles_sanitaires:4207:27949178,27958871:textiles_sanitaires:4207:28021256,28044320:textiles_sanitaires:4207:28044389,28106470:textiles_sanitaires:4207:2'}), 'main_stat': {'nb_photos': 35793}}, 'hostname': (('jetson-5',),), 'impurety_average_per_hashtag': [(('pcnc', '2025-10', 0.025868034404724412),), (('refus', '2025-10', 0.0974146879287623),), (('film_pedb', '2025-10', 0.06785934408607135),), (('pet_clair', '2025-10', 0.12238682628268438),)]} filepath : /data_4/data_log/job/memo/sevran/sla_mensuel_Sevran_mois_10_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'pet_clair': {'autre': ['autre', '1.29%', 5], 'bouchon': ['bouchon', '0.41%', 5], 'carton': ['carton', '11.88%', 17], 'papier': ['papier', '4.08%', 21], 'pet_clair': ['pet_clair', '89.73%', 520], 'pet_fonce': ['pet_fonce', '3.79%', 4]}, 'refus': {'autre': ['autre', '0.13%', 334], 'carton': ['carton', '0.45%', 602], 'metal': ['metal', '0.03%', 144], 'papier': ['papier', '0.81%', 3192], 'pehd': ['pehd', '0.07%', 40], 'pet_clair': ['pet_clair', '7.41%', 3080], 'pet_fonce': ['pet_fonce', '0.04%', 48]}, 'film_pedb': {'barquette_opaque': ['barquette_opaque', '1.67%', 6], 'carton': ['carton', '0.57%', 137], 'etiquette': ['etiquette', '0.03%', 2], 'film_plastique': ['film_plastique', '92.75%', 1495], 'metal': ['metal', '1.17%', 1], 'papier': ['papier', '7.15%', 5023], 'pet_clair': ['pet_clair', '0.03%', 1], 'pet_fonce': ['pet_fonce', '0.11%', 1], 'pet_opaque': ['pet_opaque', '0.55%', 1]}, 'pcnc': {'barquette_opaque': ['barquette_opaque', '0.11%', 2734], 'carton': ['carton', '98.24%', 5218], 'ela': ['ela', '0.0%', 30], 'etiquette': ['etiquette', '0.03%', 1147], 'film_plastique': ['film_plastique', '0.57%', 14864], 'kraft': ['kraft', '0.01%', 23], 'metal': ['metal', '0.52%', 803], 'papier': ['papier', '0.68%', 20149], 'pehd': ['pehd', '0.02%', 40], 'pet_clair': ['pet_clair', '0.2%', 1063], 'pet_fonce': ['pet_fonce', '0.03%', 82], 'pet_opaque': ['pet_opaque', '0.19%', 494], 'textiles_sanitaires': ['textiles_sanitaires', '0.01%', 30]}} before plot_matierial_repartition before organize_and_plot_coverage_data Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 TODO VR to ADNNANE : a mon avis il faut refactorer la préparation des données, je ne comprends pas non plus ce -0.0 et puis il y a un bug avec la taille differente (reproduit en commentant cette ligne ou : --raspi=20077 --use_sqlite --date=2022-09 -v --job=sla_mensuel) Erreur dans le script sla mensuel mise en forme 943: mean requires at least one data point shold exit but treated as warning to keep behavior le fichier se trouve ici : /data_4/data_log/job/memo/sevran 3.12user 3.35system 0:07.58elapsed 85%CPU (0avgtext+0avgdata 176624maxresident)k 1688inputs+1520outputs (55major+45166minor)pagefaults 0swaps