python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=30116 --dashboard_places=arc_en_ciel_mm --rootfolder_sla=/data_4/data_log/job/memo/arc_en_ciel_mm -v --mtr_id=979 --date=`date -d"$nowdate 270 day ago" +\%Y-\%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 30116, Date : 2025-02 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (5, 28) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4323 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4323 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4323 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4323 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4748 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4748 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4748 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4748 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13185 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13193 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13194 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13189 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13189 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13191 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13192 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13197 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13197 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13188 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13187 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13187 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13196 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13188 doesn't seem to be define in the database( WARNING : type of input 3 of step 13187 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13185 doesn't seem to be define in the database( WARNING : type of input 2 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13185 have datatype=16 whereas input 0 of step 13192 have datatype=1 WARNING : output 1 of step 13185 have datatype=2 whereas input 1 of step 13192 have datatype=7 WARNING : output 0 of step 13191 have datatype=6 whereas input 2 of step 13192 have datatype=5 WARNING : type of output 2 of step 13192 doesn't seem to be define in the database( WARNING : type of input 1 of step 13186 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13188 have datatype=10 whereas input 3 of step 13195 have datatype=6 WARNING : type of input 2 of step 13197 doesn't seem to be define in the database( WARNING : output 1 of step 13186 have datatype=7 whereas input 2 of step 13197 have datatype=None WARNING : type of output 3 of step 13197 doesn't seem to be define in the database( WARNING : type of input 1 of step 13188 doesn't seem to be define in the database( WARNING : output 0 of step 13188 have datatype=10 whereas input 0 of step 13198 have datatype=18 WARNING : type of input 5 of step 13195 doesn't seem to be define in the database( WARNING : output 0 of step 13198 have datatype=11 whereas input 5 of step 13195 have datatype=None WARNING : type of output 1 of step 13193 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : type of output 1 of step 13194 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13192 have datatype=1 whereas input 0 of step 13186 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,textiles_sanitaires,pet_clair', 'hashtag_parmi': 'pet_fonce,barquette_opaque,pet_opaque', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_mm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4323 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4323 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4323 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4323 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4748 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4748 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4748 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4748 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13185 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13193 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13194 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13189 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13189 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13191 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13192 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13197 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13197 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13188 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13187 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13187 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13196 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13188 doesn't seem to be define in the database( WARNING : type of input 3 of step 13187 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13185 doesn't seem to be define in the database( WARNING : type of input 2 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13185 have datatype=16 whereas input 0 of step 13192 have datatype=1 WARNING : output 1 of step 13185 have datatype=2 whereas input 1 of step 13192 have datatype=7 WARNING : output 0 of step 13191 have datatype=6 whereas input 2 of step 13192 have datatype=5 WARNING : type of output 2 of step 13192 doesn't seem to be define in the database( WARNING : type of input 1 of step 13186 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13188 have datatype=10 whereas input 3 of step 13195 have datatype=6 WARNING : type of input 2 of step 13197 doesn't seem to be define in the database( WARNING : output 1 of step 13186 have datatype=7 whereas input 2 of step 13197 have datatype=None WARNING : type of output 3 of step 13197 doesn't seem to be define in the database( WARNING : type of input 1 of step 13188 doesn't seem to be define in the database( WARNING : output 0 of step 13188 have datatype=10 whereas input 0 of step 13198 have datatype=18 WARNING : type of input 5 of step 13195 doesn't seem to be define in the database( WARNING : output 0 of step 13198 have datatype=11 whereas input 5 of step 13195 have datatype=None WARNING : type of output 1 of step 13193 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : type of output 1 of step 13194 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13192 have datatype=1 whereas input 0 of step 13186 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,textiles_sanitaires,pet_clair', 'hashtag_parmi': 'pet_fonce,barquette_opaque,pet_opaque', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (5, 28) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4323 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4323 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4323 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4323 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4748 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4748 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4748 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4748 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13185 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13193 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13194 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13189 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13189 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13191 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13192 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13197 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13197 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13188 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13187 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13187 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13196 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13188 doesn't seem to be define in the database( WARNING : type of input 3 of step 13187 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13185 doesn't seem to be define in the database( WARNING : type of input 2 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13185 have datatype=16 whereas input 0 of step 13192 have datatype=1 WARNING : output 1 of step 13185 have datatype=2 whereas input 1 of step 13192 have datatype=7 WARNING : output 0 of step 13191 have datatype=6 whereas input 2 of step 13192 have datatype=5 WARNING : type of output 2 of step 13192 doesn't seem to be define in the database( WARNING : type of input 1 of step 13186 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13188 have datatype=10 whereas input 3 of step 13195 have datatype=6 WARNING : type of input 2 of step 13197 doesn't seem to be define in the database( WARNING : output 1 of step 13186 have datatype=7 whereas input 2 of step 13197 have datatype=None WARNING : type of output 3 of step 13197 doesn't seem to be define in the database( WARNING : type of input 1 of step 13188 doesn't seem to be define in the database( WARNING : output 0 of step 13188 have datatype=10 whereas input 0 of step 13198 have datatype=18 WARNING : type of input 5 of step 13195 doesn't seem to be define in the database( WARNING : output 0 of step 13198 have datatype=11 whereas input 5 of step 13195 have datatype=None WARNING : type of output 1 of step 13193 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : type of output 1 of step 13194 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13192 have datatype=1 whereas input 0 of step 13186 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,textiles_sanitaires,pet_clair', 'hashtag_parmi': 'pet_fonce,barquette_opaque,pet_opaque', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_mm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4323 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4323 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4323 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4323 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4748 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4748 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4748 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4748 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13185 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13193 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13194 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13189 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13189 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13191 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13192 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13197 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13197 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13188 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13187 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13187 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13196 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13188 doesn't seem to be define in the database( WARNING : type of input 3 of step 13187 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13185 doesn't seem to be define in the database( WARNING : type of input 2 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13185 have datatype=16 whereas input 0 of step 13192 have datatype=1 WARNING : output 1 of step 13185 have datatype=2 whereas input 1 of step 13192 have datatype=7 WARNING : output 0 of step 13191 have datatype=6 whereas input 2 of step 13192 have datatype=5 WARNING : type of output 2 of step 13192 doesn't seem to be define in the database( WARNING : type of input 1 of step 13186 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13188 have datatype=10 whereas input 3 of step 13195 have datatype=6 WARNING : type of input 2 of step 13197 doesn't seem to be define in the database( WARNING : output 1 of step 13186 have datatype=7 whereas input 2 of step 13197 have datatype=None WARNING : type of output 3 of step 13197 doesn't seem to be define in the database( WARNING : type of input 1 of step 13188 doesn't seem to be define in the database( WARNING : output 0 of step 13188 have datatype=10 whereas input 0 of step 13198 have datatype=18 WARNING : type of input 5 of step 13195 doesn't seem to be define in the database( WARNING : output 0 of step 13198 have datatype=11 whereas input 5 of step 13195 have datatype=None WARNING : type of output 1 of step 13193 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : type of output 1 of step 13194 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13192 have datatype=1 whereas input 0 of step 13186 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,textiles_sanitaires,pet_clair', 'hashtag_parmi': 'pet_fonce,barquette_opaque,pet_opaque', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 157 month : 02 mtr_id : 979 dashboard_places : arc_en_ciel_mm date : 2025-02 year : 2025 raspi : 30116 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'arc_en_ciel_mm' and date like '%2025-02%') and created_at like '%2025-02%'))); nb_day : (5, 28) after unwanted_material_data nb_day : (5, 28) WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used WARNING: No hour configured for port 30116, from 00:00 to 24:00 used SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%30116%' AND ms.result_str like '%2025/02%'ORDER BY ms.id desc LIMIT 0, 1000000; Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-02-01 00:00:00,2025-02-02 00:00:00,2025-02-03 00:00:00,2025-02-04 00:00:00,2025-02-05 00:00:00,2025-02-06 00:00:00,2025-02-07 00:00:00,2025-02-08 00:00:00,2025-02-09 00:00:00,2025-02-10 00:00:00,2025-02-11 00:00:00,2025-02-12 00:00:00,2025-02-13 00:00:00,2025-02-14 00:00:00,2025-02-15 00:00:00,2025-02-16 00:00:00,2025-02-17 00:00:00,2025-02-18 00:00:00,2025-02-19 00:00:00,2025-02-20 00:00:00,2025-02-21 00:00:00,2025-02-22 00:00:00,2025-02-23 00:00:00,2025-02-24 00:00:00,2025-02-25 00:00:00,2025-02-26 00:00:00,2025-02-27 00:00:00,2025-02-28 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where ded.dashboard_place_id = 157 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______film_pedb' and ded.dashboard_place_id = 157 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______emr' and ded.dashboard_place_id = 157 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______gros_cartons' and ded.dashboard_place_id = 157 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______pet_clair' and ded.dashboard_place_id = 157 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______flux_dev_rigide' and ded.dashboard_place_id = 157 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______pehd_pp' and ded.dashboard_place_id = 157 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______ela' and ded.dashboard_place_id = 157 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______gm' and ded.dashboard_place_id = 157 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______aluminium' and ded.dashboard_place_id = 157 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 157 and mp.name like '%022025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-02-01 : dt_date_just_month_year : 2025-02-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! Error parsing crontab ! [Errno 2] No such file or directory: '' You better check your LOGRASPI env !!! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "arc_en_ciel_mm" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-02-01" AND ded.date <= "2025-02-28" apple3 {'gm': {'mat': 'gm', 'pht': 4209, 'datou_carac_id': 3994, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'emr': {'mat': 'emr', 'pht': 4207, 'datou_carac_id': 3993, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'carton,background'}, 'ela': {'mat': 'ela', 'pht': 4203, 'datou_carac_id': 3991, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'ela,background'}, 'pet_clair': {'mat': 'pet_clair', 'pht': 3327, 'datou_carac_id': 3804, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_clair,bouchon,etiquette,barquette_avec_film,background'}, 'film_pedb': {'mat': 'film_pedb', 'pht': 4461, 'datou_carac_id': 4322, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'film_plastique'}, 'pehd_pp': {'mat': 'pehd_pp', 'pht': 4211, 'datou_carac_id': 3995, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pehd,background'}, 'flux_dev_rigide': {'mat': 'flux_dev_rigide', 'pht': 4200, 'datou_carac_id': 4748, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_fonce,barquette_opaque,pet_opaque'}, 'aluminium': {'mat': 'aluminium', 'pht': 4205, 'datou_carac_id': 3992, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'metal,background'}, 'refus': {'mat': 'refus', 'pht': 3594, 'datou_carac_id': 3318, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'refus,background'}, 'pcnc': {'mat': 'pcnc', 'pht': 4207, 'datou_carac_id': 3993, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'carton,background'}, 'gros_cartons': {'mat': 'gros_cartons', 'pht': 4207, 'datou_carac_id': 3993, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'carton,background'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (1581044,1581124,1645457) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id AND ptp.type IN (4209,4207,4203,3327,4461,4211,4200,4205,3594,4207,4207) group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0278809465918396, 'nb_photo': 188, 'list_port_cont': '21029703,21031225,21032376,21033092,21034547,21035720,21035861,21035897,21036057,21036285,21036526,21036754,21037307,21038139,21038424,21038535,21085305', 'assoc_port': '21010306:21029703,21010312:21031225,21010317:21032376,21010321:21033092,21010328:21034547,21010342:21035720,21010350:21036057,21010360:21036754,21010366:21037307,21010378:21038535,21010388:21085305,21010396:21038424,21010431:21038139,21010441:21036526,21010452:21036285,21010498:21035861,21010550:21035897', 'assoc_mat': '21010306:autre:3327:21029703,21010312:autre:3327:21031225,21010317:autre:3327:21032376,21010321:autre:3327:21033092,21010328:autre:3327:21034547,21010342:autre:3327:21035720,21010350:autre:3327:21036057,21010360:autre:3327:21036754,21010366:autre:3327:21037307,21010378:autre:3327:21038535,21010388:autre:3327:21085305,21010396:autre:3327:21038424,21010431:autre:3327:21038139,21010441:autre:3327:21036526,21010452:autre:3327:21036285,21010498:autre:3327:21035861,21010550:autre:3327:21035897'}, {'unwanted_material': 'barquette_avec_film', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.00809577184012819, 'nb_photo': 13, 'list_port_cont': '21029701,21035865,21035896,21036293,21036520,21037313,21038144,21038415', 'assoc_port': '21010306:21029701,21010366:21037313,21010396:21038415,21010431:21038144,21010441:21036520,21010452:21036293,21010498:21035865,21010550:21035896', 'assoc_mat': '21010306:barquette_avec_film:3327:21029701,21010366:barquette_avec_film:3327:21037313,21010396:barquette_avec_film:3327:21038415,21010431:barquette_avec_film:3327:21038144,21010441:barquette_avec_film:3327:21036520,21010452:barquette_avec_film:3327:21036293,21010498:barquette_avec_film:3327:21035865,21010550:barquette_avec_film:3327:21035896'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.01145727820199558, 'nb_photo': 50, 'list_port_cont': '21031478,21037920,21042883,21044098', 'assoc_port': '21010314:21031478,21010374:21037920,21010450:21042883,21010564:21044098', 'assoc_mat': '21010314:barquette_opaque:4203:21031478,21010374:barquette_opaque:4203:21037920,21010450:barquette_opaque:4203:21042883,21010564:barquette_opaque:4203:21044098'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0031123100610556723, 'nb_photo': 28, 'list_port_cont': '21029075,21031284,21033774,21034754,21035756,21037466,21038549,21039413,21040683,21041483,21041828,21042240,21042442,21043356,21044153,21083811', 'assoc_port': '21010292:21029075,21010313:21031284,21010325:21033774,21010327:21083811,21010334:21034754,21010344:21035756,21010370:21037466,21010380:21038549,21010386:21039413,21010394:21040683,21010423:21041483,21010427:21041828,21010439:21042240,21010443:21042442,21010467:21043356,21010566:21044153', 'assoc_mat': '21010292:barquette_opaque:4207:21029075,21010313:barquette_opaque:4207:21031284,21010325:barquette_opaque:4207:21033774,21010327:barquette_opaque:4207:21083811,21010334:barquette_opaque:4207:21034754,21010344:barquette_opaque:4207:21035756,21010370:barquette_opaque:4207:21037466,21010380:barquette_opaque:4207:21038549,21010386:barquette_opaque:4207:21039413,21010394:barquette_opaque:4207:21040683,21010423:barquette_opaque:4207:21041483,21010427:barquette_opaque:4207:21041828,21010439:barquette_opaque:4207:21042240,21010443:barquette_opaque:4207:21042442,21010467:barquette_opaque:4207:21043356,21010566:barquette_opaque:4207:21044153'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.00937317366048873, 'nb_photo': 4, 'list_port_cont': '21032987,21036266,21037445,21043728', 'assoc_port': '21010320:21032987,21010354:21036266,21010368:21037445,21010557:21043728', 'assoc_mat': '21010320:barquette_opaque:4461:21032987,21010354:barquette_opaque:4461:21036266,21010368:barquette_opaque:4461:21037445,21010557:barquette_opaque:4461:21043728'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.01710100001005086, 'nb_photo': 78, 'list_port_cont': '21030062,21033211,21034680,21035953,21036893,21037782,21040151,21041792,21042357,21042800,21043685,21043937,21083764', 'assoc_port': '21010308:21030062,21010315:21083764,21010322:21033211,21010332:21034680,21010348:21035953,21010362:21036893,21010372:21037782,21010390:21040151,21010424:21041792,21010437:21042357,21010447:21042800,21010472:21043685,21010560:21043937', 'assoc_mat': '21010308:barquette_opaque:4200:21030062,21010315:barquette_opaque:4200:21083764,21010322:barquette_opaque:4200:21033211,21010332:barquette_opaque:4200:21034680,21010348:barquette_opaque:4200:21035953,21010362:barquette_opaque:4200:21036893,21010372:barquette_opaque:4200:21037782,21010390:barquette_opaque:4200:21040151,21010424:barquette_opaque:4200:21041792,21010437:barquette_opaque:4200:21042357,21010447:barquette_opaque:4200:21042800,21010472:barquette_opaque:4200:21043685,21010560:barquette_opaque:4200:21043937'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0037650287188941618, 'nb_photo': 1, 'list_port_cont': '21038851', 'assoc_port': '21010382:21038851', 'assoc_mat': '21010382:barquette_opaque:4209:21038851'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.0026449854782722554, 'nb_photo': 2, 'list_port_cont': '21031995,21036490', 'assoc_port': '21010316:21031995,21010358:21036490', 'assoc_mat': '21010316:barquette_opaque:4207:21031995,21010358:barquette_opaque:4207:21036490'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.036866855499123524, 'nb_photo': 419, 'list_port_cont': '21030315,21032594,21033378,21034558,21035870,21037045,21038126,21040332,21041111,21043243,21043272', 'assoc_port': '21010309:21030315,21010319:21032594,21010323:21033378,21010330:21034558,21010346:21035870,21010364:21037045,21010376:21038126,21010392:21040332,21010421:21041111,21010464:21043272,21010552:21043243', 'assoc_mat': '21010309:barquette_opaque:4211:21030315,21010319:barquette_opaque:4211:21032594,21010323:barquette_opaque:4211:21033378,21010330:barquette_opaque:4211:21034558,21010346:barquette_opaque:4211:21035870,21010364:barquette_opaque:4211:21037045,21010376:barquette_opaque:4211:21038126,21010392:barquette_opaque:4211:21040332,21010421:barquette_opaque:4211:21041111,21010464:barquette_opaque:4211:21043272,21010552:barquette_opaque:4211:21043243'}, {'unwanted_material': 'bouchon', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.011239212416872615, 'nb_photo': 97, 'list_port_cont': '21029709,21031219,21032384,21033090,21034546,21035715,21035853,21035892,21036058,21036286,21036530,21036755,21037314,21038131,21038417,21038534,21085314', 'assoc_port': '21010306:21029709,21010312:21031219,21010317:21032384,21010321:21033090,21010328:21034546,21010342:21035715,21010350:21036058,21010360:21036755,21010366:21037314,21010378:21038534,21010388:21085314,21010396:21038417,21010431:21038131,21010441:21036530,21010452:21036286,21010498:21035853,21010550:21035892', 'assoc_mat': '21010306:bouchon:3327:21029709,21010312:bouchon:3327:21031219,21010317:bouchon:3327:21032384,21010321:bouchon:3327:21033090,21010328:bouchon:3327:21034546,21010342:bouchon:3327:21035715,21010350:bouchon:3327:21036058,21010360:bouchon:3327:21036755,21010366:bouchon:3327:21037314,21010378:bouchon:3327:21038534,21010388:bouchon:3327:21085314,21010396:bouchon:3327:21038417,21010431:bouchon:3327:21038131,21010441:bouchon:3327:21036530,21010452:bouchon:3327:21036286,21010498:bouchon:3327:21035853,21010550:bouchon:3327:21035892'}, {'unwanted_material': 'carton', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.011171706024206645, 'nb_photo': 2, 'list_port_cont': '21040395', 'assoc_port': '21010393:21040395', 'assoc_mat': '21010393:carton:4205:21040395'}, {'unwanted_material': 'carton', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.003154728706187209, 'nb_photo': 15, 'list_port_cont': '21037917,21042872,21044086', 'assoc_port': '21010374:21037917,21010450:21042872,21010564:21044086', 'assoc_mat': '21010374:carton:4203:21037917,21010450:carton:4203:21042872,21010564:carton:4203:21044086'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.9319457801255371, 'nb_photo': 41, 'list_port_cont': '20174430,21029074,21029751,21034739,21036073,21036311,21038555,21039415,21040680,21041478,21041824,21042227,21042441,21043358,21044162,21083813', 'assoc_port': '20173926:20174430,21010292:21029074,21010307:21029751,21010327:21083813,21010334:21034739,21010352:21036073,21010356:21036311,21010380:21038555,21010386:21039415,21010394:21040680,21010423:21041478,21010427:21041824,21010439:21042227,21010443:21042441,21010467:21043358,21010566:21044162', 'assoc_mat': '20173926:carton:4207:20174430,21010292:carton:4207:21029074,21010307:carton:4207:21029751,21010327:carton:4207:21083813,21010334:carton:4207:21034739,21010352:carton:4207:21036073,21010356:carton:4207:21036311,21010380:carton:4207:21038555,21010386:carton:4207:21039415,21010394:carton:4207:21040680,21010423:carton:4207:21041478,21010427:carton:4207:21041824,21010439:carton:4207:21042227,21010443:carton:4207:21042441,21010467:carton:4207:21043358,21010566:carton:4207:21044162'}, {'unwanted_material': 'carton', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.014851902166160162, 'nb_photo': 211, 'list_port_cont': '20312922,21030895,21032993,21034097,21035541,21036265,21037436,21039255,21041923,21043082,21043567,21043733,21086585', 'assoc_port': '20173925:20312922,21010311:21030895,21010320:21032993,21010326:21034097,21010340:21035541,21010354:21036265,21010368:21037436,21010384:21039255,21010422:21086585,21010433:21041923,21010459:21043082,21010469:21043567,21010557:21043733', 'assoc_mat': '20173925:carton:4461:20312922,21010311:carton:4461:21030895,21010320:carton:4461:21032993,21010326:carton:4461:21034097,21010340:carton:4461:21035541,21010354:carton:4461:21036265,21010368:carton:4461:21037436,21010384:carton:4461:21039255,21010422:carton:4461:21086585,21010433:carton:4461:21041923,21010459:carton:4461:21043082,21010469:carton:4461:21043567,21010557:carton:4461:21043733'}, {'unwanted_material': 'carton', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.003872641606665564, 'nb_photo': 29, 'list_port_cont': '21030057,21033206,21036889,21040157,21041795,21042367,21042795,21043691,21043940', 'assoc_port': '21010308:21030057,21010322:21033206,21010362:21036889,21010390:21040157,21010424:21041795,21010437:21042367,21010447:21042795,21010472:21043691,21010560:21043940', 'assoc_mat': '21010308:carton:4200:21030057,21010322:carton:4200:21033206,21010362:carton:4200:21036889,21010390:carton:4200:21040157,21010424:carton:4200:21041795,21010437:carton:4200:21042367,21010447:carton:4200:21042795,21010472:carton:4200:21043691,21010560:carton:4200:21043940'}, {'unwanted_material': 'carton', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.9342654013489219, 'nb_photo': 5, 'list_port_cont': '21029189,21031994,21035004,21040921', 'assoc_port': '21010305:21029189,21010316:21031994,21010336:21035004,21010395:21040921', 'assoc_mat': '21010305:carton:4207:21029189,21010316:carton:4207:21031994,21010336:carton:4207:21035004,21010395:carton:4207:21040921'}, {'unwanted_material': 'carton', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0014341005717665993, 'nb_photo': 50, 'list_port_cont': '21030305,21032587,21033370,21034572,21035874,21037050,21038114,21040316,21041106,21043234,21043278', 'assoc_port': '21010309:21030305,21010319:21032587,21010323:21033370,21010330:21034572,21010346:21035874,21010364:21037050,21010376:21038114,21010392:21040316,21010421:21041106,21010464:21043278,21010552:21043234', 'assoc_mat': '21010309:carton:4211:21030305,21010319:carton:4211:21032587,21010323:carton:4211:21033370,21010330:carton:4211:21034572,21010346:carton:4211:21035874,21010364:carton:4211:21037050,21010376:carton:4211:21038114,21010392:carton:4211:21040316,21010421:carton:4211:21041106,21010464:carton:4211:21043278,21010552:carton:4211:21043234'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.05357755946933835, 'nb_photo': 197, 'list_port_cont': '21029699,21031222,21032381,21033089,21034544,21035711,21035859,21035889,21036056,21036294,21036522,21036760,21037302,21038132,21038418,21038538,21085316', 'assoc_port': '21010306:21029699,21010312:21031222,21010317:21032381,21010321:21033089,21010328:21034544,21010342:21035711,21010350:21036056,21010360:21036760,21010366:21037302,21010378:21038538,21010388:21085316,21010396:21038418,21010431:21038132,21010441:21036522,21010452:21036294,21010498:21035859,21010550:21035889', 'assoc_mat': '21010306:carton:3327:21029699,21010312:carton:3327:21031222,21010317:carton:3327:21032381,21010321:carton:3327:21033089,21010328:carton:3327:21034544,21010342:carton:3327:21035711,21010350:carton:3327:21036056,21010360:carton:3327:21036760,21010366:carton:3327:21037302,21010378:carton:3327:21038538,21010388:carton:3327:21085316,21010396:carton:3327:21038418,21010431:carton:3327:21038132,21010441:carton:3327:21036522,21010452:carton:3327:21036294,21010498:carton:3327:21035859,21010550:carton:3327:21035889'}, {'unwanted_material': 'ela', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.9151163407071976, 'nb_photo': 6, 'list_port_cont': '21031477,21037930,21042876,21044087', 'assoc_port': '21010314:21031477,21010374:21037930,21010450:21042876,21010564:21044087', 'assoc_mat': '21010314:ela:4203:21031477,21010374:ela:4203:21037930,21010450:ela:4203:21042876,21010564:ela:4203:21044087'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0018694521535402007, 'nb_photo': 4, 'list_port_cont': '21029750,21040682,21042431,21044156', 'assoc_port': '21010307:21029750,21010394:21040682,21010443:21042431,21010566:21044156', 'assoc_mat': '21010307:ela:4207:21029750,21010394:ela:4207:21040682,21010443:ela:4207:21042431,21010566:ela:4207:21044156'}, {'unwanted_material': 'ela', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.0016206325430104898, 'nb_photo': 1, 'list_port_cont': '21030072', 'assoc_port': '21010308:21030072', 'assoc_mat': '21010308:ela:4200:21030072'}, {'unwanted_material': 'ela', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.006309472191351706, 'nb_photo': 1, 'list_port_cont': '21038844', 'assoc_port': '21010382:21038844', 'assoc_mat': '21010382:ela:4209:21038844'}, {'unwanted_material': 'ela', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.00026899451835211605, 'nb_photo': 1, 'list_port_cont': '21037051', 'assoc_port': '21010364:21037051', 'assoc_mat': '21010364:ela:4211:21037051'}, {'unwanted_material': 'etiquette', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.009106779602764544, 'nb_photo': 80, 'list_port_cont': '21031482,21037925,21042874,21044085', 'assoc_port': '21010314:21031482,21010374:21037925,21010450:21042874,21010564:21044085', 'assoc_mat': '21010314:etiquette:4203:21031482,21010374:etiquette:4203:21037925,21010450:etiquette:4203:21042874,21010564:etiquette:4203:21044085'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.003015442989571786, 'nb_photo': 34, 'list_port_cont': '21029070,21029748,21031269,21032394,21033786,21034750,21036068,21037467,21038550,21039414,21040673,21041491,21041826,21042239,21042437,21043357,21044167,21083810', 'assoc_port': '21010292:21029070,21010307:21029748,21010313:21031269,21010318:21032394,21010325:21033786,21010327:21083810,21010334:21034750,21010352:21036068,21010370:21037467,21010380:21038550,21010386:21039414,21010394:21040673,21010423:21041491,21010427:21041826,21010439:21042239,21010443:21042437,21010467:21043357,21010566:21044167', 'assoc_mat': '21010292:etiquette:4207:21029070,21010307:etiquette:4207:21029748,21010313:etiquette:4207:21031269,21010318:etiquette:4207:21032394,21010325:etiquette:4207:21033786,21010327:etiquette:4207:21083810,21010334:etiquette:4207:21034750,21010352:etiquette:4207:21036068,21010370:etiquette:4207:21037467,21010380:etiquette:4207:21038550,21010386:etiquette:4207:21039414,21010394:etiquette:4207:21040673,21010423:etiquette:4207:21041491,21010427:etiquette:4207:21041826,21010439:etiquette:4207:21042239,21010443:etiquette:4207:21042437,21010467:etiquette:4207:21043357,21010566:etiquette:4207:21044167'}, {'unwanted_material': 'etiquette', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0006093541501455973, 'nb_photo': 9, 'list_port_cont': '20312934,21030899,21034105,21035539,21037441,21043568', 'assoc_port': '20173925:20312934,21010311:21030899,21010326:21034105,21010340:21035539,21010368:21037441,21010469:21043568', 'assoc_mat': '20173925:etiquette:4461:20312934,21010311:etiquette:4461:21030899,21010326:etiquette:4461:21034105,21010340:etiquette:4461:21035539,21010368:etiquette:4461:21037441,21010469:etiquette:4461:21043568'}, {'unwanted_material': 'etiquette', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.013267832335298473, 'nb_photo': 119, 'list_port_cont': '21030059,21033212,21034686,21035959,21036890,21037793,21040159,21041787,21042356,21042792,21043694,21043925,21083756', 'assoc_port': '21010308:21030059,21010315:21083756,21010322:21033212,21010332:21034686,21010348:21035959,21010362:21036890,21010372:21037793,21010390:21040159,21010424:21041787,21010437:21042356,21010447:21042792,21010472:21043694,21010560:21043925', 'assoc_mat': '21010308:etiquette:4200:21030059,21010315:etiquette:4200:21083756,21010322:etiquette:4200:21033212,21010332:etiquette:4200:21034686,21010348:etiquette:4200:21035959,21010362:etiquette:4200:21036890,21010372:etiquette:4200:21037793,21010390:etiquette:4200:21040159,21010424:etiquette:4200:21041787,21010437:etiquette:4200:21042356,21010447:etiquette:4200:21042792,21010472:etiquette:4200:21043694,21010560:etiquette:4200:21043925'}, {'unwanted_material': 'etiquette', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.03676237489295385, 'nb_photo': 12, 'list_port_cont': '21038840', 'assoc_port': '21010382:21038840', 'assoc_mat': '21010382:etiquette:4209:21038840'}, {'unwanted_material': 'etiquette', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.004481208781733734, 'nb_photo': 8, 'list_port_cont': '21032008,21033561,21036492,21037968,21040915', 'assoc_port': '21010316:21032008,21010324:21033561,21010358:21036492,21010375:21037968,21010395:21040915', 'assoc_mat': '21010316:etiquette:4207:21032008,21010324:etiquette:4207:21033561,21010358:etiquette:4207:21036492,21010375:etiquette:4207:21037968,21010395:etiquette:4207:21040915'}, {'unwanted_material': 'etiquette', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.002341784187271578, 'nb_photo': 356, 'list_port_cont': '21030303,21032589,21033383,21034573,21035867,21037059,21038113,21040329,21041112,21043245,21043279', 'assoc_port': '21010309:21030303,21010319:21032589,21010323:21033383,21010330:21034573,21010346:21035867,21010364:21037059,21010376:21038113,21010392:21040329,21010421:21041112,21010464:21043279,21010552:21043245', 'assoc_mat': '21010309:etiquette:4211:21030303,21010319:etiquette:4211:21032589,21010323:etiquette:4211:21033383,21010330:etiquette:4211:21034573,21010346:etiquette:4211:21035867,21010364:etiquette:4211:21037059,21010376:etiquette:4211:21038113,21010392:etiquette:4211:21040329,21010421:etiquette:4211:21041112,21010464:etiquette:4211:21043279,21010552:etiquette:4211:21043245'}, {'unwanted_material': 'etiquette', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.002803324750750805, 'nb_photo': 8, 'list_port_cont': '21035854,21035890,21036295,21085313', 'assoc_port': '21010388:21085313,21010452:21036295,21010498:21035854,21010550:21035890', 'assoc_mat': '21010388:etiquette:3327:21085313,21010452:etiquette:3327:21036295,21010498:etiquette:3327:21035854,21010550:etiquette:3327:21035890'}, {'unwanted_material': 'film_plastique', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.011839179781624729, 'nb_photo': 2, 'list_port_cont': '21040397', 'assoc_port': '21010393:21040397', 'assoc_mat': '21010393:film_plastique:4205:21040397'}, {'unwanted_material': 'film_plastique', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.018436454170910443, 'nb_photo': 47, 'list_port_cont': '21031479,21037924,21042879,21044091', 'assoc_port': '21010314:21031479,21010374:21037924,21010450:21042879,21010564:21044091', 'assoc_mat': '21010314:film_plastique:4203:21031479,21010374:film_plastique:4203:21037924,21010450:film_plastique:4203:21042879,21010564:film_plastique:4203:21044091'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0014777524188785492, 'nb_photo': 19, 'list_port_cont': '20174433,21029073,21029763,21030524,21036074,21038556,21039402,21042228,21043364,21044154', 'assoc_port': '20173926:20174433,21010292:21029073,21010307:21029763,21010310:21030524,21010352:21036074,21010380:21038556,21010386:21039402,21010439:21042228,21010467:21043364,21010566:21044154', 'assoc_mat': '20173926:film_plastique:4207:20174433,21010292:film_plastique:4207:21029073,21010307:film_plastique:4207:21029763,21010310:film_plastique:4207:21030524,21010352:film_plastique:4207:21036074,21010380:film_plastique:4207:21038556,21010386:film_plastique:4207:21039402,21010439:film_plastique:4207:21042228,21010467:film_plastique:4207:21043364,21010566:film_plastique:4207:21044154'}, {'unwanted_material': 'film_plastique', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.8143348545258149, 'nb_photo': 277, 'list_port_cont': '20312924,21030909,21032990,21034106,21035538,21036257,21037433,21039265,21041925,21043070,21043570,21043722,21086586', 'assoc_port': '20173925:20312924,21010311:21030909,21010320:21032990,21010326:21034106,21010340:21035538,21010354:21036257,21010368:21037433,21010384:21039265,21010422:21086586,21010433:21041925,21010459:21043070,21010469:21043570,21010557:21043722', 'assoc_mat': '20173925:film_plastique:4461:20312924,21010311:film_plastique:4461:21030909,21010320:film_plastique:4461:21032990,21010326:film_plastique:4461:21034106,21010340:film_plastique:4461:21035538,21010354:film_plastique:4461:21036257,21010368:film_plastique:4461:21037433,21010384:film_plastique:4461:21039265,21010422:film_plastique:4461:21086586,21010433:film_plastique:4461:21041925,21010459:film_plastique:4461:21043070,21010469:film_plastique:4461:21043570,21010557:film_plastique:4461:21043722'}, {'unwanted_material': 'film_plastique', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.03727661718965066, 'nb_photo': 123, 'list_port_cont': '21030068,21033214,21034694,21035944,21036888,21037794,21040154,21041789,21042351,21042796,21043699,21043930,21083752', 'assoc_port': '21010308:21030068,21010315:21083752,21010322:21033214,21010332:21034694,21010348:21035944,21010362:21036888,21010372:21037794,21010390:21040154,21010424:21041789,21010437:21042351,21010447:21042796,21010472:21043699,21010560:21043930', 'assoc_mat': '21010308:film_plastique:4200:21030068,21010315:film_plastique:4200:21083752,21010322:film_plastique:4200:21033214,21010332:film_plastique:4200:21034694,21010348:film_plastique:4200:21035944,21010362:film_plastique:4200:21036888,21010372:film_plastique:4200:21037794,21010390:film_plastique:4200:21040154,21010424:film_plastique:4200:21041789,21010437:film_plastique:4200:21042351,21010447:film_plastique:4200:21042796,21010472:film_plastique:4200:21043699,21010560:film_plastique:4200:21043930'}, {'unwanted_material': 'film_plastique', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.005534743822594581, 'nb_photo': 1, 'list_port_cont': '21038845', 'assoc_port': '21010382:21038845', 'assoc_mat': '21010382:film_plastique:4209:21038845'}, {'unwanted_material': 'film_plastique', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.0027690375877441383, 'nb_photo': 6, 'list_port_cont': '21029191,21031996,21034993,21036488,21040917', 'assoc_port': '21010305:21029191,21010316:21031996,21010336:21034993,21010358:21036488,21010395:21040917', 'assoc_mat': '21010305:film_plastique:4207:21029191,21010316:film_plastique:4207:21031996,21010336:film_plastique:4207:21034993,21010358:film_plastique:4207:21036488,21010395:film_plastique:4207:21040917'}, {'unwanted_material': 'film_plastique', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0007897699378908007, 'nb_photo': 36, 'list_port_cont': '21030301,21032593,21033372,21034566,21035877,21037058,21038115,21040326,21041102,21043237,21043270', 'assoc_port': '21010309:21030301,21010319:21032593,21010323:21033372,21010330:21034566,21010346:21035877,21010364:21037058,21010376:21038115,21010392:21040326,21010421:21041102,21010464:21043270,21010552:21043237', 'assoc_mat': '21010309:film_plastique:4211:21030301,21010319:film_plastique:4211:21032593,21010323:film_plastique:4211:21033372,21010330:film_plastique:4211:21034566,21010346:film_plastique:4211:21035877,21010364:film_plastique:4211:21037058,21010376:film_plastique:4211:21038115,21010392:film_plastique:4211:21040326,21010421:film_plastique:4211:21041102,21010464:film_plastique:4211:21043270,21010552:film_plastique:4211:21043237'}, {'unwanted_material': 'kraft', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0012813714844512707, 'nb_photo': 1, 'list_port_cont': '21042878', 'assoc_port': '21010450:21042878', 'assoc_mat': '21010450:kraft:4203:21042878'}, {'unwanted_material': 'kraft', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.005767812448563143, 'nb_photo': 4, 'list_port_cont': '21033777,21042443,21083815', 'assoc_port': '21010325:21033777,21010327:21083815,21010443:21042443', 'assoc_mat': '21010325:kraft:4207:21033777,21010327:kraft:4207:21083815,21010443:kraft:4207:21042443'}, {'unwanted_material': 'kraft', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.0005493522841139184, 'nb_photo': 1, 'list_port_cont': '21043690', 'assoc_port': '21010472:21043690', 'assoc_mat': '21010472:kraft:4200:21043690'}, {'unwanted_material': 'metal', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.006465450880125157, 'nb_photo': 15, 'list_port_cont': '21031492,21037931,21042887,21044092', 'assoc_port': '21010314:21031492,21010374:21037931,21010450:21042887,21010564:21044092', 'assoc_mat': '21010314:metal:4203:21031492,21010374:metal:4203:21037931,21010450:metal:4203:21042887,21010564:metal:4203:21044092'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0045995841829128215, 'nb_photo': 4, 'list_port_cont': '21032393,21040670,21041484,21044157', 'assoc_port': '21010318:21032393,21010394:21040670,21010423:21041484,21010566:21044157', 'assoc_mat': '21010318:metal:4207:21032393,21010394:metal:4207:21040670,21010423:metal:4207:21041484,21010566:metal:4207:21044157'}, {'unwanted_material': 'metal', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.02610430778191755, 'nb_photo': 7, 'list_port_cont': '21035537,21036256,21039262,21041928,21043076', 'assoc_port': '21010340:21035537,21010354:21036256,21010384:21039262,21010433:21041928,21010459:21043076', 'assoc_mat': '21010340:metal:4461:21035537,21010354:metal:4461:21036256,21010384:metal:4461:21039262,21010433:metal:4461:21041928,21010459:metal:4461:21043076'}, {'unwanted_material': 'metal', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.08124522911451959, 'nb_photo': 50, 'list_port_cont': '21030071,21033215,21034693,21035949,21037784,21040155,21041785,21042364,21042791,21043697,21043935,21083760', 'assoc_port': '21010308:21030071,21010315:21083760,21010322:21033215,21010332:21034693,21010348:21035949,21010372:21037784,21010390:21040155,21010424:21041785,21010437:21042364,21010447:21042791,21010472:21043697,21010560:21043935', 'assoc_mat': '21010308:metal:4200:21030071,21010315:metal:4200:21083760,21010322:metal:4200:21033215,21010332:metal:4200:21034693,21010348:metal:4200:21035949,21010372:metal:4200:21037784,21010390:metal:4200:21040155,21010424:metal:4200:21041785,21010437:metal:4200:21042364,21010447:metal:4200:21042791,21010472:metal:4200:21043697,21010560:metal:4200:21043935'}, {'unwanted_material': 'metal', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.012232553190902004, 'nb_photo': 1, 'list_port_cont': '21038848', 'assoc_port': '21010382:21038848', 'assoc_mat': '21010382:metal:4209:21038848'}, {'unwanted_material': 'metal', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.00519284624947138, 'nb_photo': 4, 'list_port_cont': '21029186,21033569,21040923', 'assoc_port': '21010305:21029186,21010324:21033569,21010395:21040923', 'assoc_mat': '21010305:metal:4207:21029186,21010324:metal:4207:21033569,21010395:metal:4207:21040923'}, {'unwanted_material': 'metal', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.012458277196351918, 'nb_photo': 68, 'list_port_cont': '21030313,21032588,21033367,21034571,21035878,21037046,21038128,21040327,21041104,21043248,21043265', 'assoc_port': '21010309:21030313,21010319:21032588,21010323:21033367,21010330:21034571,21010346:21035878,21010364:21037046,21010376:21038128,21010392:21040327,21010421:21041104,21010464:21043265,21010552:21043248', 'assoc_mat': '21010309:metal:4211:21030313,21010319:metal:4211:21032588,21010323:metal:4211:21033367,21010330:metal:4211:21034571,21010346:metal:4211:21035878,21010364:metal:4211:21037046,21010376:metal:4211:21038128,21010392:metal:4211:21040327,21010421:metal:4211:21041104,21010464:metal:4211:21043265,21010552:metal:4211:21043248'}, {'unwanted_material': 'metal', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0031080083884743605, 'nb_photo': 5, 'list_port_cont': '21035721,21035900,21036751,21037303', 'assoc_port': '21010342:21035721,21010360:21036751,21010366:21037303,21010550:21035900', 'assoc_mat': '21010342:metal:3327:21035721,21010360:metal:3327:21036751,21010366:metal:3327:21037303,21010550:metal:3327:21035900'}, {'unwanted_material': 'papier', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.03225024570297771, 'nb_photo': 12, 'list_port_cont': '21040400', 'assoc_port': '21010393:21040400', 'assoc_mat': '21010393:papier:4205:21040400'}, {'unwanted_material': 'papier', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.015594966263082799, 'nb_photo': 70, 'list_port_cont': '21031490,21037926,21042875,21044094', 'assoc_port': '21010314:21031490,21010374:21037926,21010450:21042875,21010564:21044094', 'assoc_mat': '21010314:papier:4203:21031490,21010374:papier:4203:21037926,21010450:papier:4203:21042875,21010564:papier:4203:21044094'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.05367087452335126, 'nb_photo': 767, 'list_port_cont': '20174436,21029071,21029752,21030534,21031274,21032398,21033783,21034753,21035234,21035755,21036079,21036304,21037469,21038552,21039412,21040671,21041477,21041819,21042233,21042438,21043362,21044163,21083817', 'assoc_port': '20173926:20174436,21010292:21029071,21010307:21029752,21010310:21030534,21010313:21031274,21010318:21032398,21010325:21033783,21010327:21083817,21010334:21034753,21010338:21035234,21010344:21035755,21010352:21036079,21010356:21036304,21010370:21037469,21010380:21038552,21010386:21039412,21010394:21040671,21010423:21041477,21010427:21041819,21010439:21042233,21010443:21042438,21010467:21043362,21010566:21044163', 'assoc_mat': '20173926:papier:4207:20174436,21010292:papier:4207:21029071,21010307:papier:4207:21029752,21010310:papier:4207:21030534,21010313:papier:4207:21031274,21010318:papier:4207:21032398,21010325:papier:4207:21033783,21010327:papier:4207:21083817,21010334:papier:4207:21034753,21010338:papier:4207:21035234,21010344:papier:4207:21035755,21010352:papier:4207:21036079,21010356:papier:4207:21036304,21010370:papier:4207:21037469,21010380:papier:4207:21038552,21010386:papier:4207:21039412,21010394:papier:4207:21040671,21010423:papier:4207:21041477,21010427:papier:4207:21041819,21010439:papier:4207:21042233,21010443:papier:4207:21042438,21010467:papier:4207:21043362,21010566:papier:4207:21044163'}, {'unwanted_material': 'papier', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.16075861172221145, 'nb_photo': 1652, 'list_port_cont': '20312931,21030906,21032980,21034109,21035545,21036252,21037438,21039257,21041930,21043072,21043575,21043724,21086582', 'assoc_port': '20173925:20312931,21010311:21030906,21010320:21032980,21010326:21034109,21010340:21035545,21010354:21036252,21010368:21037438,21010384:21039257,21010422:21086582,21010433:21041930,21010459:21043072,21010469:21043575,21010557:21043724', 'assoc_mat': '20173925:papier:4461:20312931,21010311:papier:4461:21030906,21010320:papier:4461:21032980,21010326:papier:4461:21034109,21010340:papier:4461:21035545,21010354:papier:4461:21036252,21010368:papier:4461:21037438,21010384:papier:4461:21039257,21010422:papier:4461:21086582,21010433:papier:4461:21041930,21010459:papier:4461:21043072,21010469:papier:4461:21043575,21010557:papier:4461:21043724'}, {'unwanted_material': 'papier', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.054568854807388836, 'nb_photo': 269, 'list_port_cont': '21030070,21033218,21034687,21035947,21036891,21037781,21040150,21041793,21042358,21042801,21043686,21043933,21083755', 'assoc_port': '21010308:21030070,21010315:21083755,21010322:21033218,21010332:21034687,21010348:21035947,21010362:21036891,21010372:21037781,21010390:21040150,21010424:21041793,21010437:21042358,21010447:21042801,21010472:21043686,21010560:21043933', 'assoc_mat': '21010308:papier:4200:21030070,21010315:papier:4200:21083755,21010322:papier:4200:21033218,21010332:papier:4200:21034687,21010348:papier:4200:21035947,21010362:papier:4200:21036891,21010372:papier:4200:21037781,21010390:papier:4200:21040150,21010424:papier:4200:21041793,21010437:papier:4200:21042358,21010447:papier:4200:21042801,21010472:papier:4200:21043686,21010560:papier:4200:21043933'}, {'unwanted_material': 'papier', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.9236559702801899, 'nb_photo': 121, 'list_port_cont': '21038838', 'assoc_port': '21010382:21038838', 'assoc_mat': '21010382:papier:4209:21038838'}, {'unwanted_material': 'papier', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.05064937838251356, 'nb_photo': 132, 'list_port_cont': '21029188,21032004,21033563,21035002,21036487,21037974,21040914', 'assoc_port': '21010305:21029188,21010316:21032004,21010324:21033563,21010336:21035002,21010358:21036487,21010375:21037974,21010395:21040914', 'assoc_mat': '21010305:papier:4207:21029188,21010316:papier:4207:21032004,21010324:papier:4207:21033563,21010336:papier:4207:21035002,21010358:papier:4207:21036487,21010375:papier:4207:21037974,21010395:papier:4207:21040914'}, {'unwanted_material': 'papier', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.006372956461625042, 'nb_photo': 246, 'list_port_cont': '21030309,21032584,21033382,21034562,21035882,21037053,21038122,21040323,21041107,21043233,21043267', 'assoc_port': '21010309:21030309,21010319:21032584,21010323:21033382,21010330:21034562,21010346:21035882,21010364:21037053,21010376:21038122,21010392:21040323,21010421:21041107,21010464:21043267,21010552:21043233', 'assoc_mat': '21010309:papier:4211:21030309,21010319:papier:4211:21032584,21010323:papier:4211:21033382,21010330:papier:4211:21034562,21010346:papier:4211:21035882,21010364:papier:4211:21037053,21010376:papier:4211:21038122,21010392:papier:4211:21040323,21010421:papier:4211:21041107,21010464:papier:4211:21043267,21010552:papier:4211:21043233'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.03703120138733584, 'nb_photo': 219, 'list_port_cont': '21029702,21031224,21032379,21033093,21034551,21035710,21035860,21035894,21036064,21036287,21036527,21036756,21037310,21038135,21038426,21038539,21085315', 'assoc_port': '21010306:21029702,21010312:21031224,21010317:21032379,21010321:21033093,21010328:21034551,21010342:21035710,21010350:21036064,21010360:21036756,21010366:21037310,21010378:21038539,21010388:21085315,21010396:21038426,21010431:21038135,21010441:21036527,21010452:21036287,21010498:21035860,21010550:21035894', 'assoc_mat': '21010306:papier:3327:21029702,21010312:papier:3327:21031224,21010317:papier:3327:21032379,21010321:papier:3327:21033093,21010328:papier:3327:21034551,21010342:papier:3327:21035710,21010350:papier:3327:21036064,21010360:papier:3327:21036756,21010366:papier:3327:21037310,21010378:papier:3327:21038539,21010388:papier:3327:21085315,21010396:papier:3327:21038426,21010431:papier:3327:21038135,21010441:papier:3327:21036527,21010452:papier:3327:21036287,21010498:papier:3327:21035860,21010550:papier:3327:21035894'}, {'unwanted_material': 'pehd', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.009607816901545146, 'nb_photo': 1, 'list_port_cont': '21043080', 'assoc_port': '21010459:21043080', 'assoc_mat': '21010459:pehd:4461:21043080'}, {'unwanted_material': 'pehd', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.044279818769473143, 'nb_photo': 3, 'list_port_cont': '21042365,21043926', 'assoc_port': '21010437:21042365,21010560:21043926', 'assoc_mat': '21010437:pehd:4200:21042365,21010560:pehd:4200:21043926'}, {'unwanted_material': 'pehd', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.00548892601853799, 'nb_photo': 10, 'list_port_cont': '21031228,21032372,21036297,21036525,21038143', 'assoc_port': '21010312:21031228,21010317:21032372,21010431:21038143,21010441:21036525,21010452:21036297', 'assoc_mat': '21010312:pehd:3327:21031228,21010317:pehd:3327:21032372,21010431:pehd:3327:21038143,21010441:pehd:3327:21036525,21010452:pehd:3327:21036297'}, {'unwanted_material': 'pet_clair', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.007971287749184737, 'nb_photo': 1, 'list_port_cont': '21040389', 'assoc_port': '21010393:21040389', 'assoc_mat': '21010393:pet_clair:4205:21040389'}, {'unwanted_material': 'pet_clair', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.009746342447344245, 'nb_photo': 15, 'list_port_cont': '21031487,21042881,21044095', 'assoc_port': '21010314:21031487,21010450:21042881,21010564:21044095', 'assoc_mat': '21010314:pet_clair:4203:21031487,21010450:pet_clair:4203:21042881,21010564:pet_clair:4203:21044095'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0035627391253297567, 'nb_photo': 5, 'list_port_cont': '21030527,21035748,21037465,21043368', 'assoc_port': '21010310:21030527,21010344:21035748,21010370:21037465,21010467:21043368', 'assoc_mat': '21010310:pet_clair:4207:21030527,21010344:pet_clair:4207:21035748,21010370:pet_clair:4207:21037465,21010467:pet_clair:4207:21043368'}, {'unwanted_material': 'pet_clair', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.03419825029433667, 'nb_photo': 75, 'list_port_cont': '21030073,21033213,21034688,21035955,21036886,21037790,21040160,21041794,21042352,21042797,21043687,21043928,21083758', 'assoc_port': '21010308:21030073,21010315:21083758,21010322:21033213,21010332:21034688,21010348:21035955,21010362:21036886,21010372:21037790,21010390:21040160,21010424:21041794,21010437:21042352,21010447:21042797,21010472:21043687,21010560:21043928', 'assoc_mat': '21010308:pet_clair:4200:21030073,21010315:pet_clair:4200:21083758,21010322:pet_clair:4200:21033213,21010332:pet_clair:4200:21034688,21010348:pet_clair:4200:21035955,21010362:pet_clair:4200:21036886,21010372:pet_clair:4200:21037790,21010390:pet_clair:4200:21040160,21010424:pet_clair:4200:21041794,21010437:pet_clair:4200:21042352,21010447:pet_clair:4200:21042797,21010472:pet_clair:4200:21043687,21010560:pet_clair:4200:21043928'}, {'unwanted_material': 'pet_clair', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0005903849862339631, 'nb_photo': 7, 'list_port_cont': '21033375,21035880,21040317,21041108,21043232,21043268', 'assoc_port': '21010323:21033375,21010346:21035880,21010392:21040317,21010421:21041108,21010464:21043268,21010552:21043232', 'assoc_mat': '21010323:pet_clair:4211:21033375,21010346:pet_clair:4211:21035880,21010392:pet_clair:4211:21040317,21010421:pet_clair:4211:21041108,21010464:pet_clair:4211:21043268,21010552:pet_clair:4211:21043232'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.847432448298875, 'nb_photo': 2436, 'list_port_cont': '21029700,21031230,21032382,21033094,21034555,21035717,21035857,21035898,21036062,21036290,21036529,21036761,21037315,21038142,21038427,21038527,21085306', 'assoc_port': '21010306:21029700,21010312:21031230,21010317:21032382,21010321:21033094,21010328:21034555,21010342:21035717,21010350:21036062,21010360:21036761,21010366:21037315,21010378:21038527,21010388:21085306,21010396:21038427,21010431:21038142,21010441:21036529,21010452:21036290,21010498:21035857,21010550:21035898', 'assoc_mat': '21010306:pet_clair:3327:21029700,21010312:pet_clair:3327:21031230,21010317:pet_clair:3327:21032382,21010321:pet_clair:3327:21033094,21010328:pet_clair:3327:21034555,21010342:pet_clair:3327:21035717,21010350:pet_clair:3327:21036062,21010360:pet_clair:3327:21036761,21010366:pet_clair:3327:21037315,21010378:pet_clair:3327:21038527,21010388:pet_clair:3327:21085306,21010396:pet_clair:3327:21038427,21010431:pet_clair:3327:21038142,21010441:pet_clair:3327:21036529,21010452:pet_clair:3327:21036290,21010498:pet_clair:3327:21035857,21010550:pet_clair:3327:21035898'}, {'unwanted_material': 'pet_fonce', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0006619494919741627, 'nb_photo': 2, 'list_port_cont': '21037922,21042884', 'assoc_port': '21010374:21037922,21010450:21042884', 'assoc_mat': '21010374:pet_fonce:4203:21037922,21010450:pet_fonce:4203:21042884'}, {'unwanted_material': 'pet_fonce', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.6936070240649872, 'nb_photo': 153, 'list_port_cont': '21030064,21033208,21034690,21035950,21036878,21037787,21040148,21041796,21042354,21042787,21043696,21043936,21083753', 'assoc_port': '21010308:21030064,21010315:21083753,21010322:21033208,21010332:21034690,21010348:21035950,21010362:21036878,21010372:21037787,21010390:21040148,21010424:21041796,21010437:21042354,21010447:21042787,21010472:21043696,21010560:21043936', 'assoc_mat': '21010308:pet_fonce:4200:21030064,21010315:pet_fonce:4200:21083753,21010322:pet_fonce:4200:21033208,21010332:pet_fonce:4200:21034690,21010348:pet_fonce:4200:21035950,21010362:pet_fonce:4200:21036878,21010372:pet_fonce:4200:21037787,21010390:pet_fonce:4200:21040148,21010424:pet_fonce:4200:21041796,21010437:pet_fonce:4200:21042354,21010447:pet_fonce:4200:21042787,21010472:pet_fonce:4200:21043696,21010560:pet_fonce:4200:21043936'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.00172681378889089, 'nb_photo': 22, 'list_port_cont': '21030308,21032600,21034559,21035872,21037047,21038117,21041115,21043236,21043275', 'assoc_port': '21010309:21030308,21010319:21032600,21010330:21034559,21010346:21035872,21010364:21037047,21010376:21038117,21010421:21041115,21010464:21043275,21010552:21043236', 'assoc_mat': '21010309:pet_fonce:4211:21030308,21010319:pet_fonce:4211:21032600,21010330:pet_fonce:4211:21034559,21010346:pet_fonce:4211:21035872,21010364:pet_fonce:4211:21037047,21010376:pet_fonce:4211:21038117,21010421:pet_fonce:4211:21041115,21010464:pet_fonce:4211:21043275,21010552:pet_fonce:4211:21043236'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.02494615120234525, 'nb_photo': 83, 'list_port_cont': '21029708,21031223,21032375,21033102,21034556,21035722,21035863,21035888,21036059,21036289,21036528,21036759,21037306,21038138,21038416,21038537,21085304', 'assoc_port': '21010306:21029708,21010312:21031223,21010317:21032375,21010321:21033102,21010328:21034556,21010342:21035722,21010350:21036059,21010360:21036759,21010366:21037306,21010378:21038537,21010388:21085304,21010396:21038416,21010431:21038138,21010441:21036528,21010452:21036289,21010498:21035863,21010550:21035888', 'assoc_mat': '21010306:pet_fonce:3327:21029708,21010312:pet_fonce:3327:21031223,21010317:pet_fonce:3327:21032375,21010321:pet_fonce:3327:21033102,21010328:pet_fonce:3327:21034556,21010342:pet_fonce:3327:21035722,21010350:pet_fonce:3327:21036059,21010360:pet_fonce:3327:21036759,21010366:pet_fonce:3327:21037306,21010378:pet_fonce:3327:21038537,21010388:pet_fonce:3327:21085304,21010396:pet_fonce:3327:21038416,21010431:pet_fonce:3327:21038138,21010441:pet_fonce:3327:21036528,21010452:pet_fonce:3327:21036289,21010498:pet_fonce:3327:21035863,21010550:pet_fonce:3327:21035888'}, {'unwanted_material': 'pet_opaque', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.010594561785623425, 'nb_photo': 21, 'list_port_cont': '21031485,21037921,21042877,21044097', 'assoc_port': '21010314:21031485,21010374:21037921,21010450:21042877,21010564:21044097', 'assoc_mat': '21010314:pet_opaque:4203:21031485,21010374:pet_opaque:4203:21037921,21010450:pet_opaque:4203:21042877,21010564:pet_opaque:4203:21044097'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.009583707410178685, 'nb_photo': 27, 'list_port_cont': '21029755,21030528,21033780,21034744,21035232,21036076,21037476,21040685,21041486,21041827,21042434,21043369,21044168,21083819', 'assoc_port': '21010307:21029755,21010310:21030528,21010325:21033780,21010327:21083819,21010334:21034744,21010338:21035232,21010352:21036076,21010370:21037476,21010394:21040685,21010423:21041486,21010427:21041827,21010443:21042434,21010467:21043369,21010566:21044168', 'assoc_mat': '21010307:pet_opaque:4207:21029755,21010310:pet_opaque:4207:21030528,21010325:pet_opaque:4207:21033780,21010327:pet_opaque:4207:21083819,21010334:pet_opaque:4207:21034744,21010338:pet_opaque:4207:21035232,21010352:pet_opaque:4207:21036076,21010370:pet_opaque:4207:21037476,21010394:pet_opaque:4207:21040685,21010423:pet_opaque:4207:21041486,21010427:pet_opaque:4207:21041827,21010443:pet_opaque:4207:21042434,21010467:pet_opaque:4207:21043369,21010566:pet_opaque:4207:21044168'}, {'unwanted_material': 'pet_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.005704754141438969, 'nb_photo': 8, 'list_port_cont': '21030898,21034101,21035548,21037447,21043571,21086583', 'assoc_port': '21010311:21030898,21010326:21034101,21010340:21035548,21010368:21037447,21010422:21086583,21010469:21043571', 'assoc_mat': '21010311:pet_opaque:4461:21030898,21010326:pet_opaque:4461:21034101,21010340:pet_opaque:4461:21035548,21010368:pet_opaque:4461:21037447,21010422:pet_opaque:4461:21086583,21010469:pet_opaque:4461:21043571'}, {'unwanted_material': 'pet_opaque', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.04622505132349525, 'nb_photo': 295, 'list_port_cont': '21030063,21033221,21034692,21035956,21036882,21037786,21040153,21041790,21042362,21042786,21043698,21043927,21083765', 'assoc_port': '21010308:21030063,21010315:21083765,21010322:21033221,21010332:21034692,21010348:21035956,21010362:21036882,21010372:21037786,21010390:21040153,21010424:21041790,21010437:21042362,21010447:21042786,21010472:21043698,21010560:21043927', 'assoc_mat': '21010308:pet_opaque:4200:21030063,21010315:pet_opaque:4200:21083765,21010322:pet_opaque:4200:21033221,21010332:pet_opaque:4200:21034692,21010348:pet_opaque:4200:21035956,21010362:pet_opaque:4200:21036882,21010372:pet_opaque:4200:21037786,21010390:pet_opaque:4200:21040153,21010424:pet_opaque:4200:21041790,21010437:pet_opaque:4200:21042362,21010447:pet_opaque:4200:21042786,21010472:pet_opaque:4200:21043698,21010560:pet_opaque:4200:21043927'}, {'unwanted_material': 'pet_opaque', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.004549505586243793, 'nb_photo': 2, 'list_port_cont': '21034997', 'assoc_port': '21010336:21034997', 'assoc_mat': '21010336:pet_opaque:4207:21034997'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.003027563038637962, 'nb_photo': 80, 'list_port_cont': '21030316,21032585,21033368,21034560,21035881,21037049,21038112,21040328,21041109,21043242,21043273', 'assoc_port': '21010309:21030316,21010319:21032585,21010323:21033368,21010330:21034560,21010346:21035881,21010364:21037049,21010376:21038112,21010392:21040328,21010421:21041109,21010464:21043273,21010552:21043242', 'assoc_mat': '21010309:pet_opaque:4211:21030316,21010319:pet_opaque:4211:21032585,21010323:pet_opaque:4211:21033368,21010330:pet_opaque:4211:21034560,21010346:pet_opaque:4211:21035881,21010364:pet_opaque:4211:21037049,21010376:pet_opaque:4211:21038112,21010392:pet_opaque:4211:21040328,21010421:pet_opaque:4211:21041109,21010464:pet_opaque:4211:21043273,21010552:pet_opaque:4211:21043242'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.0010557625171375255, 'nb_photo': 1, 'list_port_cont': '21030061', 'assoc_port': '21010308:21030061', 'assoc_mat': '21010308:textiles_sanitaires:4200:21030061'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(1581044,1581124,1645457)); after get_hostname_from_raspi hasthag : film_pedb hasthag that could be used but not yet : _______film_plastique SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______film_pedb' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=157 and date >='2025-02-01' and date <= '2025-02-28') GROUP BY month order by month; hasthag : emr hasthag that could be used but not yet : _______carton,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______emr' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=157 and date >='2025-02-01' and date <= '2025-02-28') GROUP BY month order by month; hasthag : gros_cartons hasthag that could be used but not yet : _______carton,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______gros_cartons' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=157 and date >='2025-02-01' and date <= '2025-02-28') GROUP BY month order by month; hasthag : pet_clair hasthag that could be used but not yet : _______pet_clair,bouchon,etiquette,barquette_avec_film,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______pet_clair' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=157 and date >='2025-02-01' and date <= '2025-02-28') GROUP BY month order by month; hasthag : flux_dev_rigide hasthag that could be used but not yet : _______pet_fonce,barquette_opaque,pet_opaque SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______flux_dev_rigide' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=157 and date >='2025-02-01' and date <= '2025-02-28') GROUP BY month order by month; hasthag : pehd_pp hasthag that could be used but not yet : _______pehd,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______pehd_pp' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=157 and date >='2025-02-01' and date <= '2025-02-28') GROUP BY month order by month; hasthag : ela hasthag that could be used but not yet : _______ela,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______ela' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=157 and date >='2025-02-01' and date <= '2025-02-28') GROUP BY month order by month; hasthag : gm hasthag that could be used but not yet : _______papier,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______gm' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=157 and date >='2025-02-01' and date <= '2025-02-28') GROUP BY month order by month; hasthag : aluminium hasthag that could be used but not yet : _______metal,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______aluminium' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=157 and date >='2025-02-01' and date <= '2025-02-28') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((47,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('film_pedb', 36), ('emr', 11)), 'material_dict': {'film_pedb': 36, 'emr': 11}, 'coverage_data': (), 'impurety_average_data': ((datetime.date(2025, 2, 1), 0.1513534324516888, 36), (datetime.date(2025, 2, 28), 0.14092491554164796, 3)), 'impurety_average_data_per_hashtag': {'film_pedb': ((datetime.date(2025, 2, 1), 0.17615177657823766, 36), (datetime.date(2025, 2, 28), 0.18487235663560397, 15)), 'emr': ((datetime.date(2025, 2, 1), 0.07019521531025619, 11), (datetime.date(2025, 2, 28), 0.07154614168840505, 3)), 'gros_cartons': ((datetime.date(2025, 2, 28), 0.06013847222754778, 5),), 'pet_clair': ((datetime.date(2025, 2, 28), 0.1303773448044911, 7),), 'flux_dev_rigide': ((datetime.date(2025, 2, 28), 0.23721621854637853, 8),), 'pehd_pp': ((datetime.date(2025, 2, 28), 0.060769138614304885, 6),), 'ela': ((datetime.date(2025, 2, 28), 0.08570337501973148, 5),), 'gm': ((datetime.date(2025, 2, 28), 0.07634402971980936, 3),), 'aluminium': ((datetime.date(2025, 2, 28), 0.07070726140093016, 3),)}, 'quality_array': [['-2.6217089770648796', '01022025'], ['-2.4624289768963847', '28022025']], 'number_of_batch': ((90,),), 'datou_id_sts': 4323, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0278809465918396, 'nb_photo': 188, 'list_port_cont': '21029703,21031225,21032376,21033092,21034547,21035720,21035861,21035897,21036057,21036285,21036526,21036754,21037307,21038139,21038424,21038535,21085305', 'assoc_port': '21010306:21029703,21010312:21031225,21010317:21032376,21010321:21033092,21010328:21034547,21010342:21035720,21010350:21036057,21010360:21036754,21010366:21037307,21010378:21038535,21010388:21085305,21010396:21038424,21010431:21038139,21010441:21036526,21010452:21036285,21010498:21035861,21010550:21035897', 'assoc_mat': '21010306:autre:3327:21029703,21010312:autre:3327:21031225,21010317:autre:3327:21032376,21010321:autre:3327:21033092,21010328:autre:3327:21034547,21010342:autre:3327:21035720,21010350:autre:3327:21036057,21010360:autre:3327:21036754,21010366:autre:3327:21037307,21010378:autre:3327:21038535,21010388:autre:3327:21085305,21010396:autre:3327:21038424,21010431:autre:3327:21038139,21010441:autre:3327:21036526,21010452:autre:3327:21036285,21010498:autre:3327:21035861,21010550:autre:3327:21035897'}, {'unwanted_material': 'barquette_avec_film', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.00809577184012819, 'nb_photo': 13, 'list_port_cont': '21029701,21035865,21035896,21036293,21036520,21037313,21038144,21038415', 'assoc_port': '21010306:21029701,21010366:21037313,21010396:21038415,21010431:21038144,21010441:21036520,21010452:21036293,21010498:21035865,21010550:21035896', 'assoc_mat': '21010306:barquette_avec_film:3327:21029701,21010366:barquette_avec_film:3327:21037313,21010396:barquette_avec_film:3327:21038415,21010431:barquette_avec_film:3327:21038144,21010441:barquette_avec_film:3327:21036520,21010452:barquette_avec_film:3327:21036293,21010498:barquette_avec_film:3327:21035865,21010550:barquette_avec_film:3327:21035896'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.01145727820199558, 'nb_photo': 50, 'list_port_cont': '21031478,21037920,21042883,21044098', 'assoc_port': '21010314:21031478,21010374:21037920,21010450:21042883,21010564:21044098', 'assoc_mat': '21010314:barquette_opaque:4203:21031478,21010374:barquette_opaque:4203:21037920,21010450:barquette_opaque:4203:21042883,21010564:barquette_opaque:4203:21044098'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0031123100610556723, 'nb_photo': 28, 'list_port_cont': '21029075,21031284,21033774,21034754,21035756,21037466,21038549,21039413,21040683,21041483,21041828,21042240,21042442,21043356,21044153,21083811', 'assoc_port': '21010292:21029075,21010313:21031284,21010325:21033774,21010327:21083811,21010334:21034754,21010344:21035756,21010370:21037466,21010380:21038549,21010386:21039413,21010394:21040683,21010423:21041483,21010427:21041828,21010439:21042240,21010443:21042442,21010467:21043356,21010566:21044153', 'assoc_mat': '21010292:barquette_opaque:4207:21029075,21010313:barquette_opaque:4207:21031284,21010325:barquette_opaque:4207:21033774,21010327:barquette_opaque:4207:21083811,21010334:barquette_opaque:4207:21034754,21010344:barquette_opaque:4207:21035756,21010370:barquette_opaque:4207:21037466,21010380:barquette_opaque:4207:21038549,21010386:barquette_opaque:4207:21039413,21010394:barquette_opaque:4207:21040683,21010423:barquette_opaque:4207:21041483,21010427:barquette_opaque:4207:21041828,21010439:barquette_opaque:4207:21042240,21010443:barquette_opaque:4207:21042442,21010467:barquette_opaque:4207:21043356,21010566:barquette_opaque:4207:21044153'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.00937317366048873, 'nb_photo': 4, 'list_port_cont': '21032987,21036266,21037445,21043728', 'assoc_port': '21010320:21032987,21010354:21036266,21010368:21037445,21010557:21043728', 'assoc_mat': '21010320:barquette_opaque:4461:21032987,21010354:barquette_opaque:4461:21036266,21010368:barquette_opaque:4461:21037445,21010557:barquette_opaque:4461:21043728'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.01710100001005086, 'nb_photo': 78, 'list_port_cont': '21030062,21033211,21034680,21035953,21036893,21037782,21040151,21041792,21042357,21042800,21043685,21043937,21083764', 'assoc_port': '21010308:21030062,21010315:21083764,21010322:21033211,21010332:21034680,21010348:21035953,21010362:21036893,21010372:21037782,21010390:21040151,21010424:21041792,21010437:21042357,21010447:21042800,21010472:21043685,21010560:21043937', 'assoc_mat': '21010308:barquette_opaque:4200:21030062,21010315:barquette_opaque:4200:21083764,21010322:barquette_opaque:4200:21033211,21010332:barquette_opaque:4200:21034680,21010348:barquette_opaque:4200:21035953,21010362:barquette_opaque:4200:21036893,21010372:barquette_opaque:4200:21037782,21010390:barquette_opaque:4200:21040151,21010424:barquette_opaque:4200:21041792,21010437:barquette_opaque:4200:21042357,21010447:barquette_opaque:4200:21042800,21010472:barquette_opaque:4200:21043685,21010560:barquette_opaque:4200:21043937'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0037650287188941618, 'nb_photo': 1, 'list_port_cont': '21038851', 'assoc_port': '21010382:21038851', 'assoc_mat': '21010382:barquette_opaque:4209:21038851'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.0026449854782722554, 'nb_photo': 2, 'list_port_cont': '21031995,21036490', 'assoc_port': '21010316:21031995,21010358:21036490', 'assoc_mat': '21010316:barquette_opaque:4207:21031995,21010358:barquette_opaque:4207:21036490'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.036866855499123524, 'nb_photo': 419, 'list_port_cont': '21030315,21032594,21033378,21034558,21035870,21037045,21038126,21040332,21041111,21043243,21043272', 'assoc_port': '21010309:21030315,21010319:21032594,21010323:21033378,21010330:21034558,21010346:21035870,21010364:21037045,21010376:21038126,21010392:21040332,21010421:21041111,21010464:21043272,21010552:21043243', 'assoc_mat': '21010309:barquette_opaque:4211:21030315,21010319:barquette_opaque:4211:21032594,21010323:barquette_opaque:4211:21033378,21010330:barquette_opaque:4211:21034558,21010346:barquette_opaque:4211:21035870,21010364:barquette_opaque:4211:21037045,21010376:barquette_opaque:4211:21038126,21010392:barquette_opaque:4211:21040332,21010421:barquette_opaque:4211:21041111,21010464:barquette_opaque:4211:21043272,21010552:barquette_opaque:4211:21043243'}, {'unwanted_material': 'bouchon', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.011239212416872615, 'nb_photo': 97, 'list_port_cont': '21029709,21031219,21032384,21033090,21034546,21035715,21035853,21035892,21036058,21036286,21036530,21036755,21037314,21038131,21038417,21038534,21085314', 'assoc_port': '21010306:21029709,21010312:21031219,21010317:21032384,21010321:21033090,21010328:21034546,21010342:21035715,21010350:21036058,21010360:21036755,21010366:21037314,21010378:21038534,21010388:21085314,21010396:21038417,21010431:21038131,21010441:21036530,21010452:21036286,21010498:21035853,21010550:21035892', 'assoc_mat': '21010306:bouchon:3327:21029709,21010312:bouchon:3327:21031219,21010317:bouchon:3327:21032384,21010321:bouchon:3327:21033090,21010328:bouchon:3327:21034546,21010342:bouchon:3327:21035715,21010350:bouchon:3327:21036058,21010360:bouchon:3327:21036755,21010366:bouchon:3327:21037314,21010378:bouchon:3327:21038534,21010388:bouchon:3327:21085314,21010396:bouchon:3327:21038417,21010431:bouchon:3327:21038131,21010441:bouchon:3327:21036530,21010452:bouchon:3327:21036286,21010498:bouchon:3327:21035853,21010550:bouchon:3327:21035892'}, {'unwanted_material': 'carton', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.011171706024206645, 'nb_photo': 2, 'list_port_cont': '21040395', 'assoc_port': '21010393:21040395', 'assoc_mat': '21010393:carton:4205:21040395'}, {'unwanted_material': 'carton', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.003154728706187209, 'nb_photo': 15, 'list_port_cont': '21037917,21042872,21044086', 'assoc_port': '21010374:21037917,21010450:21042872,21010564:21044086', 'assoc_mat': '21010374:carton:4203:21037917,21010450:carton:4203:21042872,21010564:carton:4203:21044086'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.9319457801255371, 'nb_photo': 41, 'list_port_cont': '20174430,21029074,21029751,21034739,21036073,21036311,21038555,21039415,21040680,21041478,21041824,21042227,21042441,21043358,21044162,21083813', 'assoc_port': '20173926:20174430,21010292:21029074,21010307:21029751,21010327:21083813,21010334:21034739,21010352:21036073,21010356:21036311,21010380:21038555,21010386:21039415,21010394:21040680,21010423:21041478,21010427:21041824,21010439:21042227,21010443:21042441,21010467:21043358,21010566:21044162', 'assoc_mat': '20173926:carton:4207:20174430,21010292:carton:4207:21029074,21010307:carton:4207:21029751,21010327:carton:4207:21083813,21010334:carton:4207:21034739,21010352:carton:4207:21036073,21010356:carton:4207:21036311,21010380:carton:4207:21038555,21010386:carton:4207:21039415,21010394:carton:4207:21040680,21010423:carton:4207:21041478,21010427:carton:4207:21041824,21010439:carton:4207:21042227,21010443:carton:4207:21042441,21010467:carton:4207:21043358,21010566:carton:4207:21044162'}, {'unwanted_material': 'carton', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.014851902166160162, 'nb_photo': 211, 'list_port_cont': '20312922,21030895,21032993,21034097,21035541,21036265,21037436,21039255,21041923,21043082,21043567,21043733,21086585', 'assoc_port': '20173925:20312922,21010311:21030895,21010320:21032993,21010326:21034097,21010340:21035541,21010354:21036265,21010368:21037436,21010384:21039255,21010422:21086585,21010433:21041923,21010459:21043082,21010469:21043567,21010557:21043733', 'assoc_mat': '20173925:carton:4461:20312922,21010311:carton:4461:21030895,21010320:carton:4461:21032993,21010326:carton:4461:21034097,21010340:carton:4461:21035541,21010354:carton:4461:21036265,21010368:carton:4461:21037436,21010384:carton:4461:21039255,21010422:carton:4461:21086585,21010433:carton:4461:21041923,21010459:carton:4461:21043082,21010469:carton:4461:21043567,21010557:carton:4461:21043733'}, {'unwanted_material': 'carton', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.003872641606665564, 'nb_photo': 29, 'list_port_cont': '21030057,21033206,21036889,21040157,21041795,21042367,21042795,21043691,21043940', 'assoc_port': '21010308:21030057,21010322:21033206,21010362:21036889,21010390:21040157,21010424:21041795,21010437:21042367,21010447:21042795,21010472:21043691,21010560:21043940', 'assoc_mat': '21010308:carton:4200:21030057,21010322:carton:4200:21033206,21010362:carton:4200:21036889,21010390:carton:4200:21040157,21010424:carton:4200:21041795,21010437:carton:4200:21042367,21010447:carton:4200:21042795,21010472:carton:4200:21043691,21010560:carton:4200:21043940'}, {'unwanted_material': 'carton', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.9342654013489219, 'nb_photo': 5, 'list_port_cont': '21029189,21031994,21035004,21040921', 'assoc_port': '21010305:21029189,21010316:21031994,21010336:21035004,21010395:21040921', 'assoc_mat': '21010305:carton:4207:21029189,21010316:carton:4207:21031994,21010336:carton:4207:21035004,21010395:carton:4207:21040921'}, {'unwanted_material': 'carton', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0014341005717665993, 'nb_photo': 50, 'list_port_cont': '21030305,21032587,21033370,21034572,21035874,21037050,21038114,21040316,21041106,21043234,21043278', 'assoc_port': '21010309:21030305,21010319:21032587,21010323:21033370,21010330:21034572,21010346:21035874,21010364:21037050,21010376:21038114,21010392:21040316,21010421:21041106,21010464:21043278,21010552:21043234', 'assoc_mat': '21010309:carton:4211:21030305,21010319:carton:4211:21032587,21010323:carton:4211:21033370,21010330:carton:4211:21034572,21010346:carton:4211:21035874,21010364:carton:4211:21037050,21010376:carton:4211:21038114,21010392:carton:4211:21040316,21010421:carton:4211:21041106,21010464:carton:4211:21043278,21010552:carton:4211:21043234'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.05357755946933835, 'nb_photo': 197, 'list_port_cont': '21029699,21031222,21032381,21033089,21034544,21035711,21035859,21035889,21036056,21036294,21036522,21036760,21037302,21038132,21038418,21038538,21085316', 'assoc_port': '21010306:21029699,21010312:21031222,21010317:21032381,21010321:21033089,21010328:21034544,21010342:21035711,21010350:21036056,21010360:21036760,21010366:21037302,21010378:21038538,21010388:21085316,21010396:21038418,21010431:21038132,21010441:21036522,21010452:21036294,21010498:21035859,21010550:21035889', 'assoc_mat': '21010306:carton:3327:21029699,21010312:carton:3327:21031222,21010317:carton:3327:21032381,21010321:carton:3327:21033089,21010328:carton:3327:21034544,21010342:carton:3327:21035711,21010350:carton:3327:21036056,21010360:carton:3327:21036760,21010366:carton:3327:21037302,21010378:carton:3327:21038538,21010388:carton:3327:21085316,21010396:carton:3327:21038418,21010431:carton:3327:21038132,21010441:carton:3327:21036522,21010452:carton:3327:21036294,21010498:carton:3327:21035859,21010550:carton:3327:21035889'}, {'unwanted_material': 'ela', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.9151163407071976, 'nb_photo': 6, 'list_port_cont': '21031477,21037930,21042876,21044087', 'assoc_port': '21010314:21031477,21010374:21037930,21010450:21042876,21010564:21044087', 'assoc_mat': '21010314:ela:4203:21031477,21010374:ela:4203:21037930,21010450:ela:4203:21042876,21010564:ela:4203:21044087'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0018694521535402007, 'nb_photo': 4, 'list_port_cont': '21029750,21040682,21042431,21044156', 'assoc_port': '21010307:21029750,21010394:21040682,21010443:21042431,21010566:21044156', 'assoc_mat': '21010307:ela:4207:21029750,21010394:ela:4207:21040682,21010443:ela:4207:21042431,21010566:ela:4207:21044156'}, {'unwanted_material': 'ela', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.0016206325430104898, 'nb_photo': 1, 'list_port_cont': '21030072', 'assoc_port': '21010308:21030072', 'assoc_mat': '21010308:ela:4200:21030072'}, {'unwanted_material': 'ela', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.006309472191351706, 'nb_photo': 1, 'list_port_cont': '21038844', 'assoc_port': '21010382:21038844', 'assoc_mat': '21010382:ela:4209:21038844'}, {'unwanted_material': 'ela', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.00026899451835211605, 'nb_photo': 1, 'list_port_cont': '21037051', 'assoc_port': '21010364:21037051', 'assoc_mat': '21010364:ela:4211:21037051'}, {'unwanted_material': 'etiquette', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.009106779602764544, 'nb_photo': 80, 'list_port_cont': '21031482,21037925,21042874,21044085', 'assoc_port': '21010314:21031482,21010374:21037925,21010450:21042874,21010564:21044085', 'assoc_mat': '21010314:etiquette:4203:21031482,21010374:etiquette:4203:21037925,21010450:etiquette:4203:21042874,21010564:etiquette:4203:21044085'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.003015442989571786, 'nb_photo': 34, 'list_port_cont': '21029070,21029748,21031269,21032394,21033786,21034750,21036068,21037467,21038550,21039414,21040673,21041491,21041826,21042239,21042437,21043357,21044167,21083810', 'assoc_port': '21010292:21029070,21010307:21029748,21010313:21031269,21010318:21032394,21010325:21033786,21010327:21083810,21010334:21034750,21010352:21036068,21010370:21037467,21010380:21038550,21010386:21039414,21010394:21040673,21010423:21041491,21010427:21041826,21010439:21042239,21010443:21042437,21010467:21043357,21010566:21044167', 'assoc_mat': '21010292:etiquette:4207:21029070,21010307:etiquette:4207:21029748,21010313:etiquette:4207:21031269,21010318:etiquette:4207:21032394,21010325:etiquette:4207:21033786,21010327:etiquette:4207:21083810,21010334:etiquette:4207:21034750,21010352:etiquette:4207:21036068,21010370:etiquette:4207:21037467,21010380:etiquette:4207:21038550,21010386:etiquette:4207:21039414,21010394:etiquette:4207:21040673,21010423:etiquette:4207:21041491,21010427:etiquette:4207:21041826,21010439:etiquette:4207:21042239,21010443:etiquette:4207:21042437,21010467:etiquette:4207:21043357,21010566:etiquette:4207:21044167'}, {'unwanted_material': 'etiquette', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0006093541501455973, 'nb_photo': 9, 'list_port_cont': '20312934,21030899,21034105,21035539,21037441,21043568', 'assoc_port': '20173925:20312934,21010311:21030899,21010326:21034105,21010340:21035539,21010368:21037441,21010469:21043568', 'assoc_mat': '20173925:etiquette:4461:20312934,21010311:etiquette:4461:21030899,21010326:etiquette:4461:21034105,21010340:etiquette:4461:21035539,21010368:etiquette:4461:21037441,21010469:etiquette:4461:21043568'}, {'unwanted_material': 'etiquette', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.013267832335298473, 'nb_photo': 119, 'list_port_cont': '21030059,21033212,21034686,21035959,21036890,21037793,21040159,21041787,21042356,21042792,21043694,21043925,21083756', 'assoc_port': '21010308:21030059,21010315:21083756,21010322:21033212,21010332:21034686,21010348:21035959,21010362:21036890,21010372:21037793,21010390:21040159,21010424:21041787,21010437:21042356,21010447:21042792,21010472:21043694,21010560:21043925', 'assoc_mat': '21010308:etiquette:4200:21030059,21010315:etiquette:4200:21083756,21010322:etiquette:4200:21033212,21010332:etiquette:4200:21034686,21010348:etiquette:4200:21035959,21010362:etiquette:4200:21036890,21010372:etiquette:4200:21037793,21010390:etiquette:4200:21040159,21010424:etiquette:4200:21041787,21010437:etiquette:4200:21042356,21010447:etiquette:4200:21042792,21010472:etiquette:4200:21043694,21010560:etiquette:4200:21043925'}, {'unwanted_material': 'etiquette', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.03676237489295385, 'nb_photo': 12, 'list_port_cont': '21038840', 'assoc_port': '21010382:21038840', 'assoc_mat': '21010382:etiquette:4209:21038840'}, {'unwanted_material': 'etiquette', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.004481208781733734, 'nb_photo': 8, 'list_port_cont': '21032008,21033561,21036492,21037968,21040915', 'assoc_port': '21010316:21032008,21010324:21033561,21010358:21036492,21010375:21037968,21010395:21040915', 'assoc_mat': '21010316:etiquette:4207:21032008,21010324:etiquette:4207:21033561,21010358:etiquette:4207:21036492,21010375:etiquette:4207:21037968,21010395:etiquette:4207:21040915'}, {'unwanted_material': 'etiquette', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.002341784187271578, 'nb_photo': 356, 'list_port_cont': '21030303,21032589,21033383,21034573,21035867,21037059,21038113,21040329,21041112,21043245,21043279', 'assoc_port': '21010309:21030303,21010319:21032589,21010323:21033383,21010330:21034573,21010346:21035867,21010364:21037059,21010376:21038113,21010392:21040329,21010421:21041112,21010464:21043279,21010552:21043245', 'assoc_mat': '21010309:etiquette:4211:21030303,21010319:etiquette:4211:21032589,21010323:etiquette:4211:21033383,21010330:etiquette:4211:21034573,21010346:etiquette:4211:21035867,21010364:etiquette:4211:21037059,21010376:etiquette:4211:21038113,21010392:etiquette:4211:21040329,21010421:etiquette:4211:21041112,21010464:etiquette:4211:21043279,21010552:etiquette:4211:21043245'}, {'unwanted_material': 'etiquette', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.002803324750750805, 'nb_photo': 8, 'list_port_cont': '21035854,21035890,21036295,21085313', 'assoc_port': '21010388:21085313,21010452:21036295,21010498:21035854,21010550:21035890', 'assoc_mat': '21010388:etiquette:3327:21085313,21010452:etiquette:3327:21036295,21010498:etiquette:3327:21035854,21010550:etiquette:3327:21035890'}, {'unwanted_material': 'film_plastique', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.011839179781624729, 'nb_photo': 2, 'list_port_cont': '21040397', 'assoc_port': '21010393:21040397', 'assoc_mat': '21010393:film_plastique:4205:21040397'}, {'unwanted_material': 'film_plastique', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.018436454170910443, 'nb_photo': 47, 'list_port_cont': '21031479,21037924,21042879,21044091', 'assoc_port': '21010314:21031479,21010374:21037924,21010450:21042879,21010564:21044091', 'assoc_mat': '21010314:film_plastique:4203:21031479,21010374:film_plastique:4203:21037924,21010450:film_plastique:4203:21042879,21010564:film_plastique:4203:21044091'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0014777524188785492, 'nb_photo': 19, 'list_port_cont': '20174433,21029073,21029763,21030524,21036074,21038556,21039402,21042228,21043364,21044154', 'assoc_port': '20173926:20174433,21010292:21029073,21010307:21029763,21010310:21030524,21010352:21036074,21010380:21038556,21010386:21039402,21010439:21042228,21010467:21043364,21010566:21044154', 'assoc_mat': '20173926:film_plastique:4207:20174433,21010292:film_plastique:4207:21029073,21010307:film_plastique:4207:21029763,21010310:film_plastique:4207:21030524,21010352:film_plastique:4207:21036074,21010380:film_plastique:4207:21038556,21010386:film_plastique:4207:21039402,21010439:film_plastique:4207:21042228,21010467:film_plastique:4207:21043364,21010566:film_plastique:4207:21044154'}, {'unwanted_material': 'film_plastique', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.8143348545258149, 'nb_photo': 277, 'list_port_cont': '20312924,21030909,21032990,21034106,21035538,21036257,21037433,21039265,21041925,21043070,21043570,21043722,21086586', 'assoc_port': '20173925:20312924,21010311:21030909,21010320:21032990,21010326:21034106,21010340:21035538,21010354:21036257,21010368:21037433,21010384:21039265,21010422:21086586,21010433:21041925,21010459:21043070,21010469:21043570,21010557:21043722', 'assoc_mat': '20173925:film_plastique:4461:20312924,21010311:film_plastique:4461:21030909,21010320:film_plastique:4461:21032990,21010326:film_plastique:4461:21034106,21010340:film_plastique:4461:21035538,21010354:film_plastique:4461:21036257,21010368:film_plastique:4461:21037433,21010384:film_plastique:4461:21039265,21010422:film_plastique:4461:21086586,21010433:film_plastique:4461:21041925,21010459:film_plastique:4461:21043070,21010469:film_plastique:4461:21043570,21010557:film_plastique:4461:21043722'}, {'unwanted_material': 'film_plastique', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.03727661718965066, 'nb_photo': 123, 'list_port_cont': '21030068,21033214,21034694,21035944,21036888,21037794,21040154,21041789,21042351,21042796,21043699,21043930,21083752', 'assoc_port': '21010308:21030068,21010315:21083752,21010322:21033214,21010332:21034694,21010348:21035944,21010362:21036888,21010372:21037794,21010390:21040154,21010424:21041789,21010437:21042351,21010447:21042796,21010472:21043699,21010560:21043930', 'assoc_mat': '21010308:film_plastique:4200:21030068,21010315:film_plastique:4200:21083752,21010322:film_plastique:4200:21033214,21010332:film_plastique:4200:21034694,21010348:film_plastique:4200:21035944,21010362:film_plastique:4200:21036888,21010372:film_plastique:4200:21037794,21010390:film_plastique:4200:21040154,21010424:film_plastique:4200:21041789,21010437:film_plastique:4200:21042351,21010447:film_plastique:4200:21042796,21010472:film_plastique:4200:21043699,21010560:film_plastique:4200:21043930'}, {'unwanted_material': 'film_plastique', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.005534743822594581, 'nb_photo': 1, 'list_port_cont': '21038845', 'assoc_port': '21010382:21038845', 'assoc_mat': '21010382:film_plastique:4209:21038845'}, {'unwanted_material': 'film_plastique', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.0027690375877441383, 'nb_photo': 6, 'list_port_cont': '21029191,21031996,21034993,21036488,21040917', 'assoc_port': '21010305:21029191,21010316:21031996,21010336:21034993,21010358:21036488,21010395:21040917', 'assoc_mat': '21010305:film_plastique:4207:21029191,21010316:film_plastique:4207:21031996,21010336:film_plastique:4207:21034993,21010358:film_plastique:4207:21036488,21010395:film_plastique:4207:21040917'}, {'unwanted_material': 'film_plastique', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0007897699378908007, 'nb_photo': 36, 'list_port_cont': '21030301,21032593,21033372,21034566,21035877,21037058,21038115,21040326,21041102,21043237,21043270', 'assoc_port': '21010309:21030301,21010319:21032593,21010323:21033372,21010330:21034566,21010346:21035877,21010364:21037058,21010376:21038115,21010392:21040326,21010421:21041102,21010464:21043270,21010552:21043237', 'assoc_mat': '21010309:film_plastique:4211:21030301,21010319:film_plastique:4211:21032593,21010323:film_plastique:4211:21033372,21010330:film_plastique:4211:21034566,21010346:film_plastique:4211:21035877,21010364:film_plastique:4211:21037058,21010376:film_plastique:4211:21038115,21010392:film_plastique:4211:21040326,21010421:film_plastique:4211:21041102,21010464:film_plastique:4211:21043270,21010552:film_plastique:4211:21043237'}, {'unwanted_material': 'kraft', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0012813714844512707, 'nb_photo': 1, 'list_port_cont': '21042878', 'assoc_port': '21010450:21042878', 'assoc_mat': '21010450:kraft:4203:21042878'}, {'unwanted_material': 'kraft', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.005767812448563143, 'nb_photo': 4, 'list_port_cont': '21033777,21042443,21083815', 'assoc_port': '21010325:21033777,21010327:21083815,21010443:21042443', 'assoc_mat': '21010325:kraft:4207:21033777,21010327:kraft:4207:21083815,21010443:kraft:4207:21042443'}, {'unwanted_material': 'kraft', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.0005493522841139184, 'nb_photo': 1, 'list_port_cont': '21043690', 'assoc_port': '21010472:21043690', 'assoc_mat': '21010472:kraft:4200:21043690'}, {'unwanted_material': 'metal', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.006465450880125157, 'nb_photo': 15, 'list_port_cont': '21031492,21037931,21042887,21044092', 'assoc_port': '21010314:21031492,21010374:21037931,21010450:21042887,21010564:21044092', 'assoc_mat': '21010314:metal:4203:21031492,21010374:metal:4203:21037931,21010450:metal:4203:21042887,21010564:metal:4203:21044092'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0045995841829128215, 'nb_photo': 4, 'list_port_cont': '21032393,21040670,21041484,21044157', 'assoc_port': '21010318:21032393,21010394:21040670,21010423:21041484,21010566:21044157', 'assoc_mat': '21010318:metal:4207:21032393,21010394:metal:4207:21040670,21010423:metal:4207:21041484,21010566:metal:4207:21044157'}, {'unwanted_material': 'metal', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.02610430778191755, 'nb_photo': 7, 'list_port_cont': '21035537,21036256,21039262,21041928,21043076', 'assoc_port': '21010340:21035537,21010354:21036256,21010384:21039262,21010433:21041928,21010459:21043076', 'assoc_mat': '21010340:metal:4461:21035537,21010354:metal:4461:21036256,21010384:metal:4461:21039262,21010433:metal:4461:21041928,21010459:metal:4461:21043076'}, {'unwanted_material': 'metal', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.08124522911451959, 'nb_photo': 50, 'list_port_cont': '21030071,21033215,21034693,21035949,21037784,21040155,21041785,21042364,21042791,21043697,21043935,21083760', 'assoc_port': '21010308:21030071,21010315:21083760,21010322:21033215,21010332:21034693,21010348:21035949,21010372:21037784,21010390:21040155,21010424:21041785,21010437:21042364,21010447:21042791,21010472:21043697,21010560:21043935', 'assoc_mat': '21010308:metal:4200:21030071,21010315:metal:4200:21083760,21010322:metal:4200:21033215,21010332:metal:4200:21034693,21010348:metal:4200:21035949,21010372:metal:4200:21037784,21010390:metal:4200:21040155,21010424:metal:4200:21041785,21010437:metal:4200:21042364,21010447:metal:4200:21042791,21010472:metal:4200:21043697,21010560:metal:4200:21043935'}, {'unwanted_material': 'metal', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.012232553190902004, 'nb_photo': 1, 'list_port_cont': '21038848', 'assoc_port': '21010382:21038848', 'assoc_mat': '21010382:metal:4209:21038848'}, {'unwanted_material': 'metal', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.00519284624947138, 'nb_photo': 4, 'list_port_cont': '21029186,21033569,21040923', 'assoc_port': '21010305:21029186,21010324:21033569,21010395:21040923', 'assoc_mat': '21010305:metal:4207:21029186,21010324:metal:4207:21033569,21010395:metal:4207:21040923'}, {'unwanted_material': 'metal', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.012458277196351918, 'nb_photo': 68, 'list_port_cont': '21030313,21032588,21033367,21034571,21035878,21037046,21038128,21040327,21041104,21043248,21043265', 'assoc_port': '21010309:21030313,21010319:21032588,21010323:21033367,21010330:21034571,21010346:21035878,21010364:21037046,21010376:21038128,21010392:21040327,21010421:21041104,21010464:21043265,21010552:21043248', 'assoc_mat': '21010309:metal:4211:21030313,21010319:metal:4211:21032588,21010323:metal:4211:21033367,21010330:metal:4211:21034571,21010346:metal:4211:21035878,21010364:metal:4211:21037046,21010376:metal:4211:21038128,21010392:metal:4211:21040327,21010421:metal:4211:21041104,21010464:metal:4211:21043265,21010552:metal:4211:21043248'}, {'unwanted_material': 'metal', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0031080083884743605, 'nb_photo': 5, 'list_port_cont': '21035721,21035900,21036751,21037303', 'assoc_port': '21010342:21035721,21010360:21036751,21010366:21037303,21010550:21035900', 'assoc_mat': '21010342:metal:3327:21035721,21010360:metal:3327:21036751,21010366:metal:3327:21037303,21010550:metal:3327:21035900'}, {'unwanted_material': 'papier', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.03225024570297771, 'nb_photo': 12, 'list_port_cont': '21040400', 'assoc_port': '21010393:21040400', 'assoc_mat': '21010393:papier:4205:21040400'}, {'unwanted_material': 'papier', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.015594966263082799, 'nb_photo': 70, 'list_port_cont': '21031490,21037926,21042875,21044094', 'assoc_port': '21010314:21031490,21010374:21037926,21010450:21042875,21010564:21044094', 'assoc_mat': '21010314:papier:4203:21031490,21010374:papier:4203:21037926,21010450:papier:4203:21042875,21010564:papier:4203:21044094'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.05367087452335126, 'nb_photo': 767, 'list_port_cont': '20174436,21029071,21029752,21030534,21031274,21032398,21033783,21034753,21035234,21035755,21036079,21036304,21037469,21038552,21039412,21040671,21041477,21041819,21042233,21042438,21043362,21044163,21083817', 'assoc_port': '20173926:20174436,21010292:21029071,21010307:21029752,21010310:21030534,21010313:21031274,21010318:21032398,21010325:21033783,21010327:21083817,21010334:21034753,21010338:21035234,21010344:21035755,21010352:21036079,21010356:21036304,21010370:21037469,21010380:21038552,21010386:21039412,21010394:21040671,21010423:21041477,21010427:21041819,21010439:21042233,21010443:21042438,21010467:21043362,21010566:21044163', 'assoc_mat': '20173926:papier:4207:20174436,21010292:papier:4207:21029071,21010307:papier:4207:21029752,21010310:papier:4207:21030534,21010313:papier:4207:21031274,21010318:papier:4207:21032398,21010325:papier:4207:21033783,21010327:papier:4207:21083817,21010334:papier:4207:21034753,21010338:papier:4207:21035234,21010344:papier:4207:21035755,21010352:papier:4207:21036079,21010356:papier:4207:21036304,21010370:papier:4207:21037469,21010380:papier:4207:21038552,21010386:papier:4207:21039412,21010394:papier:4207:21040671,21010423:papier:4207:21041477,21010427:papier:4207:21041819,21010439:papier:4207:21042233,21010443:papier:4207:21042438,21010467:papier:4207:21043362,21010566:papier:4207:21044163'}, {'unwanted_material': 'papier', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.16075861172221145, 'nb_photo': 1652, 'list_port_cont': '20312931,21030906,21032980,21034109,21035545,21036252,21037438,21039257,21041930,21043072,21043575,21043724,21086582', 'assoc_port': '20173925:20312931,21010311:21030906,21010320:21032980,21010326:21034109,21010340:21035545,21010354:21036252,21010368:21037438,21010384:21039257,21010422:21086582,21010433:21041930,21010459:21043072,21010469:21043575,21010557:21043724', 'assoc_mat': '20173925:papier:4461:20312931,21010311:papier:4461:21030906,21010320:papier:4461:21032980,21010326:papier:4461:21034109,21010340:papier:4461:21035545,21010354:papier:4461:21036252,21010368:papier:4461:21037438,21010384:papier:4461:21039257,21010422:papier:4461:21086582,21010433:papier:4461:21041930,21010459:papier:4461:21043072,21010469:papier:4461:21043575,21010557:papier:4461:21043724'}, {'unwanted_material': 'papier', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.054568854807388836, 'nb_photo': 269, 'list_port_cont': '21030070,21033218,21034687,21035947,21036891,21037781,21040150,21041793,21042358,21042801,21043686,21043933,21083755', 'assoc_port': '21010308:21030070,21010315:21083755,21010322:21033218,21010332:21034687,21010348:21035947,21010362:21036891,21010372:21037781,21010390:21040150,21010424:21041793,21010437:21042358,21010447:21042801,21010472:21043686,21010560:21043933', 'assoc_mat': '21010308:papier:4200:21030070,21010315:papier:4200:21083755,21010322:papier:4200:21033218,21010332:papier:4200:21034687,21010348:papier:4200:21035947,21010362:papier:4200:21036891,21010372:papier:4200:21037781,21010390:papier:4200:21040150,21010424:papier:4200:21041793,21010437:papier:4200:21042358,21010447:papier:4200:21042801,21010472:papier:4200:21043686,21010560:papier:4200:21043933'}, {'unwanted_material': 'papier', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.9236559702801899, 'nb_photo': 121, 'list_port_cont': '21038838', 'assoc_port': '21010382:21038838', 'assoc_mat': '21010382:papier:4209:21038838'}, {'unwanted_material': 'papier', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.05064937838251356, 'nb_photo': 132, 'list_port_cont': '21029188,21032004,21033563,21035002,21036487,21037974,21040914', 'assoc_port': '21010305:21029188,21010316:21032004,21010324:21033563,21010336:21035002,21010358:21036487,21010375:21037974,21010395:21040914', 'assoc_mat': '21010305:papier:4207:21029188,21010316:papier:4207:21032004,21010324:papier:4207:21033563,21010336:papier:4207:21035002,21010358:papier:4207:21036487,21010375:papier:4207:21037974,21010395:papier:4207:21040914'}, {'unwanted_material': 'papier', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.006372956461625042, 'nb_photo': 246, 'list_port_cont': '21030309,21032584,21033382,21034562,21035882,21037053,21038122,21040323,21041107,21043233,21043267', 'assoc_port': '21010309:21030309,21010319:21032584,21010323:21033382,21010330:21034562,21010346:21035882,21010364:21037053,21010376:21038122,21010392:21040323,21010421:21041107,21010464:21043267,21010552:21043233', 'assoc_mat': '21010309:papier:4211:21030309,21010319:papier:4211:21032584,21010323:papier:4211:21033382,21010330:papier:4211:21034562,21010346:papier:4211:21035882,21010364:papier:4211:21037053,21010376:papier:4211:21038122,21010392:papier:4211:21040323,21010421:papier:4211:21041107,21010464:papier:4211:21043267,21010552:papier:4211:21043233'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.03703120138733584, 'nb_photo': 219, 'list_port_cont': '21029702,21031224,21032379,21033093,21034551,21035710,21035860,21035894,21036064,21036287,21036527,21036756,21037310,21038135,21038426,21038539,21085315', 'assoc_port': '21010306:21029702,21010312:21031224,21010317:21032379,21010321:21033093,21010328:21034551,21010342:21035710,21010350:21036064,21010360:21036756,21010366:21037310,21010378:21038539,21010388:21085315,21010396:21038426,21010431:21038135,21010441:21036527,21010452:21036287,21010498:21035860,21010550:21035894', 'assoc_mat': '21010306:papier:3327:21029702,21010312:papier:3327:21031224,21010317:papier:3327:21032379,21010321:papier:3327:21033093,21010328:papier:3327:21034551,21010342:papier:3327:21035710,21010350:papier:3327:21036064,21010360:papier:3327:21036756,21010366:papier:3327:21037310,21010378:papier:3327:21038539,21010388:papier:3327:21085315,21010396:papier:3327:21038426,21010431:papier:3327:21038135,21010441:papier:3327:21036527,21010452:papier:3327:21036287,21010498:papier:3327:21035860,21010550:papier:3327:21035894'}, {'unwanted_material': 'pehd', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.009607816901545146, 'nb_photo': 1, 'list_port_cont': '21043080', 'assoc_port': '21010459:21043080', 'assoc_mat': '21010459:pehd:4461:21043080'}, {'unwanted_material': 'pehd', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.044279818769473143, 'nb_photo': 3, 'list_port_cont': '21042365,21043926', 'assoc_port': '21010437:21042365,21010560:21043926', 'assoc_mat': '21010437:pehd:4200:21042365,21010560:pehd:4200:21043926'}, {'unwanted_material': 'pehd', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.00548892601853799, 'nb_photo': 10, 'list_port_cont': '21031228,21032372,21036297,21036525,21038143', 'assoc_port': '21010312:21031228,21010317:21032372,21010431:21038143,21010441:21036525,21010452:21036297', 'assoc_mat': '21010312:pehd:3327:21031228,21010317:pehd:3327:21032372,21010431:pehd:3327:21038143,21010441:pehd:3327:21036525,21010452:pehd:3327:21036297'}, {'unwanted_material': 'pet_clair', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.007971287749184737, 'nb_photo': 1, 'list_port_cont': '21040389', 'assoc_port': '21010393:21040389', 'assoc_mat': '21010393:pet_clair:4205:21040389'}, {'unwanted_material': 'pet_clair', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.009746342447344245, 'nb_photo': 15, 'list_port_cont': '21031487,21042881,21044095', 'assoc_port': '21010314:21031487,21010450:21042881,21010564:21044095', 'assoc_mat': '21010314:pet_clair:4203:21031487,21010450:pet_clair:4203:21042881,21010564:pet_clair:4203:21044095'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0035627391253297567, 'nb_photo': 5, 'list_port_cont': '21030527,21035748,21037465,21043368', 'assoc_port': '21010310:21030527,21010344:21035748,21010370:21037465,21010467:21043368', 'assoc_mat': '21010310:pet_clair:4207:21030527,21010344:pet_clair:4207:21035748,21010370:pet_clair:4207:21037465,21010467:pet_clair:4207:21043368'}, {'unwanted_material': 'pet_clair', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.03419825029433667, 'nb_photo': 75, 'list_port_cont': '21030073,21033213,21034688,21035955,21036886,21037790,21040160,21041794,21042352,21042797,21043687,21043928,21083758', 'assoc_port': '21010308:21030073,21010315:21083758,21010322:21033213,21010332:21034688,21010348:21035955,21010362:21036886,21010372:21037790,21010390:21040160,21010424:21041794,21010437:21042352,21010447:21042797,21010472:21043687,21010560:21043928', 'assoc_mat': '21010308:pet_clair:4200:21030073,21010315:pet_clair:4200:21083758,21010322:pet_clair:4200:21033213,21010332:pet_clair:4200:21034688,21010348:pet_clair:4200:21035955,21010362:pet_clair:4200:21036886,21010372:pet_clair:4200:21037790,21010390:pet_clair:4200:21040160,21010424:pet_clair:4200:21041794,21010437:pet_clair:4200:21042352,21010447:pet_clair:4200:21042797,21010472:pet_clair:4200:21043687,21010560:pet_clair:4200:21043928'}, {'unwanted_material': 'pet_clair', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0005903849862339631, 'nb_photo': 7, 'list_port_cont': '21033375,21035880,21040317,21041108,21043232,21043268', 'assoc_port': '21010323:21033375,21010346:21035880,21010392:21040317,21010421:21041108,21010464:21043268,21010552:21043232', 'assoc_mat': '21010323:pet_clair:4211:21033375,21010346:pet_clair:4211:21035880,21010392:pet_clair:4211:21040317,21010421:pet_clair:4211:21041108,21010464:pet_clair:4211:21043268,21010552:pet_clair:4211:21043232'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.847432448298875, 'nb_photo': 2436, 'list_port_cont': '21029700,21031230,21032382,21033094,21034555,21035717,21035857,21035898,21036062,21036290,21036529,21036761,21037315,21038142,21038427,21038527,21085306', 'assoc_port': '21010306:21029700,21010312:21031230,21010317:21032382,21010321:21033094,21010328:21034555,21010342:21035717,21010350:21036062,21010360:21036761,21010366:21037315,21010378:21038527,21010388:21085306,21010396:21038427,21010431:21038142,21010441:21036529,21010452:21036290,21010498:21035857,21010550:21035898', 'assoc_mat': '21010306:pet_clair:3327:21029700,21010312:pet_clair:3327:21031230,21010317:pet_clair:3327:21032382,21010321:pet_clair:3327:21033094,21010328:pet_clair:3327:21034555,21010342:pet_clair:3327:21035717,21010350:pet_clair:3327:21036062,21010360:pet_clair:3327:21036761,21010366:pet_clair:3327:21037315,21010378:pet_clair:3327:21038527,21010388:pet_clair:3327:21085306,21010396:pet_clair:3327:21038427,21010431:pet_clair:3327:21038142,21010441:pet_clair:3327:21036529,21010452:pet_clair:3327:21036290,21010498:pet_clair:3327:21035857,21010550:pet_clair:3327:21035898'}, {'unwanted_material': 'pet_fonce', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0006619494919741627, 'nb_photo': 2, 'list_port_cont': '21037922,21042884', 'assoc_port': '21010374:21037922,21010450:21042884', 'assoc_mat': '21010374:pet_fonce:4203:21037922,21010450:pet_fonce:4203:21042884'}, {'unwanted_material': 'pet_fonce', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.6936070240649872, 'nb_photo': 153, 'list_port_cont': '21030064,21033208,21034690,21035950,21036878,21037787,21040148,21041796,21042354,21042787,21043696,21043936,21083753', 'assoc_port': '21010308:21030064,21010315:21083753,21010322:21033208,21010332:21034690,21010348:21035950,21010362:21036878,21010372:21037787,21010390:21040148,21010424:21041796,21010437:21042354,21010447:21042787,21010472:21043696,21010560:21043936', 'assoc_mat': '21010308:pet_fonce:4200:21030064,21010315:pet_fonce:4200:21083753,21010322:pet_fonce:4200:21033208,21010332:pet_fonce:4200:21034690,21010348:pet_fonce:4200:21035950,21010362:pet_fonce:4200:21036878,21010372:pet_fonce:4200:21037787,21010390:pet_fonce:4200:21040148,21010424:pet_fonce:4200:21041796,21010437:pet_fonce:4200:21042354,21010447:pet_fonce:4200:21042787,21010472:pet_fonce:4200:21043696,21010560:pet_fonce:4200:21043936'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.00172681378889089, 'nb_photo': 22, 'list_port_cont': '21030308,21032600,21034559,21035872,21037047,21038117,21041115,21043236,21043275', 'assoc_port': '21010309:21030308,21010319:21032600,21010330:21034559,21010346:21035872,21010364:21037047,21010376:21038117,21010421:21041115,21010464:21043275,21010552:21043236', 'assoc_mat': '21010309:pet_fonce:4211:21030308,21010319:pet_fonce:4211:21032600,21010330:pet_fonce:4211:21034559,21010346:pet_fonce:4211:21035872,21010364:pet_fonce:4211:21037047,21010376:pet_fonce:4211:21038117,21010421:pet_fonce:4211:21041115,21010464:pet_fonce:4211:21043275,21010552:pet_fonce:4211:21043236'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.02494615120234525, 'nb_photo': 83, 'list_port_cont': '21029708,21031223,21032375,21033102,21034556,21035722,21035863,21035888,21036059,21036289,21036528,21036759,21037306,21038138,21038416,21038537,21085304', 'assoc_port': '21010306:21029708,21010312:21031223,21010317:21032375,21010321:21033102,21010328:21034556,21010342:21035722,21010350:21036059,21010360:21036759,21010366:21037306,21010378:21038537,21010388:21085304,21010396:21038416,21010431:21038138,21010441:21036528,21010452:21036289,21010498:21035863,21010550:21035888', 'assoc_mat': '21010306:pet_fonce:3327:21029708,21010312:pet_fonce:3327:21031223,21010317:pet_fonce:3327:21032375,21010321:pet_fonce:3327:21033102,21010328:pet_fonce:3327:21034556,21010342:pet_fonce:3327:21035722,21010350:pet_fonce:3327:21036059,21010360:pet_fonce:3327:21036759,21010366:pet_fonce:3327:21037306,21010378:pet_fonce:3327:21038537,21010388:pet_fonce:3327:21085304,21010396:pet_fonce:3327:21038416,21010431:pet_fonce:3327:21038138,21010441:pet_fonce:3327:21036528,21010452:pet_fonce:3327:21036289,21010498:pet_fonce:3327:21035863,21010550:pet_fonce:3327:21035888'}, {'unwanted_material': 'pet_opaque', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.010594561785623425, 'nb_photo': 21, 'list_port_cont': '21031485,21037921,21042877,21044097', 'assoc_port': '21010314:21031485,21010374:21037921,21010450:21042877,21010564:21044097', 'assoc_mat': '21010314:pet_opaque:4203:21031485,21010374:pet_opaque:4203:21037921,21010450:pet_opaque:4203:21042877,21010564:pet_opaque:4203:21044097'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.009583707410178685, 'nb_photo': 27, 'list_port_cont': '21029755,21030528,21033780,21034744,21035232,21036076,21037476,21040685,21041486,21041827,21042434,21043369,21044168,21083819', 'assoc_port': '21010307:21029755,21010310:21030528,21010325:21033780,21010327:21083819,21010334:21034744,21010338:21035232,21010352:21036076,21010370:21037476,21010394:21040685,21010423:21041486,21010427:21041827,21010443:21042434,21010467:21043369,21010566:21044168', 'assoc_mat': '21010307:pet_opaque:4207:21029755,21010310:pet_opaque:4207:21030528,21010325:pet_opaque:4207:21033780,21010327:pet_opaque:4207:21083819,21010334:pet_opaque:4207:21034744,21010338:pet_opaque:4207:21035232,21010352:pet_opaque:4207:21036076,21010370:pet_opaque:4207:21037476,21010394:pet_opaque:4207:21040685,21010423:pet_opaque:4207:21041486,21010427:pet_opaque:4207:21041827,21010443:pet_opaque:4207:21042434,21010467:pet_opaque:4207:21043369,21010566:pet_opaque:4207:21044168'}, {'unwanted_material': 'pet_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.005704754141438969, 'nb_photo': 8, 'list_port_cont': '21030898,21034101,21035548,21037447,21043571,21086583', 'assoc_port': '21010311:21030898,21010326:21034101,21010340:21035548,21010368:21037447,21010422:21086583,21010469:21043571', 'assoc_mat': '21010311:pet_opaque:4461:21030898,21010326:pet_opaque:4461:21034101,21010340:pet_opaque:4461:21035548,21010368:pet_opaque:4461:21037447,21010422:pet_opaque:4461:21086583,21010469:pet_opaque:4461:21043571'}, {'unwanted_material': 'pet_opaque', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.04622505132349525, 'nb_photo': 295, 'list_port_cont': '21030063,21033221,21034692,21035956,21036882,21037786,21040153,21041790,21042362,21042786,21043698,21043927,21083765', 'assoc_port': '21010308:21030063,21010315:21083765,21010322:21033221,21010332:21034692,21010348:21035956,21010362:21036882,21010372:21037786,21010390:21040153,21010424:21041790,21010437:21042362,21010447:21042786,21010472:21043698,21010560:21043927', 'assoc_mat': '21010308:pet_opaque:4200:21030063,21010315:pet_opaque:4200:21083765,21010322:pet_opaque:4200:21033221,21010332:pet_opaque:4200:21034692,21010348:pet_opaque:4200:21035956,21010362:pet_opaque:4200:21036882,21010372:pet_opaque:4200:21037786,21010390:pet_opaque:4200:21040153,21010424:pet_opaque:4200:21041790,21010437:pet_opaque:4200:21042362,21010447:pet_opaque:4200:21042786,21010472:pet_opaque:4200:21043698,21010560:pet_opaque:4200:21043927'}, {'unwanted_material': 'pet_opaque', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.004549505586243793, 'nb_photo': 2, 'list_port_cont': '21034997', 'assoc_port': '21010336:21034997', 'assoc_mat': '21010336:pet_opaque:4207:21034997'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.003027563038637962, 'nb_photo': 80, 'list_port_cont': '21030316,21032585,21033368,21034560,21035881,21037049,21038112,21040328,21041109,21043242,21043273', 'assoc_port': '21010309:21030316,21010319:21032585,21010323:21033368,21010330:21034560,21010346:21035881,21010364:21037049,21010376:21038112,21010392:21040328,21010421:21041109,21010464:21043273,21010552:21043242', 'assoc_mat': '21010309:pet_opaque:4211:21030316,21010319:pet_opaque:4211:21032585,21010323:pet_opaque:4211:21033368,21010330:pet_opaque:4211:21034560,21010346:pet_opaque:4211:21035881,21010364:pet_opaque:4211:21037049,21010376:pet_opaque:4211:21038112,21010392:pet_opaque:4211:21040328,21010421:pet_opaque:4211:21041109,21010464:pet_opaque:4211:21043273,21010552:pet_opaque:4211:21043242'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.0010557625171375255, 'nb_photo': 1, 'list_port_cont': '21030061', 'assoc_port': '21010308:21030061', 'assoc_mat': '21010308:textiles_sanitaires:4200:21030061'}), 'main_stat': {'nb_photos': 914}}, 'hostname': (('jetson-116',),), 'impurety_average_per_hashtag': []} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4323 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4323 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4323 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4323 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4748 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4748 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4748 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4748 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13185 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13193 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13194 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13189 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13189 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13191 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13192 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13197 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13197 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13188 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13187 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13187 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13196 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13188 doesn't seem to be define in the database( WARNING : type of input 3 of step 13187 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13185 doesn't seem to be define in the database( WARNING : type of input 2 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13185 have datatype=16 whereas input 0 of step 13192 have datatype=1 WARNING : output 1 of step 13185 have datatype=2 whereas input 1 of step 13192 have datatype=7 WARNING : output 0 of step 13191 have datatype=6 whereas input 2 of step 13192 have datatype=5 WARNING : type of output 2 of step 13192 doesn't seem to be define in the database( WARNING : type of input 1 of step 13186 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13188 have datatype=10 whereas input 3 of step 13195 have datatype=6 WARNING : type of input 2 of step 13197 doesn't seem to be define in the database( WARNING : output 1 of step 13186 have datatype=7 whereas input 2 of step 13197 have datatype=None WARNING : type of output 3 of step 13197 doesn't seem to be define in the database( WARNING : type of input 1 of step 13188 doesn't seem to be define in the database( WARNING : output 0 of step 13188 have datatype=10 whereas input 0 of step 13198 have datatype=18 WARNING : type of input 5 of step 13195 doesn't seem to be define in the database( WARNING : output 0 of step 13198 have datatype=11 whereas input 5 of step 13195 have datatype=None WARNING : type of output 1 of step 13193 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : type of output 1 of step 13194 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13192 have datatype=1 whereas input 0 of step 13186 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,textiles_sanitaires,pet_clair', 'hashtag_parmi': 'pet_fonce,barquette_opaque,pet_opaque', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_mm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4323 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4323 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4323 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4323 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4748 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4748 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4748 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4748 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13185 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13193 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13194 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13189 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13189 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13191 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13192 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13197 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13197 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13188 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13187 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13187 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13196 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13188 doesn't seem to be define in the database( WARNING : type of input 3 of step 13187 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13185 doesn't seem to be define in the database( WARNING : type of input 2 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13185 have datatype=16 whereas input 0 of step 13192 have datatype=1 WARNING : output 1 of step 13185 have datatype=2 whereas input 1 of step 13192 have datatype=7 WARNING : output 0 of step 13191 have datatype=6 whereas input 2 of step 13192 have datatype=5 WARNING : type of output 2 of step 13192 doesn't seem to be define in the database( WARNING : type of input 1 of step 13186 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13188 have datatype=10 whereas input 3 of step 13195 have datatype=6 WARNING : type of input 2 of step 13197 doesn't seem to be define in the database( WARNING : output 1 of step 13186 have datatype=7 whereas input 2 of step 13197 have datatype=None WARNING : type of output 3 of step 13197 doesn't seem to be define in the database( WARNING : type of input 1 of step 13188 doesn't seem to be define in the database( WARNING : output 0 of step 13188 have datatype=10 whereas input 0 of step 13198 have datatype=18 WARNING : type of input 5 of step 13195 doesn't seem to be define in the database( WARNING : output 0 of step 13198 have datatype=11 whereas input 5 of step 13195 have datatype=None WARNING : type of output 1 of step 13193 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : type of output 1 of step 13194 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13192 have datatype=1 whereas input 0 of step 13186 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,textiles_sanitaires,pet_clair', 'hashtag_parmi': 'pet_fonce,barquette_opaque,pet_opaque', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((47,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('film_pedb', 36), ('emr', 11)), 'material_dict': {'film_pedb': 36, 'emr': 11}, 'coverage_data': (), 'impurety_average_data': ((datetime.date(2025, 2, 1), 0.1513534324516888, 36), (datetime.date(2025, 2, 28), 0.14092491554164796, 3)), 'impurety_average_data_per_hashtag': {'film_pedb': ((datetime.date(2025, 2, 1), 0.17615177657823766, 36), (datetime.date(2025, 2, 28), 0.18487235663560397, 15)), 'emr': ((datetime.date(2025, 2, 1), 0.07019521531025619, 11), (datetime.date(2025, 2, 28), 0.07154614168840505, 3)), 'gros_cartons': ((datetime.date(2025, 2, 28), 0.06013847222754778, 5),), 'pet_clair': ((datetime.date(2025, 2, 28), 0.1303773448044911, 7),), 'flux_dev_rigide': ((datetime.date(2025, 2, 28), 0.23721621854637853, 8),), 'pehd_pp': ((datetime.date(2025, 2, 28), 0.060769138614304885, 6),), 'ela': ((datetime.date(2025, 2, 28), 0.08570337501973148, 5),), 'gm': ((datetime.date(2025, 2, 28), 0.07634402971980936, 3),), 'aluminium': ((datetime.date(2025, 2, 28), 0.07070726140093016, 3),)}, 'quality_array': [['-2.6217089770648796', '01022025'], ['-2.4624289768963847', '28022025']], 'number_of_batch': ((90,),), 'datou_id_sts': 4323, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0278809465918396, 'nb_photo': 188, 'list_port_cont': '21029703,21031225,21032376,21033092,21034547,21035720,21035861,21035897,21036057,21036285,21036526,21036754,21037307,21038139,21038424,21038535,21085305', 'assoc_port': '21010306:21029703,21010312:21031225,21010317:21032376,21010321:21033092,21010328:21034547,21010342:21035720,21010350:21036057,21010360:21036754,21010366:21037307,21010378:21038535,21010388:21085305,21010396:21038424,21010431:21038139,21010441:21036526,21010452:21036285,21010498:21035861,21010550:21035897', 'assoc_mat': '21010306:autre:3327:21029703,21010312:autre:3327:21031225,21010317:autre:3327:21032376,21010321:autre:3327:21033092,21010328:autre:3327:21034547,21010342:autre:3327:21035720,21010350:autre:3327:21036057,21010360:autre:3327:21036754,21010366:autre:3327:21037307,21010378:autre:3327:21038535,21010388:autre:3327:21085305,21010396:autre:3327:21038424,21010431:autre:3327:21038139,21010441:autre:3327:21036526,21010452:autre:3327:21036285,21010498:autre:3327:21035861,21010550:autre:3327:21035897'}, {'unwanted_material': 'barquette_avec_film', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.00809577184012819, 'nb_photo': 13, 'list_port_cont': '21029701,21035865,21035896,21036293,21036520,21037313,21038144,21038415', 'assoc_port': '21010306:21029701,21010366:21037313,21010396:21038415,21010431:21038144,21010441:21036520,21010452:21036293,21010498:21035865,21010550:21035896', 'assoc_mat': '21010306:barquette_avec_film:3327:21029701,21010366:barquette_avec_film:3327:21037313,21010396:barquette_avec_film:3327:21038415,21010431:barquette_avec_film:3327:21038144,21010441:barquette_avec_film:3327:21036520,21010452:barquette_avec_film:3327:21036293,21010498:barquette_avec_film:3327:21035865,21010550:barquette_avec_film:3327:21035896'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.01145727820199558, 'nb_photo': 50, 'list_port_cont': '21031478,21037920,21042883,21044098', 'assoc_port': '21010314:21031478,21010374:21037920,21010450:21042883,21010564:21044098', 'assoc_mat': '21010314:barquette_opaque:4203:21031478,21010374:barquette_opaque:4203:21037920,21010450:barquette_opaque:4203:21042883,21010564:barquette_opaque:4203:21044098'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0031123100610556723, 'nb_photo': 28, 'list_port_cont': '21029075,21031284,21033774,21034754,21035756,21037466,21038549,21039413,21040683,21041483,21041828,21042240,21042442,21043356,21044153,21083811', 'assoc_port': '21010292:21029075,21010313:21031284,21010325:21033774,21010327:21083811,21010334:21034754,21010344:21035756,21010370:21037466,21010380:21038549,21010386:21039413,21010394:21040683,21010423:21041483,21010427:21041828,21010439:21042240,21010443:21042442,21010467:21043356,21010566:21044153', 'assoc_mat': '21010292:barquette_opaque:4207:21029075,21010313:barquette_opaque:4207:21031284,21010325:barquette_opaque:4207:21033774,21010327:barquette_opaque:4207:21083811,21010334:barquette_opaque:4207:21034754,21010344:barquette_opaque:4207:21035756,21010370:barquette_opaque:4207:21037466,21010380:barquette_opaque:4207:21038549,21010386:barquette_opaque:4207:21039413,21010394:barquette_opaque:4207:21040683,21010423:barquette_opaque:4207:21041483,21010427:barquette_opaque:4207:21041828,21010439:barquette_opaque:4207:21042240,21010443:barquette_opaque:4207:21042442,21010467:barquette_opaque:4207:21043356,21010566:barquette_opaque:4207:21044153'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.00937317366048873, 'nb_photo': 4, 'list_port_cont': '21032987,21036266,21037445,21043728', 'assoc_port': '21010320:21032987,21010354:21036266,21010368:21037445,21010557:21043728', 'assoc_mat': '21010320:barquette_opaque:4461:21032987,21010354:barquette_opaque:4461:21036266,21010368:barquette_opaque:4461:21037445,21010557:barquette_opaque:4461:21043728'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.01710100001005086, 'nb_photo': 78, 'list_port_cont': '21030062,21033211,21034680,21035953,21036893,21037782,21040151,21041792,21042357,21042800,21043685,21043937,21083764', 'assoc_port': '21010308:21030062,21010315:21083764,21010322:21033211,21010332:21034680,21010348:21035953,21010362:21036893,21010372:21037782,21010390:21040151,21010424:21041792,21010437:21042357,21010447:21042800,21010472:21043685,21010560:21043937', 'assoc_mat': '21010308:barquette_opaque:4200:21030062,21010315:barquette_opaque:4200:21083764,21010322:barquette_opaque:4200:21033211,21010332:barquette_opaque:4200:21034680,21010348:barquette_opaque:4200:21035953,21010362:barquette_opaque:4200:21036893,21010372:barquette_opaque:4200:21037782,21010390:barquette_opaque:4200:21040151,21010424:barquette_opaque:4200:21041792,21010437:barquette_opaque:4200:21042357,21010447:barquette_opaque:4200:21042800,21010472:barquette_opaque:4200:21043685,21010560:barquette_opaque:4200:21043937'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.0037650287188941618, 'nb_photo': 1, 'list_port_cont': '21038851', 'assoc_port': '21010382:21038851', 'assoc_mat': '21010382:barquette_opaque:4209:21038851'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.0026449854782722554, 'nb_photo': 2, 'list_port_cont': '21031995,21036490', 'assoc_port': '21010316:21031995,21010358:21036490', 'assoc_mat': '21010316:barquette_opaque:4207:21031995,21010358:barquette_opaque:4207:21036490'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.036866855499123524, 'nb_photo': 419, 'list_port_cont': '21030315,21032594,21033378,21034558,21035870,21037045,21038126,21040332,21041111,21043243,21043272', 'assoc_port': '21010309:21030315,21010319:21032594,21010323:21033378,21010330:21034558,21010346:21035870,21010364:21037045,21010376:21038126,21010392:21040332,21010421:21041111,21010464:21043272,21010552:21043243', 'assoc_mat': '21010309:barquette_opaque:4211:21030315,21010319:barquette_opaque:4211:21032594,21010323:barquette_opaque:4211:21033378,21010330:barquette_opaque:4211:21034558,21010346:barquette_opaque:4211:21035870,21010364:barquette_opaque:4211:21037045,21010376:barquette_opaque:4211:21038126,21010392:barquette_opaque:4211:21040332,21010421:barquette_opaque:4211:21041111,21010464:barquette_opaque:4211:21043272,21010552:barquette_opaque:4211:21043243'}, {'unwanted_material': 'bouchon', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.011239212416872615, 'nb_photo': 97, 'list_port_cont': '21029709,21031219,21032384,21033090,21034546,21035715,21035853,21035892,21036058,21036286,21036530,21036755,21037314,21038131,21038417,21038534,21085314', 'assoc_port': '21010306:21029709,21010312:21031219,21010317:21032384,21010321:21033090,21010328:21034546,21010342:21035715,21010350:21036058,21010360:21036755,21010366:21037314,21010378:21038534,21010388:21085314,21010396:21038417,21010431:21038131,21010441:21036530,21010452:21036286,21010498:21035853,21010550:21035892', 'assoc_mat': '21010306:bouchon:3327:21029709,21010312:bouchon:3327:21031219,21010317:bouchon:3327:21032384,21010321:bouchon:3327:21033090,21010328:bouchon:3327:21034546,21010342:bouchon:3327:21035715,21010350:bouchon:3327:21036058,21010360:bouchon:3327:21036755,21010366:bouchon:3327:21037314,21010378:bouchon:3327:21038534,21010388:bouchon:3327:21085314,21010396:bouchon:3327:21038417,21010431:bouchon:3327:21038131,21010441:bouchon:3327:21036530,21010452:bouchon:3327:21036286,21010498:bouchon:3327:21035853,21010550:bouchon:3327:21035892'}, {'unwanted_material': 'carton', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.011171706024206645, 'nb_photo': 2, 'list_port_cont': '21040395', 'assoc_port': '21010393:21040395', 'assoc_mat': '21010393:carton:4205:21040395'}, {'unwanted_material': 'carton', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.003154728706187209, 'nb_photo': 15, 'list_port_cont': '21037917,21042872,21044086', 'assoc_port': '21010374:21037917,21010450:21042872,21010564:21044086', 'assoc_mat': '21010374:carton:4203:21037917,21010450:carton:4203:21042872,21010564:carton:4203:21044086'}, {'unwanted_material': 'carton', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.9319457801255371, 'nb_photo': 41, 'list_port_cont': '20174430,21029074,21029751,21034739,21036073,21036311,21038555,21039415,21040680,21041478,21041824,21042227,21042441,21043358,21044162,21083813', 'assoc_port': '20173926:20174430,21010292:21029074,21010307:21029751,21010327:21083813,21010334:21034739,21010352:21036073,21010356:21036311,21010380:21038555,21010386:21039415,21010394:21040680,21010423:21041478,21010427:21041824,21010439:21042227,21010443:21042441,21010467:21043358,21010566:21044162', 'assoc_mat': '20173926:carton:4207:20174430,21010292:carton:4207:21029074,21010307:carton:4207:21029751,21010327:carton:4207:21083813,21010334:carton:4207:21034739,21010352:carton:4207:21036073,21010356:carton:4207:21036311,21010380:carton:4207:21038555,21010386:carton:4207:21039415,21010394:carton:4207:21040680,21010423:carton:4207:21041478,21010427:carton:4207:21041824,21010439:carton:4207:21042227,21010443:carton:4207:21042441,21010467:carton:4207:21043358,21010566:carton:4207:21044162'}, {'unwanted_material': 'carton', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.014851902166160162, 'nb_photo': 211, 'list_port_cont': '20312922,21030895,21032993,21034097,21035541,21036265,21037436,21039255,21041923,21043082,21043567,21043733,21086585', 'assoc_port': '20173925:20312922,21010311:21030895,21010320:21032993,21010326:21034097,21010340:21035541,21010354:21036265,21010368:21037436,21010384:21039255,21010422:21086585,21010433:21041923,21010459:21043082,21010469:21043567,21010557:21043733', 'assoc_mat': '20173925:carton:4461:20312922,21010311:carton:4461:21030895,21010320:carton:4461:21032993,21010326:carton:4461:21034097,21010340:carton:4461:21035541,21010354:carton:4461:21036265,21010368:carton:4461:21037436,21010384:carton:4461:21039255,21010422:carton:4461:21086585,21010433:carton:4461:21041923,21010459:carton:4461:21043082,21010469:carton:4461:21043567,21010557:carton:4461:21043733'}, {'unwanted_material': 'carton', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.003872641606665564, 'nb_photo': 29, 'list_port_cont': '21030057,21033206,21036889,21040157,21041795,21042367,21042795,21043691,21043940', 'assoc_port': '21010308:21030057,21010322:21033206,21010362:21036889,21010390:21040157,21010424:21041795,21010437:21042367,21010447:21042795,21010472:21043691,21010560:21043940', 'assoc_mat': '21010308:carton:4200:21030057,21010322:carton:4200:21033206,21010362:carton:4200:21036889,21010390:carton:4200:21040157,21010424:carton:4200:21041795,21010437:carton:4200:21042367,21010447:carton:4200:21042795,21010472:carton:4200:21043691,21010560:carton:4200:21043940'}, {'unwanted_material': 'carton', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.9342654013489219, 'nb_photo': 5, 'list_port_cont': '21029189,21031994,21035004,21040921', 'assoc_port': '21010305:21029189,21010316:21031994,21010336:21035004,21010395:21040921', 'assoc_mat': '21010305:carton:4207:21029189,21010316:carton:4207:21031994,21010336:carton:4207:21035004,21010395:carton:4207:21040921'}, {'unwanted_material': 'carton', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0014341005717665993, 'nb_photo': 50, 'list_port_cont': '21030305,21032587,21033370,21034572,21035874,21037050,21038114,21040316,21041106,21043234,21043278', 'assoc_port': '21010309:21030305,21010319:21032587,21010323:21033370,21010330:21034572,21010346:21035874,21010364:21037050,21010376:21038114,21010392:21040316,21010421:21041106,21010464:21043278,21010552:21043234', 'assoc_mat': '21010309:carton:4211:21030305,21010319:carton:4211:21032587,21010323:carton:4211:21033370,21010330:carton:4211:21034572,21010346:carton:4211:21035874,21010364:carton:4211:21037050,21010376:carton:4211:21038114,21010392:carton:4211:21040316,21010421:carton:4211:21041106,21010464:carton:4211:21043278,21010552:carton:4211:21043234'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.05357755946933835, 'nb_photo': 197, 'list_port_cont': '21029699,21031222,21032381,21033089,21034544,21035711,21035859,21035889,21036056,21036294,21036522,21036760,21037302,21038132,21038418,21038538,21085316', 'assoc_port': '21010306:21029699,21010312:21031222,21010317:21032381,21010321:21033089,21010328:21034544,21010342:21035711,21010350:21036056,21010360:21036760,21010366:21037302,21010378:21038538,21010388:21085316,21010396:21038418,21010431:21038132,21010441:21036522,21010452:21036294,21010498:21035859,21010550:21035889', 'assoc_mat': '21010306:carton:3327:21029699,21010312:carton:3327:21031222,21010317:carton:3327:21032381,21010321:carton:3327:21033089,21010328:carton:3327:21034544,21010342:carton:3327:21035711,21010350:carton:3327:21036056,21010360:carton:3327:21036760,21010366:carton:3327:21037302,21010378:carton:3327:21038538,21010388:carton:3327:21085316,21010396:carton:3327:21038418,21010431:carton:3327:21038132,21010441:carton:3327:21036522,21010452:carton:3327:21036294,21010498:carton:3327:21035859,21010550:carton:3327:21035889'}, {'unwanted_material': 'ela', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.9151163407071976, 'nb_photo': 6, 'list_port_cont': '21031477,21037930,21042876,21044087', 'assoc_port': '21010314:21031477,21010374:21037930,21010450:21042876,21010564:21044087', 'assoc_mat': '21010314:ela:4203:21031477,21010374:ela:4203:21037930,21010450:ela:4203:21042876,21010564:ela:4203:21044087'}, {'unwanted_material': 'ela', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0018694521535402007, 'nb_photo': 4, 'list_port_cont': '21029750,21040682,21042431,21044156', 'assoc_port': '21010307:21029750,21010394:21040682,21010443:21042431,21010566:21044156', 'assoc_mat': '21010307:ela:4207:21029750,21010394:ela:4207:21040682,21010443:ela:4207:21042431,21010566:ela:4207:21044156'}, {'unwanted_material': 'ela', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.0016206325430104898, 'nb_photo': 1, 'list_port_cont': '21030072', 'assoc_port': '21010308:21030072', 'assoc_mat': '21010308:ela:4200:21030072'}, {'unwanted_material': 'ela', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.006309472191351706, 'nb_photo': 1, 'list_port_cont': '21038844', 'assoc_port': '21010382:21038844', 'assoc_mat': '21010382:ela:4209:21038844'}, {'unwanted_material': 'ela', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.00026899451835211605, 'nb_photo': 1, 'list_port_cont': '21037051', 'assoc_port': '21010364:21037051', 'assoc_mat': '21010364:ela:4211:21037051'}, {'unwanted_material': 'etiquette', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.009106779602764544, 'nb_photo': 80, 'list_port_cont': '21031482,21037925,21042874,21044085', 'assoc_port': '21010314:21031482,21010374:21037925,21010450:21042874,21010564:21044085', 'assoc_mat': '21010314:etiquette:4203:21031482,21010374:etiquette:4203:21037925,21010450:etiquette:4203:21042874,21010564:etiquette:4203:21044085'}, {'unwanted_material': 'etiquette', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.003015442989571786, 'nb_photo': 34, 'list_port_cont': '21029070,21029748,21031269,21032394,21033786,21034750,21036068,21037467,21038550,21039414,21040673,21041491,21041826,21042239,21042437,21043357,21044167,21083810', 'assoc_port': '21010292:21029070,21010307:21029748,21010313:21031269,21010318:21032394,21010325:21033786,21010327:21083810,21010334:21034750,21010352:21036068,21010370:21037467,21010380:21038550,21010386:21039414,21010394:21040673,21010423:21041491,21010427:21041826,21010439:21042239,21010443:21042437,21010467:21043357,21010566:21044167', 'assoc_mat': '21010292:etiquette:4207:21029070,21010307:etiquette:4207:21029748,21010313:etiquette:4207:21031269,21010318:etiquette:4207:21032394,21010325:etiquette:4207:21033786,21010327:etiquette:4207:21083810,21010334:etiquette:4207:21034750,21010352:etiquette:4207:21036068,21010370:etiquette:4207:21037467,21010380:etiquette:4207:21038550,21010386:etiquette:4207:21039414,21010394:etiquette:4207:21040673,21010423:etiquette:4207:21041491,21010427:etiquette:4207:21041826,21010439:etiquette:4207:21042239,21010443:etiquette:4207:21042437,21010467:etiquette:4207:21043357,21010566:etiquette:4207:21044167'}, {'unwanted_material': 'etiquette', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0006093541501455973, 'nb_photo': 9, 'list_port_cont': '20312934,21030899,21034105,21035539,21037441,21043568', 'assoc_port': '20173925:20312934,21010311:21030899,21010326:21034105,21010340:21035539,21010368:21037441,21010469:21043568', 'assoc_mat': '20173925:etiquette:4461:20312934,21010311:etiquette:4461:21030899,21010326:etiquette:4461:21034105,21010340:etiquette:4461:21035539,21010368:etiquette:4461:21037441,21010469:etiquette:4461:21043568'}, {'unwanted_material': 'etiquette', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.013267832335298473, 'nb_photo': 119, 'list_port_cont': '21030059,21033212,21034686,21035959,21036890,21037793,21040159,21041787,21042356,21042792,21043694,21043925,21083756', 'assoc_port': '21010308:21030059,21010315:21083756,21010322:21033212,21010332:21034686,21010348:21035959,21010362:21036890,21010372:21037793,21010390:21040159,21010424:21041787,21010437:21042356,21010447:21042792,21010472:21043694,21010560:21043925', 'assoc_mat': '21010308:etiquette:4200:21030059,21010315:etiquette:4200:21083756,21010322:etiquette:4200:21033212,21010332:etiquette:4200:21034686,21010348:etiquette:4200:21035959,21010362:etiquette:4200:21036890,21010372:etiquette:4200:21037793,21010390:etiquette:4200:21040159,21010424:etiquette:4200:21041787,21010437:etiquette:4200:21042356,21010447:etiquette:4200:21042792,21010472:etiquette:4200:21043694,21010560:etiquette:4200:21043925'}, {'unwanted_material': 'etiquette', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.03676237489295385, 'nb_photo': 12, 'list_port_cont': '21038840', 'assoc_port': '21010382:21038840', 'assoc_mat': '21010382:etiquette:4209:21038840'}, {'unwanted_material': 'etiquette', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.004481208781733734, 'nb_photo': 8, 'list_port_cont': '21032008,21033561,21036492,21037968,21040915', 'assoc_port': '21010316:21032008,21010324:21033561,21010358:21036492,21010375:21037968,21010395:21040915', 'assoc_mat': '21010316:etiquette:4207:21032008,21010324:etiquette:4207:21033561,21010358:etiquette:4207:21036492,21010375:etiquette:4207:21037968,21010395:etiquette:4207:21040915'}, {'unwanted_material': 'etiquette', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.002341784187271578, 'nb_photo': 356, 'list_port_cont': '21030303,21032589,21033383,21034573,21035867,21037059,21038113,21040329,21041112,21043245,21043279', 'assoc_port': '21010309:21030303,21010319:21032589,21010323:21033383,21010330:21034573,21010346:21035867,21010364:21037059,21010376:21038113,21010392:21040329,21010421:21041112,21010464:21043279,21010552:21043245', 'assoc_mat': '21010309:etiquette:4211:21030303,21010319:etiquette:4211:21032589,21010323:etiquette:4211:21033383,21010330:etiquette:4211:21034573,21010346:etiquette:4211:21035867,21010364:etiquette:4211:21037059,21010376:etiquette:4211:21038113,21010392:etiquette:4211:21040329,21010421:etiquette:4211:21041112,21010464:etiquette:4211:21043279,21010552:etiquette:4211:21043245'}, {'unwanted_material': 'etiquette', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.002803324750750805, 'nb_photo': 8, 'list_port_cont': '21035854,21035890,21036295,21085313', 'assoc_port': '21010388:21085313,21010452:21036295,21010498:21035854,21010550:21035890', 'assoc_mat': '21010388:etiquette:3327:21085313,21010452:etiquette:3327:21036295,21010498:etiquette:3327:21035854,21010550:etiquette:3327:21035890'}, {'unwanted_material': 'film_plastique', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.011839179781624729, 'nb_photo': 2, 'list_port_cont': '21040397', 'assoc_port': '21010393:21040397', 'assoc_mat': '21010393:film_plastique:4205:21040397'}, {'unwanted_material': 'film_plastique', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.018436454170910443, 'nb_photo': 47, 'list_port_cont': '21031479,21037924,21042879,21044091', 'assoc_port': '21010314:21031479,21010374:21037924,21010450:21042879,21010564:21044091', 'assoc_mat': '21010314:film_plastique:4203:21031479,21010374:film_plastique:4203:21037924,21010450:film_plastique:4203:21042879,21010564:film_plastique:4203:21044091'}, {'unwanted_material': 'film_plastique', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0014777524188785492, 'nb_photo': 19, 'list_port_cont': '20174433,21029073,21029763,21030524,21036074,21038556,21039402,21042228,21043364,21044154', 'assoc_port': '20173926:20174433,21010292:21029073,21010307:21029763,21010310:21030524,21010352:21036074,21010380:21038556,21010386:21039402,21010439:21042228,21010467:21043364,21010566:21044154', 'assoc_mat': '20173926:film_plastique:4207:20174433,21010292:film_plastique:4207:21029073,21010307:film_plastique:4207:21029763,21010310:film_plastique:4207:21030524,21010352:film_plastique:4207:21036074,21010380:film_plastique:4207:21038556,21010386:film_plastique:4207:21039402,21010439:film_plastique:4207:21042228,21010467:film_plastique:4207:21043364,21010566:film_plastique:4207:21044154'}, {'unwanted_material': 'film_plastique', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.8143348545258149, 'nb_photo': 277, 'list_port_cont': '20312924,21030909,21032990,21034106,21035538,21036257,21037433,21039265,21041925,21043070,21043570,21043722,21086586', 'assoc_port': '20173925:20312924,21010311:21030909,21010320:21032990,21010326:21034106,21010340:21035538,21010354:21036257,21010368:21037433,21010384:21039265,21010422:21086586,21010433:21041925,21010459:21043070,21010469:21043570,21010557:21043722', 'assoc_mat': '20173925:film_plastique:4461:20312924,21010311:film_plastique:4461:21030909,21010320:film_plastique:4461:21032990,21010326:film_plastique:4461:21034106,21010340:film_plastique:4461:21035538,21010354:film_plastique:4461:21036257,21010368:film_plastique:4461:21037433,21010384:film_plastique:4461:21039265,21010422:film_plastique:4461:21086586,21010433:film_plastique:4461:21041925,21010459:film_plastique:4461:21043070,21010469:film_plastique:4461:21043570,21010557:film_plastique:4461:21043722'}, {'unwanted_material': 'film_plastique', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.03727661718965066, 'nb_photo': 123, 'list_port_cont': '21030068,21033214,21034694,21035944,21036888,21037794,21040154,21041789,21042351,21042796,21043699,21043930,21083752', 'assoc_port': '21010308:21030068,21010315:21083752,21010322:21033214,21010332:21034694,21010348:21035944,21010362:21036888,21010372:21037794,21010390:21040154,21010424:21041789,21010437:21042351,21010447:21042796,21010472:21043699,21010560:21043930', 'assoc_mat': '21010308:film_plastique:4200:21030068,21010315:film_plastique:4200:21083752,21010322:film_plastique:4200:21033214,21010332:film_plastique:4200:21034694,21010348:film_plastique:4200:21035944,21010362:film_plastique:4200:21036888,21010372:film_plastique:4200:21037794,21010390:film_plastique:4200:21040154,21010424:film_plastique:4200:21041789,21010437:film_plastique:4200:21042351,21010447:film_plastique:4200:21042796,21010472:film_plastique:4200:21043699,21010560:film_plastique:4200:21043930'}, {'unwanted_material': 'film_plastique', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.005534743822594581, 'nb_photo': 1, 'list_port_cont': '21038845', 'assoc_port': '21010382:21038845', 'assoc_mat': '21010382:film_plastique:4209:21038845'}, {'unwanted_material': 'film_plastique', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.0027690375877441383, 'nb_photo': 6, 'list_port_cont': '21029191,21031996,21034993,21036488,21040917', 'assoc_port': '21010305:21029191,21010316:21031996,21010336:21034993,21010358:21036488,21010395:21040917', 'assoc_mat': '21010305:film_plastique:4207:21029191,21010316:film_plastique:4207:21031996,21010336:film_plastique:4207:21034993,21010358:film_plastique:4207:21036488,21010395:film_plastique:4207:21040917'}, {'unwanted_material': 'film_plastique', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0007897699378908007, 'nb_photo': 36, 'list_port_cont': '21030301,21032593,21033372,21034566,21035877,21037058,21038115,21040326,21041102,21043237,21043270', 'assoc_port': '21010309:21030301,21010319:21032593,21010323:21033372,21010330:21034566,21010346:21035877,21010364:21037058,21010376:21038115,21010392:21040326,21010421:21041102,21010464:21043270,21010552:21043237', 'assoc_mat': '21010309:film_plastique:4211:21030301,21010319:film_plastique:4211:21032593,21010323:film_plastique:4211:21033372,21010330:film_plastique:4211:21034566,21010346:film_plastique:4211:21035877,21010364:film_plastique:4211:21037058,21010376:film_plastique:4211:21038115,21010392:film_plastique:4211:21040326,21010421:film_plastique:4211:21041102,21010464:film_plastique:4211:21043270,21010552:film_plastique:4211:21043237'}, {'unwanted_material': 'kraft', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0012813714844512707, 'nb_photo': 1, 'list_port_cont': '21042878', 'assoc_port': '21010450:21042878', 'assoc_mat': '21010450:kraft:4203:21042878'}, {'unwanted_material': 'kraft', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.005767812448563143, 'nb_photo': 4, 'list_port_cont': '21033777,21042443,21083815', 'assoc_port': '21010325:21033777,21010327:21083815,21010443:21042443', 'assoc_mat': '21010325:kraft:4207:21033777,21010327:kraft:4207:21083815,21010443:kraft:4207:21042443'}, {'unwanted_material': 'kraft', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.0005493522841139184, 'nb_photo': 1, 'list_port_cont': '21043690', 'assoc_port': '21010472:21043690', 'assoc_mat': '21010472:kraft:4200:21043690'}, {'unwanted_material': 'metal', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.006465450880125157, 'nb_photo': 15, 'list_port_cont': '21031492,21037931,21042887,21044092', 'assoc_port': '21010314:21031492,21010374:21037931,21010450:21042887,21010564:21044092', 'assoc_mat': '21010314:metal:4203:21031492,21010374:metal:4203:21037931,21010450:metal:4203:21042887,21010564:metal:4203:21044092'}, {'unwanted_material': 'metal', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0045995841829128215, 'nb_photo': 4, 'list_port_cont': '21032393,21040670,21041484,21044157', 'assoc_port': '21010318:21032393,21010394:21040670,21010423:21041484,21010566:21044157', 'assoc_mat': '21010318:metal:4207:21032393,21010394:metal:4207:21040670,21010423:metal:4207:21041484,21010566:metal:4207:21044157'}, {'unwanted_material': 'metal', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.02610430778191755, 'nb_photo': 7, 'list_port_cont': '21035537,21036256,21039262,21041928,21043076', 'assoc_port': '21010340:21035537,21010354:21036256,21010384:21039262,21010433:21041928,21010459:21043076', 'assoc_mat': '21010340:metal:4461:21035537,21010354:metal:4461:21036256,21010384:metal:4461:21039262,21010433:metal:4461:21041928,21010459:metal:4461:21043076'}, {'unwanted_material': 'metal', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.08124522911451959, 'nb_photo': 50, 'list_port_cont': '21030071,21033215,21034693,21035949,21037784,21040155,21041785,21042364,21042791,21043697,21043935,21083760', 'assoc_port': '21010308:21030071,21010315:21083760,21010322:21033215,21010332:21034693,21010348:21035949,21010372:21037784,21010390:21040155,21010424:21041785,21010437:21042364,21010447:21042791,21010472:21043697,21010560:21043935', 'assoc_mat': '21010308:metal:4200:21030071,21010315:metal:4200:21083760,21010322:metal:4200:21033215,21010332:metal:4200:21034693,21010348:metal:4200:21035949,21010372:metal:4200:21037784,21010390:metal:4200:21040155,21010424:metal:4200:21041785,21010437:metal:4200:21042364,21010447:metal:4200:21042791,21010472:metal:4200:21043697,21010560:metal:4200:21043935'}, {'unwanted_material': 'metal', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.012232553190902004, 'nb_photo': 1, 'list_port_cont': '21038848', 'assoc_port': '21010382:21038848', 'assoc_mat': '21010382:metal:4209:21038848'}, {'unwanted_material': 'metal', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.00519284624947138, 'nb_photo': 4, 'list_port_cont': '21029186,21033569,21040923', 'assoc_port': '21010305:21029186,21010324:21033569,21010395:21040923', 'assoc_mat': '21010305:metal:4207:21029186,21010324:metal:4207:21033569,21010395:metal:4207:21040923'}, {'unwanted_material': 'metal', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.012458277196351918, 'nb_photo': 68, 'list_port_cont': '21030313,21032588,21033367,21034571,21035878,21037046,21038128,21040327,21041104,21043248,21043265', 'assoc_port': '21010309:21030313,21010319:21032588,21010323:21033367,21010330:21034571,21010346:21035878,21010364:21037046,21010376:21038128,21010392:21040327,21010421:21041104,21010464:21043265,21010552:21043248', 'assoc_mat': '21010309:metal:4211:21030313,21010319:metal:4211:21032588,21010323:metal:4211:21033367,21010330:metal:4211:21034571,21010346:metal:4211:21035878,21010364:metal:4211:21037046,21010376:metal:4211:21038128,21010392:metal:4211:21040327,21010421:metal:4211:21041104,21010464:metal:4211:21043265,21010552:metal:4211:21043248'}, {'unwanted_material': 'metal', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.0031080083884743605, 'nb_photo': 5, 'list_port_cont': '21035721,21035900,21036751,21037303', 'assoc_port': '21010342:21035721,21010360:21036751,21010366:21037303,21010550:21035900', 'assoc_mat': '21010342:metal:3327:21035721,21010360:metal:3327:21036751,21010366:metal:3327:21037303,21010550:metal:3327:21035900'}, {'unwanted_material': 'papier', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.03225024570297771, 'nb_photo': 12, 'list_port_cont': '21040400', 'assoc_port': '21010393:21040400', 'assoc_mat': '21010393:papier:4205:21040400'}, {'unwanted_material': 'papier', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.015594966263082799, 'nb_photo': 70, 'list_port_cont': '21031490,21037926,21042875,21044094', 'assoc_port': '21010314:21031490,21010374:21037926,21010450:21042875,21010564:21044094', 'assoc_mat': '21010314:papier:4203:21031490,21010374:papier:4203:21037926,21010450:papier:4203:21042875,21010564:papier:4203:21044094'}, {'unwanted_material': 'papier', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.05367087452335126, 'nb_photo': 767, 'list_port_cont': '20174436,21029071,21029752,21030534,21031274,21032398,21033783,21034753,21035234,21035755,21036079,21036304,21037469,21038552,21039412,21040671,21041477,21041819,21042233,21042438,21043362,21044163,21083817', 'assoc_port': '20173926:20174436,21010292:21029071,21010307:21029752,21010310:21030534,21010313:21031274,21010318:21032398,21010325:21033783,21010327:21083817,21010334:21034753,21010338:21035234,21010344:21035755,21010352:21036079,21010356:21036304,21010370:21037469,21010380:21038552,21010386:21039412,21010394:21040671,21010423:21041477,21010427:21041819,21010439:21042233,21010443:21042438,21010467:21043362,21010566:21044163', 'assoc_mat': '20173926:papier:4207:20174436,21010292:papier:4207:21029071,21010307:papier:4207:21029752,21010310:papier:4207:21030534,21010313:papier:4207:21031274,21010318:papier:4207:21032398,21010325:papier:4207:21033783,21010327:papier:4207:21083817,21010334:papier:4207:21034753,21010338:papier:4207:21035234,21010344:papier:4207:21035755,21010352:papier:4207:21036079,21010356:papier:4207:21036304,21010370:papier:4207:21037469,21010380:papier:4207:21038552,21010386:papier:4207:21039412,21010394:papier:4207:21040671,21010423:papier:4207:21041477,21010427:papier:4207:21041819,21010439:papier:4207:21042233,21010443:papier:4207:21042438,21010467:papier:4207:21043362,21010566:papier:4207:21044163'}, {'unwanted_material': 'papier', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.16075861172221145, 'nb_photo': 1652, 'list_port_cont': '20312931,21030906,21032980,21034109,21035545,21036252,21037438,21039257,21041930,21043072,21043575,21043724,21086582', 'assoc_port': '20173925:20312931,21010311:21030906,21010320:21032980,21010326:21034109,21010340:21035545,21010354:21036252,21010368:21037438,21010384:21039257,21010422:21086582,21010433:21041930,21010459:21043072,21010469:21043575,21010557:21043724', 'assoc_mat': '20173925:papier:4461:20312931,21010311:papier:4461:21030906,21010320:papier:4461:21032980,21010326:papier:4461:21034109,21010340:papier:4461:21035545,21010354:papier:4461:21036252,21010368:papier:4461:21037438,21010384:papier:4461:21039257,21010422:papier:4461:21086582,21010433:papier:4461:21041930,21010459:papier:4461:21043072,21010469:papier:4461:21043575,21010557:papier:4461:21043724'}, {'unwanted_material': 'papier', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.054568854807388836, 'nb_photo': 269, 'list_port_cont': '21030070,21033218,21034687,21035947,21036891,21037781,21040150,21041793,21042358,21042801,21043686,21043933,21083755', 'assoc_port': '21010308:21030070,21010315:21083755,21010322:21033218,21010332:21034687,21010348:21035947,21010362:21036891,21010372:21037781,21010390:21040150,21010424:21041793,21010437:21042358,21010447:21042801,21010472:21043686,21010560:21043933', 'assoc_mat': '21010308:papier:4200:21030070,21010315:papier:4200:21083755,21010322:papier:4200:21033218,21010332:papier:4200:21034687,21010348:papier:4200:21035947,21010362:papier:4200:21036891,21010372:papier:4200:21037781,21010390:papier:4200:21040150,21010424:papier:4200:21041793,21010437:papier:4200:21042358,21010447:papier:4200:21042801,21010472:papier:4200:21043686,21010560:papier:4200:21043933'}, {'unwanted_material': 'papier', 'main_material': 'gm', 'pht_type': 4209, 'ratio': 0.9236559702801899, 'nb_photo': 121, 'list_port_cont': '21038838', 'assoc_port': '21010382:21038838', 'assoc_mat': '21010382:papier:4209:21038838'}, {'unwanted_material': 'papier', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.05064937838251356, 'nb_photo': 132, 'list_port_cont': '21029188,21032004,21033563,21035002,21036487,21037974,21040914', 'assoc_port': '21010305:21029188,21010316:21032004,21010324:21033563,21010336:21035002,21010358:21036487,21010375:21037974,21010395:21040914', 'assoc_mat': '21010305:papier:4207:21029188,21010316:papier:4207:21032004,21010324:papier:4207:21033563,21010336:papier:4207:21035002,21010358:papier:4207:21036487,21010375:papier:4207:21037974,21010395:papier:4207:21040914'}, {'unwanted_material': 'papier', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.006372956461625042, 'nb_photo': 246, 'list_port_cont': '21030309,21032584,21033382,21034562,21035882,21037053,21038122,21040323,21041107,21043233,21043267', 'assoc_port': '21010309:21030309,21010319:21032584,21010323:21033382,21010330:21034562,21010346:21035882,21010364:21037053,21010376:21038122,21010392:21040323,21010421:21041107,21010464:21043267,21010552:21043233', 'assoc_mat': '21010309:papier:4211:21030309,21010319:papier:4211:21032584,21010323:papier:4211:21033382,21010330:papier:4211:21034562,21010346:papier:4211:21035882,21010364:papier:4211:21037053,21010376:papier:4211:21038122,21010392:papier:4211:21040323,21010421:papier:4211:21041107,21010464:papier:4211:21043267,21010552:papier:4211:21043233'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.03703120138733584, 'nb_photo': 219, 'list_port_cont': '21029702,21031224,21032379,21033093,21034551,21035710,21035860,21035894,21036064,21036287,21036527,21036756,21037310,21038135,21038426,21038539,21085315', 'assoc_port': '21010306:21029702,21010312:21031224,21010317:21032379,21010321:21033093,21010328:21034551,21010342:21035710,21010350:21036064,21010360:21036756,21010366:21037310,21010378:21038539,21010388:21085315,21010396:21038426,21010431:21038135,21010441:21036527,21010452:21036287,21010498:21035860,21010550:21035894', 'assoc_mat': '21010306:papier:3327:21029702,21010312:papier:3327:21031224,21010317:papier:3327:21032379,21010321:papier:3327:21033093,21010328:papier:3327:21034551,21010342:papier:3327:21035710,21010350:papier:3327:21036064,21010360:papier:3327:21036756,21010366:papier:3327:21037310,21010378:papier:3327:21038539,21010388:papier:3327:21085315,21010396:papier:3327:21038426,21010431:papier:3327:21038135,21010441:papier:3327:21036527,21010452:papier:3327:21036287,21010498:papier:3327:21035860,21010550:papier:3327:21035894'}, {'unwanted_material': 'pehd', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.009607816901545146, 'nb_photo': 1, 'list_port_cont': '21043080', 'assoc_port': '21010459:21043080', 'assoc_mat': '21010459:pehd:4461:21043080'}, {'unwanted_material': 'pehd', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.044279818769473143, 'nb_photo': 3, 'list_port_cont': '21042365,21043926', 'assoc_port': '21010437:21042365,21010560:21043926', 'assoc_mat': '21010437:pehd:4200:21042365,21010560:pehd:4200:21043926'}, {'unwanted_material': 'pehd', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.00548892601853799, 'nb_photo': 10, 'list_port_cont': '21031228,21032372,21036297,21036525,21038143', 'assoc_port': '21010312:21031228,21010317:21032372,21010431:21038143,21010441:21036525,21010452:21036297', 'assoc_mat': '21010312:pehd:3327:21031228,21010317:pehd:3327:21032372,21010431:pehd:3327:21038143,21010441:pehd:3327:21036525,21010452:pehd:3327:21036297'}, {'unwanted_material': 'pet_clair', 'main_material': 'aluminium', 'pht_type': 4205, 'ratio': 0.007971287749184737, 'nb_photo': 1, 'list_port_cont': '21040389', 'assoc_port': '21010393:21040389', 'assoc_mat': '21010393:pet_clair:4205:21040389'}, {'unwanted_material': 'pet_clair', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.009746342447344245, 'nb_photo': 15, 'list_port_cont': '21031487,21042881,21044095', 'assoc_port': '21010314:21031487,21010450:21042881,21010564:21044095', 'assoc_mat': '21010314:pet_clair:4203:21031487,21010450:pet_clair:4203:21042881,21010564:pet_clair:4203:21044095'}, {'unwanted_material': 'pet_clair', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.0035627391253297567, 'nb_photo': 5, 'list_port_cont': '21030527,21035748,21037465,21043368', 'assoc_port': '21010310:21030527,21010344:21035748,21010370:21037465,21010467:21043368', 'assoc_mat': '21010310:pet_clair:4207:21030527,21010344:pet_clair:4207:21035748,21010370:pet_clair:4207:21037465,21010467:pet_clair:4207:21043368'}, {'unwanted_material': 'pet_clair', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.03419825029433667, 'nb_photo': 75, 'list_port_cont': '21030073,21033213,21034688,21035955,21036886,21037790,21040160,21041794,21042352,21042797,21043687,21043928,21083758', 'assoc_port': '21010308:21030073,21010315:21083758,21010322:21033213,21010332:21034688,21010348:21035955,21010362:21036886,21010372:21037790,21010390:21040160,21010424:21041794,21010437:21042352,21010447:21042797,21010472:21043687,21010560:21043928', 'assoc_mat': '21010308:pet_clair:4200:21030073,21010315:pet_clair:4200:21083758,21010322:pet_clair:4200:21033213,21010332:pet_clair:4200:21034688,21010348:pet_clair:4200:21035955,21010362:pet_clair:4200:21036886,21010372:pet_clair:4200:21037790,21010390:pet_clair:4200:21040160,21010424:pet_clair:4200:21041794,21010437:pet_clair:4200:21042352,21010447:pet_clair:4200:21042797,21010472:pet_clair:4200:21043687,21010560:pet_clair:4200:21043928'}, {'unwanted_material': 'pet_clair', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.0005903849862339631, 'nb_photo': 7, 'list_port_cont': '21033375,21035880,21040317,21041108,21043232,21043268', 'assoc_port': '21010323:21033375,21010346:21035880,21010392:21040317,21010421:21041108,21010464:21043268,21010552:21043232', 'assoc_mat': '21010323:pet_clair:4211:21033375,21010346:pet_clair:4211:21035880,21010392:pet_clair:4211:21040317,21010421:pet_clair:4211:21041108,21010464:pet_clair:4211:21043268,21010552:pet_clair:4211:21043232'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.847432448298875, 'nb_photo': 2436, 'list_port_cont': '21029700,21031230,21032382,21033094,21034555,21035717,21035857,21035898,21036062,21036290,21036529,21036761,21037315,21038142,21038427,21038527,21085306', 'assoc_port': '21010306:21029700,21010312:21031230,21010317:21032382,21010321:21033094,21010328:21034555,21010342:21035717,21010350:21036062,21010360:21036761,21010366:21037315,21010378:21038527,21010388:21085306,21010396:21038427,21010431:21038142,21010441:21036529,21010452:21036290,21010498:21035857,21010550:21035898', 'assoc_mat': '21010306:pet_clair:3327:21029700,21010312:pet_clair:3327:21031230,21010317:pet_clair:3327:21032382,21010321:pet_clair:3327:21033094,21010328:pet_clair:3327:21034555,21010342:pet_clair:3327:21035717,21010350:pet_clair:3327:21036062,21010360:pet_clair:3327:21036761,21010366:pet_clair:3327:21037315,21010378:pet_clair:3327:21038527,21010388:pet_clair:3327:21085306,21010396:pet_clair:3327:21038427,21010431:pet_clair:3327:21038142,21010441:pet_clair:3327:21036529,21010452:pet_clair:3327:21036290,21010498:pet_clair:3327:21035857,21010550:pet_clair:3327:21035898'}, {'unwanted_material': 'pet_fonce', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.0006619494919741627, 'nb_photo': 2, 'list_port_cont': '21037922,21042884', 'assoc_port': '21010374:21037922,21010450:21042884', 'assoc_mat': '21010374:pet_fonce:4203:21037922,21010450:pet_fonce:4203:21042884'}, {'unwanted_material': 'pet_fonce', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.6936070240649872, 'nb_photo': 153, 'list_port_cont': '21030064,21033208,21034690,21035950,21036878,21037787,21040148,21041796,21042354,21042787,21043696,21043936,21083753', 'assoc_port': '21010308:21030064,21010315:21083753,21010322:21033208,21010332:21034690,21010348:21035950,21010362:21036878,21010372:21037787,21010390:21040148,21010424:21041796,21010437:21042354,21010447:21042787,21010472:21043696,21010560:21043936', 'assoc_mat': '21010308:pet_fonce:4200:21030064,21010315:pet_fonce:4200:21083753,21010322:pet_fonce:4200:21033208,21010332:pet_fonce:4200:21034690,21010348:pet_fonce:4200:21035950,21010362:pet_fonce:4200:21036878,21010372:pet_fonce:4200:21037787,21010390:pet_fonce:4200:21040148,21010424:pet_fonce:4200:21041796,21010437:pet_fonce:4200:21042354,21010447:pet_fonce:4200:21042787,21010472:pet_fonce:4200:21043696,21010560:pet_fonce:4200:21043936'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.00172681378889089, 'nb_photo': 22, 'list_port_cont': '21030308,21032600,21034559,21035872,21037047,21038117,21041115,21043236,21043275', 'assoc_port': '21010309:21030308,21010319:21032600,21010330:21034559,21010346:21035872,21010364:21037047,21010376:21038117,21010421:21041115,21010464:21043275,21010552:21043236', 'assoc_mat': '21010309:pet_fonce:4211:21030308,21010319:pet_fonce:4211:21032600,21010330:pet_fonce:4211:21034559,21010346:pet_fonce:4211:21035872,21010364:pet_fonce:4211:21037047,21010376:pet_fonce:4211:21038117,21010421:pet_fonce:4211:21041115,21010464:pet_fonce:4211:21043275,21010552:pet_fonce:4211:21043236'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.02494615120234525, 'nb_photo': 83, 'list_port_cont': '21029708,21031223,21032375,21033102,21034556,21035722,21035863,21035888,21036059,21036289,21036528,21036759,21037306,21038138,21038416,21038537,21085304', 'assoc_port': '21010306:21029708,21010312:21031223,21010317:21032375,21010321:21033102,21010328:21034556,21010342:21035722,21010350:21036059,21010360:21036759,21010366:21037306,21010378:21038537,21010388:21085304,21010396:21038416,21010431:21038138,21010441:21036528,21010452:21036289,21010498:21035863,21010550:21035888', 'assoc_mat': '21010306:pet_fonce:3327:21029708,21010312:pet_fonce:3327:21031223,21010317:pet_fonce:3327:21032375,21010321:pet_fonce:3327:21033102,21010328:pet_fonce:3327:21034556,21010342:pet_fonce:3327:21035722,21010350:pet_fonce:3327:21036059,21010360:pet_fonce:3327:21036759,21010366:pet_fonce:3327:21037306,21010378:pet_fonce:3327:21038537,21010388:pet_fonce:3327:21085304,21010396:pet_fonce:3327:21038416,21010431:pet_fonce:3327:21038138,21010441:pet_fonce:3327:21036528,21010452:pet_fonce:3327:21036289,21010498:pet_fonce:3327:21035863,21010550:pet_fonce:3327:21035888'}, {'unwanted_material': 'pet_opaque', 'main_material': 'ela', 'pht_type': 4203, 'ratio': 0.010594561785623425, 'nb_photo': 21, 'list_port_cont': '21031485,21037921,21042877,21044097', 'assoc_port': '21010314:21031485,21010374:21037921,21010450:21042877,21010564:21044097', 'assoc_mat': '21010314:pet_opaque:4203:21031485,21010374:pet_opaque:4203:21037921,21010450:pet_opaque:4203:21042877,21010564:pet_opaque:4203:21044097'}, {'unwanted_material': 'pet_opaque', 'main_material': 'emr', 'pht_type': 4207, 'ratio': 0.009583707410178685, 'nb_photo': 27, 'list_port_cont': '21029755,21030528,21033780,21034744,21035232,21036076,21037476,21040685,21041486,21041827,21042434,21043369,21044168,21083819', 'assoc_port': '21010307:21029755,21010310:21030528,21010325:21033780,21010327:21083819,21010334:21034744,21010338:21035232,21010352:21036076,21010370:21037476,21010394:21040685,21010423:21041486,21010427:21041827,21010443:21042434,21010467:21043369,21010566:21044168', 'assoc_mat': '21010307:pet_opaque:4207:21029755,21010310:pet_opaque:4207:21030528,21010325:pet_opaque:4207:21033780,21010327:pet_opaque:4207:21083819,21010334:pet_opaque:4207:21034744,21010338:pet_opaque:4207:21035232,21010352:pet_opaque:4207:21036076,21010370:pet_opaque:4207:21037476,21010394:pet_opaque:4207:21040685,21010423:pet_opaque:4207:21041486,21010427:pet_opaque:4207:21041827,21010443:pet_opaque:4207:21042434,21010467:pet_opaque:4207:21043369,21010566:pet_opaque:4207:21044168'}, {'unwanted_material': 'pet_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.005704754141438969, 'nb_photo': 8, 'list_port_cont': '21030898,21034101,21035548,21037447,21043571,21086583', 'assoc_port': '21010311:21030898,21010326:21034101,21010340:21035548,21010368:21037447,21010422:21086583,21010469:21043571', 'assoc_mat': '21010311:pet_opaque:4461:21030898,21010326:pet_opaque:4461:21034101,21010340:pet_opaque:4461:21035548,21010368:pet_opaque:4461:21037447,21010422:pet_opaque:4461:21086583,21010469:pet_opaque:4461:21043571'}, {'unwanted_material': 'pet_opaque', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.04622505132349525, 'nb_photo': 295, 'list_port_cont': '21030063,21033221,21034692,21035956,21036882,21037786,21040153,21041790,21042362,21042786,21043698,21043927,21083765', 'assoc_port': '21010308:21030063,21010315:21083765,21010322:21033221,21010332:21034692,21010348:21035956,21010362:21036882,21010372:21037786,21010390:21040153,21010424:21041790,21010437:21042362,21010447:21042786,21010472:21043698,21010560:21043927', 'assoc_mat': '21010308:pet_opaque:4200:21030063,21010315:pet_opaque:4200:21083765,21010322:pet_opaque:4200:21033221,21010332:pet_opaque:4200:21034692,21010348:pet_opaque:4200:21035956,21010362:pet_opaque:4200:21036882,21010372:pet_opaque:4200:21037786,21010390:pet_opaque:4200:21040153,21010424:pet_opaque:4200:21041790,21010437:pet_opaque:4200:21042362,21010447:pet_opaque:4200:21042786,21010472:pet_opaque:4200:21043698,21010560:pet_opaque:4200:21043927'}, {'unwanted_material': 'pet_opaque', 'main_material': 'gros_cartons', 'pht_type': 4207, 'ratio': 0.004549505586243793, 'nb_photo': 2, 'list_port_cont': '21034997', 'assoc_port': '21010336:21034997', 'assoc_mat': '21010336:pet_opaque:4207:21034997'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pehd_pp', 'pht_type': 4211, 'ratio': 0.003027563038637962, 'nb_photo': 80, 'list_port_cont': '21030316,21032585,21033368,21034560,21035881,21037049,21038112,21040328,21041109,21043242,21043273', 'assoc_port': '21010309:21030316,21010319:21032585,21010323:21033368,21010330:21034560,21010346:21035881,21010364:21037049,21010376:21038112,21010392:21040328,21010421:21041109,21010464:21043273,21010552:21043242', 'assoc_mat': '21010309:pet_opaque:4211:21030316,21010319:pet_opaque:4211:21032585,21010323:pet_opaque:4211:21033368,21010330:pet_opaque:4211:21034560,21010346:pet_opaque:4211:21035881,21010364:pet_opaque:4211:21037049,21010376:pet_opaque:4211:21038112,21010392:pet_opaque:4211:21040328,21010421:pet_opaque:4211:21041109,21010464:pet_opaque:4211:21043273,21010552:pet_opaque:4211:21043242'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'flux_dev_rigide', 'pht_type': 4200, 'ratio': 0.0010557625171375255, 'nb_photo': 1, 'list_port_cont': '21030061', 'assoc_port': '21010308:21030061', 'assoc_mat': '21010308:textiles_sanitaires:4200:21030061'}), 'main_stat': {'nb_photos': 914}}, 'hostname': (('jetson-116',),), 'impurety_average_per_hashtag': []} filepath : /data_4/data_log/job/memo/arc_en_ciel_mm/sla_mensuel_arc_en_ciel_mm_mois_02_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'pet_clair': {'autre': ['autre', '2.79%', 188], 'barquette_avec_film': ['barquette_avec_film', '0.81%', 13], 'bouchon': ['bouchon', '1.12%', 97], 'carton': ['carton', '5.36%', 197], 'etiquette': ['etiquette', '0.28%', 8], 'metal': ['metal', '0.31%', 5], 'papier': ['papier', '3.7%', 219], 'pehd': ['pehd', '0.55%', 10], 'pet_clair': ['pet_clair', '84.74%', 2436], 'pet_fonce': ['pet_fonce', '2.49%', 83]}, 'ela': {'barquette_opaque': ['barquette_opaque', '1.15%', 50], 'carton': ['carton', '0.32%', 15], 'ela': ['ela', '91.51%', 6], 'etiquette': ['etiquette', '0.91%', 80], 'film_plastique': ['film_plastique', '1.84%', 47], 'kraft': ['kraft', '0.13%', 1], 'metal': ['metal', '0.65%', 15], 'papier': ['papier', '1.56%', 70], 'pet_clair': ['pet_clair', '0.97%', 15], 'pet_fonce': ['pet_fonce', '0.07%', 2], 'pet_opaque': ['pet_opaque', '1.06%', 21]}, 'emr': {'barquette_opaque': ['barquette_opaque', '0.31%', 28], 'carton': ['carton', '93.19%', 41], 'ela': ['ela', '0.19%', 4], 'etiquette': ['etiquette', '0.3%', 34], 'film_plastique': ['film_plastique', '0.15%', 19], 'kraft': ['kraft', '0.58%', 4], 'metal': ['metal', '0.46%', 4], 'papier': ['papier', '5.37%', 767], 'pet_clair': ['pet_clair', '0.36%', 5], 'pet_opaque': ['pet_opaque', '0.96%', 27]}, 'film_pedb': {'barquette_opaque': ['barquette_opaque', '0.94%', 4], 'carton': ['carton', '1.49%', 211], 'etiquette': ['etiquette', '0.06%', 9], 'film_plastique': ['film_plastique', '81.43%', 277], 'metal': ['metal', '2.61%', 7], 'papier': ['papier', '16.08%', 1652], 'pehd': ['pehd', '0.96%', 1], 'pet_opaque': ['pet_opaque', '0.57%', 8]}, 'flux_dev_rigide': {'barquette_opaque': ['barquette_opaque', '1.71%', 78], 'carton': ['carton', '0.39%', 29], 'ela': ['ela', '0.16%', 1], 'etiquette': ['etiquette', '1.33%', 119], 'film_plastique': ['film_plastique', '3.73%', 123], 'kraft': ['kraft', '0.05%', 1], 'metal': ['metal', '8.12%', 50], 'papier': ['papier', '5.46%', 269], 'pehd': ['pehd', '4.43%', 3], 'pet_clair': ['pet_clair', '3.42%', 75], 'pet_fonce': ['pet_fonce', '69.36%', 153], 'pet_opaque': ['pet_opaque', '4.62%', 295], 'textiles_sanitaires': ['textiles_sanitaires', '0.11%', 1]}, 'gm': {'barquette_opaque': ['barquette_opaque', '0.38%', 1], 'ela': ['ela', '0.63%', 1], 'etiquette': ['etiquette', '3.68%', 12], 'film_plastique': ['film_plastique', '0.55%', 1], 'metal': ['metal', '1.22%', 1], 'papier': ['papier', '92.37%', 121]}, 'gros_cartons': {'barquette_opaque': ['barquette_opaque', '0.26%', 2], 'carton': ['carton', '93.43%', 5], 'etiquette': ['etiquette', '0.45%', 8], 'film_plastique': ['film_plastique', '0.28%', 6], 'metal': ['metal', '0.52%', 4], 'papier': ['papier', '5.06%', 132], 'pet_opaque': ['pet_opaque', '0.45%', 2]}, 'pehd_pp': {'barquette_opaque': ['barquette_opaque', '3.69%', 419], 'carton': ['carton', '0.14%', 50], 'ela': ['ela', '0.03%', 1], 'etiquette': ['etiquette', '0.23%', 356], 'film_plastique': ['film_plastique', '0.08%', 36], 'metal': ['metal', '1.25%', 68], 'papier': ['papier', '0.64%', 246], 'pet_clair': ['pet_clair', '0.06%', 7], 'pet_fonce': ['pet_fonce', '0.17%', 22], 'pet_opaque': ['pet_opaque', '0.3%', 80]}, 'aluminium': {'carton': ['carton', '1.12%', 2], 'film_plastique': ['film_plastique', '1.18%', 2], 'papier': ['papier', '3.23%', 12], 'pet_clair': ['pet_clair', '0.8%', 1]}} before plot_matierial_repartition before organize_and_plot_impurety_average_data before organize_and_plot_quality_photo_data finish generating filepath : /data_4/data_log/job/memo/arc_en_ciel_mm/sla_mensuel_arc_en_ciel_mm_mois_02_annee_2025.pdf le fichier se trouve ici : /data_4/data_log/job/memo/arc_en_ciel_mm 4.16user 5.41system 0:08.22elapsed 116%CPU (0avgtext+0avgdata 179356maxresident)k 5312inputs+1408outputs (16major+51902minor)pagefaults 0swaps