path: root/www/p5-HTML-RobotsMETA/pkg-descr

HTML::RobotsMETA is a simple HTML::Parser subclass
that extracts robots exclusion information from meta tags.

WWW: https://metacpan.org/release/HTML-RobotsMETA