LinkChecker is a free, GPL licensed URL validator.
Features
- recursive and multithreaded checking
- output in colored or normal text, HTML, SQL, CSV, XML or a sitemap graph in different formats
- HTTP/1.1, HTTPS, FTP, mailto:, news:, nntp:, Telnet and local file links support
- restriction of link checking with regular expression filters for URLs
- proxy support
- username/password authorization for HTTP and FTP and Telnet
- honors robots.txt exclusion protocol
- Cookie support
- HTML and CSS syntax check
- Antivirus check
- Different interfaces: command line, GUI and web interface
Também está no Debian Lenny: aptitude install linkchecker e nas portas do FreeBSD: /usr/ports/www/linkchecker