Why is htdig rejecting some of the links in my documents?
When htdig parses documents and finds hypertext links to other documents (hrefs), it may reject them for any of several reasons. To find out what those reasons are, you need to run htdig with at least 3 “v” options, i.e. -vvv. Here are the meanings of some of the messages you might see at this verbosity level.