web-tree

A library that builds and displays hierarchical trees of URLs. This is useful if you visit a bunch of URLs in a domain and want to view the structure of the site. I also created a Firefox add-on that uses the library to build a tree of URLs you visit in your browser.

web-tree-crawler

A naive web crawler that uses web-tree to build a tree of URLs it’s crawled.