Anemone: An easy-to-use Ruby web spider framework

July 6th, 2009 - Backend, Ruby on Rails

“Anemone is a Ruby library that makes it quick and painless to write programs that spider a website. It provides a simple DSL for performing actions on every page of a site, skipping certain URLs, and calculating the shortest path to a given page on a site.

The multi-threaded design makes Anemone fast. The API makes it simple. And the expressiveness of Ruby makes it powerful.”

Information about installing and using the framework can be found at http://anemone.rubyforge.org/