Debian logoDebian Screenshots >

ruby-webrobots

Library for creating robots.txt-aware web robots

Description

This library helps write robots.txt-compliant web robots in Ruby, based on Nokogiri's functionality.

Upload more screenshots

Please help extend the collection of screenshots. Just make a screenshot and upload it here. You don't need to register or anything.


Homepage

https://github.com/knu/webrobots


Statistics

490 other people were interested in this package here. The newest known version of this software is 0.1.2-1 (Information last updated 3 days ago.)