diff --git a/www/py-robot-detection/pkg-message b/www/py-robot-detection/pkg-message new file mode 100644 --- /dev/null +++ b/www/py-robot-detection/pkg-message @@ -0,0 +1,8 @@ +You can download a new version of the Robot Database from http://www.robotstxt.org/dbexport.html. + +Download the database dump, and run the file robot_detection.py with the file as first argument. + + $ fetch http://www.robotstxt.org/db/all.txt + $ python robot_detection.py all.txt + +If the database has changed, it'll print out the new version of robot_useragents variable that you need to put into the source code.