Page MenuHomeFreeBSD
Files F163146094

D52550.id162223.diff
No OneTemporary
Actions

D52550.id162223.diff
View Options

diff --git a/www/py-robot-detection/pkg-message b/www/py-robot-detection/pkg-message
new file mode 100644
--- /dev/null
+++ b/www/py-robot-detection/pkg-message
@@ -0,0 +1,8 @@
+You can download a new version of the Robot Database from http://www.robotstxt.org/dbexport.html.
+
+Download the database dump, and run the file robot_detection.py with the file as first argument.
+
+ $ fetch http://www.robotstxt.org/db/all.txt
+ $ python robot_detection.py all.txt
+
+If the database has changed, it'll print out the new version of robot_useragents variable that you need to put into the source code.

File Metadata

Mime Type
text/plain
Expires
Tue, Jul 21, 12:36 PM (8 h, 45 m)
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
35316970
Default Alt Text
D52550.id162223.diff (599 B)

Event Timeline