Page MenuHomeFreeBSD
Files F163265139

D52550.id162222.diff
No OneTemporary
Actions

D52550.id162222.diff
View Options

diff --git a/www/py-robot-detection/pkg-message b/www/py-robot-detection/pkg-message
new file mode 100644
--- /dev/null
+++ b/www/py-robot-detection/pkg-message
@@ -0,0 +1,8 @@
+You can download a new version of the Robot Database from http://www.robotstxt.org/dbexport.html.
+
+Download the database dump, and run the file robot_detection.py with the file as first argument.
+
+ $ fetch http://www.robotstxt.org/db/all.txt
+ $ python robot_detection.py all.txt
+
+If the database has changed, it'll print out the new version of robot_useragents variable that you need to put into the source code.

File Metadata

Mime Type
text/plain
Expires
Wed, Jul 22, 2:08 PM (15 h, 4 m)
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
35366584
Default Alt Text
D52550.id162222.diff (599 B)

Event Timeline