From 078f3d7416be51cb03ff674c5bcafab711f9225f Mon Sep 17 00:00:00 2001 From: Klemek Date: Sun, 4 Apr 2021 21:57:16 +0200 Subject: [PATCH] updated readme --- README.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/README.md b/README.md index b990175..ad6f0c2 100644 --- a/README.md +++ b/README.md @@ -336,6 +336,11 @@ Any URL like `/year/month/day/anything/` will redirect to this article (and link * `hit_counter` * `unique_visitor_timeout`: (default: 7200000 / 2h) specify the time (in ms) before a visitor can be accounted again +* `robots` + * `list_url`: (default: https://raw.githubusercontent.com/atmire/COUNTER-Robots/master/COUNTER_Robots_list.json) + url to fetch for web crawlers patterns + * `list_file`: (default: robots_list.json) + file to store web crawlers patterns * `redis` Options to connect to redis (see [redis options](https://github.com/NodeRedis/node-redis#options-object-properties) for more info) * `host`: (default: localhost)