forum.touteslesbieres.fr
robots.txt

Robots Exclusion Standard data for forum.touteslesbieres.fr

Resource Scan

Scan Details

Site Domain forum.touteslesbieres.fr
Base Domain touteslesbieres.fr
Scan Status Ok
Last Scan2025-12-09T14:28:31+00:00
Next Scan 2026-01-08T14:28:31+00:00

Last Scan

Scanned2025-12-09T14:28:31+00:00
URL http://forum.touteslesbieres.fr/robots.txt
Domain IPs 2001:41d0:1:1b00:213:186:33:87, 213.186.33.168
Response IP 213.186.33.168
Found Yes
Hash e5a1bac2969df7cc0b63e102df93a4848a8b8d34a7111da7dbd3379cf89722cb
SimHash 4e294c22bb32

Groups

*

Rule Path
Disallow /a
Disallow /d
Disallow /c
Disallow /e
Disallow /j
Disallow /l
Disallow /m
Disallow /p
Disallow /r
Disallow /s
Disallow /u
Disallow /*pid%3D

yandex

Rule Path
Disallow /a
Disallow /d
Disallow /c
Disallow /e
Disallow /j
Disallow /l
Disallow /m
Disallow /p
Disallow /r
Disallow /s
Disallow /u
Disallow /*pid%3D

Other Records

Field Value
crawl-delay 5

Warnings

  • `clean-param` is not a known field.