Log In Sign Up

benaughtytest.de
robots.txt

Robots Exclusion Standard data for benaughtytest.de

Resource Scan

Scan Details

Site Domain benaughtytest.de
Base Domain benaughtytest.de
Scan Status Ok
Last Scan2024-06-02T19:13:36+00:00
Next Scan 2024-07-02T19:13:36+00:00

Last Scan

Scanned2024-06-02T19:13:36+00:00
URL https://benaughtytest.de/robots.txt
Domain IPs 104.21.42.59, 172.67.201.90, 2606:4700:3033::6815:2a3b, 2606:4700:3033::ac43:c95a
Response IP 104.21.42.59
Found Yes
Hash 6be3abac82b12021f5568203c9ecefacce860e5d2cee07d4a1a41fd0e3e6254e
SimHash 883475d25fcb

Groups

googlebot

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow

alexa

Rule Path
Disallow /

archive.org

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /
Back to top