bast.de
robots.txt

Robots Exclusion Standard data for bast.de

Resource Scan

Scan Details

Site Domain bast.de
Base Domain bast.de
Scan Status Ok
Last Scan2025-09-27T19:08:04+00:00
Next Scan 2025-10-27T19:08:04+00:00

Last Scan

Scanned2025-09-27T19:08:04+00:00
URL https://bast.de/robots.txt
Domain IPs 141.38.3.30
Response IP 141.38.3.30
Found Yes
Hash 42e640088103cbb4df36df93f2ad03983f34e6a90fd92c868fab5c1af70b4315
SimHash 451000e4ddd1

Groups

*

Rule Path
Disallow /SiteGlobals/
Disallow /DE/Service/
Disallow /EN/Service/
Allow /SiteGlobals/Modules/
Allow /SiteGlobals/StyleBundles/
Allow /SiteGlobals/Frontend/

Other Records

Field Value
crawl-delay 30