Log In Sign Up

rodi-db.de
robots.txt

Robots Exclusion Standard data for rodi-db.de

Resource Scan

Scan Details

Site Domain rodi-db.de
Base Domain rodi-db.de
Scan Status Ok
Last Scan2024-06-28T04:22:34+00:00
Next Scan 2024-07-05T04:22:34+00:00

Last Scan

Scanned2024-06-28T04:22:34+00:00
URL https://rodi-db.de/robots.txt
Redirect https://www.rodi-db.de/robots.txt
Redirect Domain www.rodi-db.de
Redirect Base rodi-db.de
Domain IPs 195.201.124.42, 2a01:4f8:c2c:8315::1
Redirect IPs 195.201.124.42, 2a01:4f8:c2c:8315::1
Response IP 195.201.124.42
Found Yes
Hash 749fc8d9106e40b8146f96e2a3837da2a59cda722088ce7de7fad5ec9935578e
SimHash 2cb81dc126a6

Groups

*

Rule Path
Disallow /admin_*.php
Disallow /static/

Other Records

Field Value
crawl-delay 60
Back to top

Comments

  • This robots.txt file controls crawling of URLs under https://www.rodi-db.de.
  • User-agent: Googlebot
  • Disallow: /admin_*.php
Back to top