berlin-visual.com
robots.txt

Robots Exclusion Standard data for berlin-visual.com

Resource Scan

Scan Details

Site Domain berlin-visual.com
Base Domain berlin-visual.com
Scan Status Ok
Last Scan2024-09-22T05:46:53+00:00
Next Scan 2024-09-29T05:46:53+00:00

Last Scan

Scanned2024-09-22T05:46:53+00:00
URL https://berlin-visual.com/robots.txt
Domain IPs 2a01:4f9:2a:1427::3, 95.216.19.203
Response IP 95.216.19.203
Found Yes
Hash ff0d6db0f146f0fe2afa432474688e5e5847132f9aef284088fda908e231f317
SimHash 084cdc60b6b1

Groups

*

Rule Path
Allow /
Disallow /html/
Disallow /search/
Disallow /register/
Disallow /password/
Disallow /login/
Disallow /logout/

Other Records

Field Value
crawl-delay 10

Comments

  • Directories
  • Paths (clean URLs)