barwy.net
robots.txt

Robots Exclusion Standard data for barwy.net

Resource Scan

Scan Details

Site Domain barwy.net
Base Domain barwy.net
Scan Status Ok
Last Scan2024-11-16T10:57:03+00:00
Next Scan 2024-11-23T10:57:03+00:00

Last Scan

Scanned2024-11-16T10:57:03+00:00
URL https://barwy.net/robots.txt
Redirect https://www.barwy.net/robots.txt
Redirect Domain www.barwy.net
Redirect Base barwy.net
Domain IPs 178.62.231.161
Redirect IPs 178.62.231.161
Response IP 178.62.231.161
Found Yes
Hash 1a54d853730ed7e6240c1a050c99e41a9d602b385bc01b4f958f935614692d66
SimHash 690c9d9166d0

Groups

*

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /admin/

Other Records

Field Value
sitemap https://www.barwy.net/sitemap.xml

Comments

  • /robots.txt file for https://www.barwy.net/
  • mail barwy@barwy.net for constructive criticism.