magazinera.com
robots.txt

Robots Exclusion Standard data for magazinera.com

Resource Scan

Scan Details

Site Domain magazinera.com
Base Domain magazinera.com
Scan Status Ok
Last Scan2024-11-14T10:06:38+00:00
Next Scan 2024-11-21T10:06:38+00:00

Last Scan

Scanned2024-11-14T10:06:38+00:00
URL https://magazinera.com/robots.txt
Domain IPs 104.21.15.133, 172.67.162.165, 2606:4700:3035::6815:f85, 2606:4700:3036::ac43:a2a5
Response IP 104.21.15.133
Found Yes
Hash 21d8d131a20150bfc1609f15c5531b35743ea6b0d44f00f1f6dbae3dd47b89fe
SimHash 6700dc51c3b0

Groups

*

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://magazinera.com/sitemap.xml

Warnings

  • `host` is not a known field.