Log In Sign Up

gayperv.com
robots.txt

Robots Exclusion Standard data for gayperv.com

Resource Scan

Scan Details

Site Domain gayperv.com
Base Domain gayperv.com
Scan Status Ok
Last Scan5/16/2025, 12:13:47 PM
Next Scan 6/15/2025, 12:13:47 PM

Last Scan

Scanned5/16/2025, 12:13:47 PM
URL https://gayperv.com/robots.txt
Redirect https://www.gayperv.com/robots.txt
Redirect Domain www.gayperv.com
Redirect Base gayperv.com
Domain IPs 104.21.83.73, 172.67.217.136, 2606:4700:3031::ac43:d988, 2606:4700:3037::6815:5349
Redirect IPs 104.21.83.73, 172.67.217.136, 2606:4700:3031::ac43:d988, 2606:4700:3037::6815:5349
Response IP 104.21.83.73
Found Yes
Hash e5ce5c58b7db175994c542358305cf0b3b369c7ee29d6c8ee5128050b71f12f0
SimHash 1b18bc47eb10

Groups

*

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.gayperv.com/sitemap.xml
Back to top

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
Back to top

Warnings

  • `host` is not a known field.
Back to top