Log In Sign Up

go-gaytube.com
robots.txt

Robots Exclusion Standard data for go-gaytube.com

Resource Scan

Scan Details

Site Domain go-gaytube.com
Base Domain go-gaytube.com
Scan Status Ok
Last Scan6/7/2025, 4:20:31 PM
Next Scan 7/7/2025, 4:20:31 PM

Last Scan

Scanned6/7/2025, 4:20:31 PM
URL https://go-gaytube.com/robots.txt
Redirect https://www.go-gaytube.com/robots.txt
Redirect Domain www.go-gaytube.com
Redirect Base go-gaytube.com
Domain IPs 104.21.71.149, 172.67.170.181, 2606:4700:3031::ac43:aab5, 2606:4700:3032::6815:4795
Redirect IPs 104.21.71.149, 172.67.170.181, 2606:4700:3031::ac43:aab5, 2606:4700:3032::6815:4795
Response IP 104.21.71.149
Found Yes
Hash e097043a3babfbdb3a924b4d07139cc93196a4f72f14fa0e847c24f46990da54
SimHash 291c9d07cb13

Groups

*

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.go-gaytube.com/sitemap.xml
Back to top

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
Back to top

Warnings

  • `host` is not a known field.
Back to top