Log In Sign Up

xlgaytube.tv
robots.txt

Robots Exclusion Standard data for xlgaytube.tv

Resource Scan

Scan Details

Site Domain xlgaytube.tv
Base Domain xlgaytube.tv
Scan Status Ok
Last Scan2025-04-07T13:25:36+00:00
Next Scan 2025-05-07T13:25:36+00:00

Last Scan

Scanned2025-04-07T13:25:36+00:00
URL https://xlgaytube.tv/robots.txt
Redirect https://www.xlgaytube.tv/robots.txt
Redirect Domain www.xlgaytube.tv
Redirect Base xlgaytube.tv
Domain IPs 104.21.55.123, 172.67.148.26, 2606:4700:3030::ac43:941a, 2606:4700:3036::6815:377b
Redirect IPs 104.21.55.123, 172.67.148.26, 2606:4700:3030::ac43:941a, 2606:4700:3036::6815:377b
Response IP 104.21.55.123
Found Yes
Hash 512dfaa81cb5a0656306ef059c888f3aa4eaa8e9f8f67a1ce694c87d2b0e4c13
SimHash 39149c07cb30

Groups

*

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.xlgaytube.tv/sitemap.xml
Back to top

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
Back to top

Warnings

  • `host` is not a known field.
Back to top