gaystryst.com
robots.txt

Robots Exclusion Standard data for gaystryst.com

Resource Scan

Scan Details

Site Domain gaystryst.com
Base Domain gaystryst.com
Scan Status Ok
Last Scan2024-08-30T11:44:32+00:00
Next Scan 2024-09-29T11:44:32+00:00

Last Scan

Scanned2024-08-30T11:44:32+00:00
URL https://gaystryst.com/robots.txt
Redirect https://www.gaystryst.com/robots.txt
Redirect Domain www.gaystryst.com
Redirect Base gaystryst.com
Domain IPs 138.197.208.131, 159.203.100.29
Redirect IPs 23.215.7.30, 23.215.7.31, 2600:1413:b000:1b::17d7:71e, 2600:1413:b000:1b::17d7:71f
Response IP 23.52.40.26
Found Yes
Hash 1d48c8516acb0e7a96ab1a038c4286c569f3d1f2c62cba9c46e48c92fee589f8
SimHash 39155840cd33

Groups

*

Rule Path
Disallow *autologin*

ia_archiver

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

surveybot_ignoreip

Rule Path
Disallow /

*

Rule Path
Disallow /landing/mta
Disallow /t/tr

Other Records

Field Value
sitemap https://www.gaystryst.com/sitemap.xml