sunsetbld.com
robots.txt

Robots Exclusion Standard data for sunsetbld.com

Resource Scan

Scan Details

Site Domain sunsetbld.com
Base Domain sunsetbld.com
Scan Status Ok
Last Scan2025-09-02T11:31:20+00:00
Next Scan 2025-10-02T11:31:20+00:00

Last Scan

Scanned2025-09-02T11:31:20+00:00
URL https://sunsetbld.com/robots.txt
Redirect https://www.sunsetbld.com/robots.txt
Redirect Domain www.sunsetbld.com
Redirect Base sunsetbld.com
Domain IPs 185.125.27.5
Redirect IPs 185.125.27.5
Response IP 185.125.27.5
Found Yes
Hash effd06637f6227fa2d7b0fd969d233d7764f98960d1f9718bfe426d544b07e17
SimHash 3e1e5d27c579

Groups

ahrefsbot
ahrefssiteaudit
blexbot
mj12bot
semrushbot
siteauditbot
yandexbot

Rule Path
Disallow /

ccbot
google-extended

Rule Path
Disallow /
Disallow */trackback
Disallow /*/feed
Disallow /*/comments
Disallow /cgi-bin
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow /*.cgi$
Disallow /forum/search.php?

Other Records

Field Value
sitemap https://www.sunsetbld.com/sitemap_index.xml
sitemap https://www.sunsetbld.com/forum/sitemap.xml