Log In Sign Up

auntannie.com
robots.txt

Robots Exclusion Standard data for auntannie.com

Resource Scan

Scan Details

Site Domain auntannie.com
Base Domain auntannie.com
Scan Status Ok
Last Scan2024-10-30T20:00:49+00:00
Next Scan 2024-11-06T20:00:49+00:00

Last Scan

Scanned2024-10-30T20:00:49+00:00
URL https://auntannie.com/robots.txt
Redirect https://www.auntannie.com/robots.txt
Redirect Domain www.auntannie.com
Redirect Base auntannie.com
Domain IPs 13.227.254.14, 13.227.254.36, 13.227.254.49, 13.227.254.74, 2600:9000:200a:4a00:1b:6616:e080:93a1, 2600:9000:200a:4c00:1b:6616:e080:93a1, 2600:9000:200a:5600:1b:6616:e080:93a1, 2600:9000:200a:6200:1b:6616:e080:93a1, 2600:9000:200a:9e00:1b:6616:e080:93a1, 2600:9000:200a:c400:1b:6616:e080:93a1, 2600:9000:200a:c600:1b:6616:e080:93a1, 2600:9000:200a:dc00:1b:6616:e080:93a1
Redirect IPs 13.225.4.110, 13.225.4.7, 13.225.4.78, 13.225.4.99, 2600:9000:21b4:1a00:13:1d58:7800:93a1, 2600:9000:21b4:2800:13:1d58:7800:93a1, 2600:9000:21b4:3c00:13:1d58:7800:93a1, 2600:9000:21b4:4000:13:1d58:7800:93a1, 2600:9000:21b4:7400:13:1d58:7800:93a1, 2600:9000:21b4:9e00:13:1d58:7800:93a1, 2600:9000:21b4:cc00:13:1d58:7800:93a1, 2600:9000:21b4:e400:13:1d58:7800:93a1
Response IP 13.225.4.99
Found Yes
Hash 03b481b34879bd264ccf85b9ebe375b737727f098039e411fc9b757ea707e901
SimHash 381859c4ea00

Groups

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.auntannie.com/sitemap.xml
Back to top