timsterling.com
robots.txt

Robots Exclusion Standard data for timsterling.com

Resource Scan

Scan Details

Site Domain timsterling.com
Base Domain timsterling.com
Scan Status Ok
Last Scan2025-10-28T07:44:52+00:00
Next Scan 2025-11-27T07:44:52+00:00

Last Scan

Scanned2025-10-28T07:44:52+00:00
URL http://timsterling.com/robots.txt
Redirect http://www.timsterling.com/robots.txt
Redirect Domain www.timsterling.com
Redirect Base timsterling.com
Domain IPs 199.34.228.100
Redirect IPs 199.34.228.100
Response IP 199.34.228.100
Found Yes
Hash 8f04a2c411a55d13f87d8ced467337536bdcbe6061a3de5391fa73d4b1be6ad7
SimHash 2b54dc546793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap http://www.timsterling.com/sitemap.xml