jocelynthompson.com.au
robots.txt

Robots Exclusion Standard data for jocelynthompson.com.au

Resource Scan

Scan Details

Site Domain jocelynthompson.com.au
Base Domain jocelynthompson.com.au
Scan Status Ok
Last Scan2025-12-31T10:57:15+00:00
Next Scan 2026-01-30T10:57:15+00:00

Last Scan

Scanned2025-12-31T10:57:15+00:00
URL http://jocelynthompson.com.au/robots.txt
Redirect http://www.jocelynthompson.com.au/robots.txt
Redirect Domain www.jocelynthompson.com.au
Redirect Base jocelynthompson.com.au
Domain IPs 199.34.228.59
Redirect IPs 199.34.228.59
Response IP 199.34.228.59
Found Yes
Hash 4dd2dc603a4098f1b971422c0285556d1814c08526f8174a0d6f1258347d8692
SimHash 4054dc762f93

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap http://www.jocelynthompson.com.au/sitemap.xml