austonjames.com
robots.txt
Robots Exclusion Standard data for austonjames.com
Resource Scan
Scan Details
| Site Domain | austonjames.com |
| Base Domain | austonjames.com |
| Scan Status | Ok |
| Last Scan | 2025-09-25T23:20:13+00:00 |
| Next Scan | 2025-10-09T23:20:13+00:00 |
Last Scan
| Scanned | 2025-09-25T23:20:13+00:00 |
| URL | https://austonjames.com/robots.txt |
| Redirect | https://www.austonjames.com//robots.txt |
| Redirect Domain | www.austonjames.com |
| Redirect Base | austonjames.com |
| Domain IPs | 2607:f1c0:100f:f000::200, 74.208.236.246 |
| Redirect IPs | 69.22.188.40, 69.22.188.41 |
| Response IP | 69.22.188.40 |
| Found | Yes |
| Hash | 86ac49c1a4ee695b30d19f4d970a907210acdc2a5fd0cb296558eb7b76d2c961 |
| SimHash | d05ecccaef44 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /adm/ |
| Disallow | /ajax/ |
| Disallow | /com/ |
| Disallow | /ext/ |
| Disallow | /ltr/ |
| Disallow | /mem/ |
| Disallow | /mu/ |
| Disallow | /pp/ |
| Disallow | /ezp/ |
| Disallow | /cart/ |
| Disallow | /c/*/login |
| Disallow | /c/*/signup* |
| Disallow | /fees |
| Disallow | /signup/trial |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.austonjames.com/user-sitemap/sitemap-U00001tlras4cL_U/0.xml.gz |
Comments