racq.com.au
robots.txt
Robots Exclusion Standard data for racq.com.au
Resource Scan
Scan Details
Site Domain | racq.com.au |
Base Domain | racq.com.au |
Scan Status | Ok |
Last Scan | 2024-10-19T08:53:53+00:00 |
Next Scan | 2024-11-18T08:53:53+00:00 |
Last Scan
Scanned | 2024-10-19T08:53:53+00:00 |
URL | https://racq.com.au/robots.txt |
Redirect | https://www.racq.com.au:443/robots.txt |
Redirect Domain | www.racq.com.au |
Redirect Base | racq.com.au |
Domain IPs | 13.33.30.19, 13.33.30.2, 13.33.30.73, 13.33.30.76 |
Redirect IPs | 13.33.30.19, 13.33.30.2, 13.33.30.73, 13.33.30.76 |
Response IP | 13.33.30.19 |
Found | Yes |
Hash | 174360ade79a3113cb47f2fdff8133d9021da6b27ce253bb5eb0b5e6f17b82dd |
SimHash | 3590a92155fe |
Groups
*
Rule | Path | Comment |
---|---|---|
Allow | /*.js | - |
Allow | /*.css | - |
Allow | /*.js?* | - |
Allow | /*.css?* | - |
Disallow | /en/.* | - |
Disallow | /temp/ | - |
Disallow | /?tag= | - |
Disallow | /forms/ | - |
Disallow | /*.pdf$ | - |
Disallow | /upload/ | - |
Disallow | /hidden* | - |
Disallow | /sitecore | - |
Disallow | /Sitecore | - |
Disallow | /*?la=en* | - |
Disallow | /search | * |
Disallow | */data/*? | - |
Disallow | /sitecore/ | - |
Disallow | /App_Data/ | - |
Disallow | /Overlays* | - |
Disallow | /overlays* | - |
Disallow | /ajaxpages* | - |
Disallow | /App_config/ | - |
Disallow | /App_Browsers/ | - |
Disallow | /sitecore_files/ | - |
Disallow | /help-contact/search | * |
Disallow | /-/media/project/racqgroup/racq/pdf* | - |
Other Records
Field | Value |
---|---|
sitemap | https://www.racq.com.au/sitemap.xml |
Warnings
- 1 invalid line.