sportspeople.com.au
robots.txt
Robots Exclusion Standard data for sportspeople.com.au
Resource Scan
Scan Details
Site Domain | sportspeople.com.au |
Base Domain | sportspeople.com.au |
Scan Status | Ok |
Last Scan | 2024-08-31T17:58:55+00:00 |
Next Scan | 2024-09-30T17:58:55+00:00 |
Last Scan
Scanned | 2024-08-31T17:58:55+00:00 |
URL | https://sportspeople.com.au/robots.txt |
Domain IPs | 108.156.133.11, 108.156.133.21, 108.156.133.50, 108.156.133.57, 2600:9000:2755:3200:0:63f2:7980:93a1, 2600:9000:2755:5200:0:63f2:7980:93a1, 2600:9000:2755:7000:0:63f2:7980:93a1, 2600:9000:2755:9600:0:63f2:7980:93a1, 2600:9000:2755:b200:0:63f2:7980:93a1, 2600:9000:2755:ce00:0:63f2:7980:93a1, 2600:9000:2755:d800:0:63f2:7980:93a1, 2600:9000:2755:fe00:0:63f2:7980:93a1 |
Response IP | 108.156.133.21 |
Found | Yes |
Hash | 0f3597f46859df9697857ed03f78ca20a427b3c32baf710af87bd623f5638e22 |
SimHash | 8a1066a6c3b1 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /pay |
Disallow | /pay-new |
Disallow | /admin/ |
Disallow | /site/ |
Disallow | /Content/ |
Disallow | /resources/ |
Disallow | /files/ |
Disallow | /a/ |
Allow | /a/auth/register* |
Allow | /site/**/*.js |
Allow | /site/**/*.css |
Allow | /site/**/*.jpg |
Allow | /site/**/*.png |
Allow | /site/**/*.gif |