mottmac.com
robots.txt
Robots Exclusion Standard data for mottmac.com
Resource Scan
Scan Details
| Site Domain | mottmac.com |
| Base Domain | mottmac.com |
| Scan Status | Ok |
| Last Scan | 2024-06-21T17:27:26+00:00 |
| Next Scan | 2024-07-05T17:27:26+00:00 |
Last Scan
| Scanned | 2024-06-21T17:27:26+00:00 |
| URL | https://www.mottmac.com/robots.txt |
| Domain IPs | 13.35.18.29, 13.35.18.40, 13.35.18.54, 13.35.18.78, 2600:9000:20c7:1000:1b:f18b:b9c0:93a1, 2600:9000:20c7:3800:1b:f18b:b9c0:93a1, 2600:9000:20c7:5000:1b:f18b:b9c0:93a1, 2600:9000:20c7:5a00:1b:f18b:b9c0:93a1, 2600:9000:20c7:7000:1b:f18b:b9c0:93a1, 2600:9000:20c7:a600:1b:f18b:b9c0:93a1, 2600:9000:20c7:be00:1b:f18b:b9c0:93a1, 2600:9000:20c7:c200:1b:f18b:b9c0:93a1 |
| Response IP | 13.35.18.29 |
| Found | Yes |
| Hash | 5da3d2a841e851d8431b8cd71dfda44621f9edf9e88e5b3c451fb0dce805ba51 |
| SimHash | 84445c44c0d7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?term=* |
| Disallow | /*?appliedFilters=* |
| Disallow | /ethicsau |
| Disallow | /admin |
| Disallow | /*?showcookieconsent* |
| Disallow | /*?nocache* |
| Disallow | /.well-known/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mottmac.com/sitemap.xml |
Warnings
- 2 invalid lines.