special.com.au
robots.txt
Robots Exclusion Standard data for special.com.au
Resource Scan
Scan Details
Site Domain | special.com.au |
Base Domain | special.com.au |
Scan Status | Ok |
Last Scan | 2024-10-27T00:48:15+00:00 |
Next Scan | 2024-11-10T00:48:15+00:00 |
Last Scan
Scanned | 2024-10-27T00:48:15+00:00 |
URL | https://special.com.au/robots.txt |
Domain IPs | 108.157.254.14, 108.157.254.4, 108.157.254.43, 108.157.254.97, 2600:9000:2753:2200:1a:22ba:cac0:93a1, 2600:9000:2753:4000:1a:22ba:cac0:93a1, 2600:9000:2753:7200:1a:22ba:cac0:93a1, 2600:9000:2753:8c00:1a:22ba:cac0:93a1, 2600:9000:2753:c00:1a:22ba:cac0:93a1, 2600:9000:2753:ca00:1a:22ba:cac0:93a1, 2600:9000:2753:e000:1a:22ba:cac0:93a1, 2600:9000:2753:e800:1a:22ba:cac0:93a1 |
Response IP | 108.157.254.4 |
Found | Yes |
Hash | 128b1c785912862b7d8c2ae39dbaba3a72d0f491456db3b742dd0480c3d4beaa |
SimHash | 6b048651c7b0 |
Other Records
Field | Value |
---|---|
sitemap | https://www.special.com.au/sitemap.xml |
Warnings
- `host` is not a known field.
Comments