jasonsavard.com
robots.txt
Robots Exclusion Standard data for jasonsavard.com
Resource Scan
Scan Details
| Site Domain | jasonsavard.com |
| Base Domain | jasonsavard.com |
| Scan Status | Ok |
| Last Scan | 2024-11-09T17:42:07+00:00 |
| Next Scan | 2024-11-16T17:42:07+00:00 |
Last Scan
| Scanned | 2024-11-09T17:42:07+00:00 |
| URL | https://jasonsavard.com/robots.txt |
| Domain IPs | 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138 |
| Response IP | 52.221.42.138 |
| Found | Yes |
| Hash | d60ab66b28b6e675d7c68be8deb1ef9e20702d9db752ccff5ad8a0c88f642da0 |
| SimHash | 69169c96e513 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /test |
| Disallow | /wikitemp |
| Disallow | /mediawiki/index.php |
| Disallow | /wiki/index.php |
| Disallow | /wiki/User%3A |
| Disallow | /wiki/MediaWiki%3A |
| Disallow | /wiki/Special%3A |
| Disallow | /wiki/Talk%3A |
| Disallow | /faq?wikiPage |
| Disallow | /*?ref= |
| Disallow | /fullfrontal |
| Disallow | /forum/entry/signin |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://jasonsavard.com/sitemap.xml |