awd.is
robots.txt
Robots Exclusion Standard data for awd.is
Resource Scan
Scan Details
| Site Domain | awd.is |
| Base Domain | awd.is |
| Scan Status | Ok |
| Last Scan | 2024-09-23T11:42:18+00:00 |
| Next Scan | 2024-09-30T11:42:18+00:00 |
Last Scan
| Scanned | 2024-09-23T11:42:18+00:00 |
| URL | https://awd.is/robots.txt |
| Domain IPs | 136.243.53.153 |
| Response IP | 136.243.53.153 |
| Found | Yes |
| Hash | 548b6ad4214035c17bc63e4db421b2ed7df82ba754e441496dd5ce92f9ccb59f |
| SimHash | 471c8a453236 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin |
| Disallow | /wp-json/ |
| Disallow | /xmlrpc.php |
| Disallow | /readme.html |
| Disallow | /de/* |
| Disallow | /pt/* |
| Disallow | /it/* |
| Disallow | /fr/* |
| Disallow | /es/* |
| Disallow | /ca/* |
| Disallow | /en/* |
| Disallow | /zh-TW/* |
| Disallow | /ta/* |
| Disallow | /*/vinskiawd |
| Disallow | /*/vinskiy_awd |
| Disallow | /*/feed* |
| Disallow | /*/?filter_by=review_high%3Ffilter_by=review_high* |
| Disallow | /*/?filter_by=popular7filter_bypopular7 |
| Disallow | /*/?filter_by=popularfilter_bypopular |
| Disallow | /*.htm |
| Disallow | /archive |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | /?s= |
| Allow | /*.css |
| Allow | /*.js |
Other Records
| Field | Value |
|---|---|
| sitemap | https://awd.is/sitemap_index.xml |
| sitemap | https://awd.is/sitemap_index.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.