aab.dk
robots.txt
Robots Exclusion Standard data for aab.dk
Resource Scan
Scan Details
| Site Domain | aab.dk |
| Base Domain | aab.dk |
| Scan Status | Ok |
| Last Scan | 2026-01-01T04:03:38+00:00 |
| Next Scan | 2026-01-31T04:03:38+00:00 |
Last Scan
| Scanned | 2026-01-01T04:03:38+00:00 |
| URL | https://aab.dk/robots.txt |
| Domain IPs | 34.88.230.205 |
| Response IP | 34.88.230.205 |
| Found | Yes |
| Hash | 951a14bdc83be5f73aa23c39bcc9b13293e0d4f70142f30302c4cfa575e622c3 |
| SimHash | 21d8215b0776 |
Groups
*
| Product | Comment |
|---|---|
| * | general rules for robots of all search engines |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | service folder for storing server scripts |
| Disallow | /? | all request parameters on the main |
| Disallow | /wp- | all files WP: /wp-json/, /wp-includes, /wp-content/plugins |
| Disallow | /wp/ | if there is a subdirectory / wp / where the CMS is installed (if not, # rule can be removed) |
| Disallow | *?s= | site search |
| Disallow | *%26s%3D | site search |
| Disallow | /search/ | site search |
| Disallow | /author/ | author's archive |
| Disallow | /users/ | user archive |
| Disallow | */trackback | trackbacks, notifications in comments about a link to a web document |
| Disallow | */feed | all feeds |
| Disallow | */rss | rss feed |
| Disallow | */embed | all embeddings |
| Disallow | */wlwmanifest.xml | xml Windows Live Writer manifest file (if not using, # rule can be removed) |
| Disallow | /xmlrpc.php | WordPress API file |
| Disallow | *utm*%3D | utm |
| Disallow | *openstat%3D | openstat tags |
| Allow | */uploads | open the folder with files uploads |
| Allow | /*/*.js | open js files |
| Allow | /*/*.css | open css files |
| Allow | /wp-*.png | allow indexing images |
| Allow | /wp-*.jpg | allow indexing images |
| Allow | /wp-*.jpeg | allow indexing images |
| Allow | /wp-*.gif | allow indexing gifs |
| Allow | /wp-admin/admin-ajax.php | allow ajax |
Other Records
| Field | Value |
|---|---|
| sitemap | https://aab.dk/sitemap.xml |
Comments