preisjaeger.at
robots.txt
Robots Exclusion Standard data for preisjaeger.at
Resource Scan
Scan Details
| Site Domain | preisjaeger.at |
| Base Domain | preisjaeger.at |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-24T08:28:39+00:00 |
| Next Scan | 2024-11-22T08:28:39+00:00 |
Last Successful Scan
| Scanned | 2024-04-27T08:25:41+00:00 |
| URL | https://preisjaeger.at/robots.txt |
| Redirect | https://www.preisjaeger.at/robots.txt |
| Redirect Domain | www.preisjaeger.at |
| Redirect Base | preisjaeger.at |
| Domain IPs | 104.18.20.8, 104.18.21.8, 2606:4700::6812:1408, 2606:4700::6812:1508 |
| Redirect IPs | 104.18.20.8, 104.18.21.8, 2606:4700::6812:1408, 2606:4700::6812:1508 |
| Response IP | 104.18.20.8 |
| Found | Yes |
| Hash | 8e285f6b3e7321e768ff8135f086ef88384336caea4e5dd9809c67258b958c64 |
| SimHash | c80a4010ce21 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /search/price_comparison/geizhals |
| Disallow | /cdn-cgi/ |
| Disallow | /weiterleitung/ |
| Disallow | */feed/ |
| Disallow | */trackback/ |
| Disallow | /assets/js/share/thread-embed.js |
| Disallow | /selection |
| Disallow | /admin |
| Disallow | /*?layout=* |
| Disallow | /login |
| Disallow | /visit/ |
| Disallow | /graphql |
| Disallow | /gutschein/api/* |
| Disallow | /gutschein/loading/* |
| Disallow | /gutschein/m/clickout |
| Disallow | /gutschein/m/click-* |
| Disallow | /gutschein/m/cn-clickout* |
| Disallow | /gutschein/clickout/* |
| Disallow | /gutschein/user/submit |
| Disallow | /gutschein/*?preview |
| Disallow | /gutschein/m/clickout/* |
| Disallow | /rest-api/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.preisjaeger.at/sitemap/sitemap.xml.gz |
| sitemap | https://www.preisjaeger.at/gutschein/sitemap.xml |