pepperdeals.se
robots.txt
Robots Exclusion Standard data for pepperdeals.se
Resource Scan
Scan Details
| Site Domain | pepperdeals.se |
| Base Domain | pepperdeals.se |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-27T10:39:43+00:00 |
| Next Scan | 2024-11-25T10:39:43+00:00 |
Last Successful Scan
| Scanned | 2024-04-30T10:38:10+00:00 |
| URL | https://pepperdeals.se/robots.txt |
| Redirect | https://www.pepperdeals.se/robots.txt |
| Redirect Domain | www.pepperdeals.se |
| Redirect Base | pepperdeals.se |
| Domain IPs | 104.18.2.63, 104.18.3.63, 2606:4700::6812:23f, 2606:4700::6812:33f |
| Redirect IPs | 104.18.2.63, 104.18.3.63, 2606:4700::6812:23f, 2606:4700::6812:33f |
| Response IP | 104.18.2.63 |
| Found | Yes |
| Hash | eea9a5c33770a795f0fcfdc5ba7a5c647d1a0d42be6f15a29974cee23311596b |
| SimHash | c0a69110cf20 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /cdn-cgi/ |
| Disallow | /selection |
| Disallow | /assets/js/share/thread-embed.js |
| Disallow | /admin |
| Disallow | /*?layout=* |
| Disallow | /login |
| Disallow | /visit/ |
| Disallow | /graphql |
| Disallow | /rabattkoder/api/* |
| Disallow | /rabattkoder/loading/* |
| Disallow | /rabattkoder/m/clickout |
| Disallow | /rabattkoder/m/click-* |
| Disallow | /rabattkoder/m/cn-clickout* |
| Disallow | /rabattkoder/clickout/* |
| Disallow | /rabattkoder/user/submit |
| Disallow | /rabattkoder/*?preview |
| Disallow | /rabattkoder/m/clickout/* |
| Disallow | /rest-api/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.pepperdeals.se/sitemap/sitemap.xml.gz |
| sitemap | https://www.pepperdeals.se/rabattkoder/sitemap.xml |