caterkwik.co.uk
robots.txt
Robots Exclusion Standard data for caterkwik.co.uk
Resource Scan
Scan Details
| Site Domain | caterkwik.co.uk |
| Base Domain | caterkwik.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-12-13T16:06:31+00:00 |
| Next Scan | 2026-01-12T16:06:31+00:00 |
Last Scan
| Scanned | 2025-12-13T16:06:31+00:00 |
| URL | https://caterkwik.co.uk/robots.txt |
| Redirect | https://www.caterkwik.co.uk/robots.txt |
| Redirect Domain | www.caterkwik.co.uk |
| Redirect Base | caterkwik.co.uk |
| Domain IPs | 104.26.6.89, 104.26.7.89, 172.67.73.216, 2606:4700:20::681a:659, 2606:4700:20::681a:759, 2606:4700:20::ac43:49d8 |
| Redirect IPs | 104.26.6.89, 104.26.7.89, 172.67.73.216, 2606:4700:20::681a:659, 2606:4700:20::681a:759, 2606:4700:20::ac43:49d8 |
| Response IP | 104.26.7.89 |
| Found | Yes |
| Hash | 4305ab5841a11fa1aa8b5d0814f8ec487e90fdedca2d8979bef05b53084fed82 |
| SimHash | 620cddd48d51 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /siteadmin |
| Disallow | /shopadmin |
| Disallow | /cgi-bin/shop/index.cgi |
| Disallow | /awstats |
| Disallow | /shop/html_templates/caterkwik08 |
| Disallow | /news/wp-content/themes/ |
| Disallow | /news/wp-admin |
| Disallow | /news/wp-login.php |
| Disallow | /discount-club/customer-signup |
| Disallow | /dccs |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.caterkwik.co.uk/sitemap.xml |