allsubscriptionboxes.co.uk
robots.txt
Robots Exclusion Standard data for allsubscriptionboxes.co.uk
Resource Scan
Scan Details
| Site Domain | allsubscriptionboxes.co.uk |
| Base Domain | allsubscriptionboxes.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-11-06T10:33:23+00:00 |
| Next Scan | 2025-11-13T10:33:23+00:00 |
Last Scan
| Scanned | 2025-11-06T10:33:23+00:00 |
| URL | https://allsubscriptionboxes.co.uk/robots.txt |
| Redirect | https://www.allsubscriptionboxes.co.uk/robots.txt |
| Redirect Domain | www.allsubscriptionboxes.co.uk |
| Redirect Base | allsubscriptionboxes.co.uk |
| Domain IPs | 146.88.235.94 |
| Redirect IPs | 146.88.235.94 |
| Response IP | 146.88.235.94 |
| Found | Yes |
| Hash | 6828d6c1376f4350fbd16ef759fcb5dcf021dede593edafec8e46c96005e1263 |
| SimHash | 2640dc135622 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Allow | /*.js$ |
| Allow | /*.css$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
googlebot
| Rule | Path | Comment |
|---|---|---|
| Allow | .js | - |
| Allow | .css | - |
| Allow | /wp-includes | - |
| Allow | /wp-content | - |
| Disallow | /cgi-bin | - |
| Disallow | /wp-admin | - |
| Disallow | /wp-includes | - |
| Disallow | /wp-content | - |
| Disallow | /feed | - |
| Disallow | /*/feed | - |
| Allow | /blog/comment-lancer-une-box-mensuelle-tous-nos-conseils.html | - |
| Disallow | /comments | - |
| Disallow | */comment-* | Blocks the Comments Permalinks and Comment Pages |
alexabot
mediapartners-google
adsbot-google
googlebot-image
googlebot-mobile
ia_archiver-web.archive.org
googlebot
googlebot-image
googlebot-mobile
msnbot
slurp
teoma
twiceler
gigabot
scrubby
robozilla
nutch
ia_archiver
baiduspider
naverbot
yeti
yahoo-mmcrawler
psbot
asterias
yahoo-blogs/v3.9
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.allsubscriptionboxes.co.uk/sitemap_index.xml |
Comments