senetic.co.uk
robots.txt

Robots Exclusion Standard data for senetic.co.uk

Resource Scan

Scan Details

Site Domain senetic.co.uk
Base Domain senetic.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-24T16:19:12+00:00
Next Scan 2026-01-22T16:19:12+00:00

Last Successful Scan

Scanned2025-03-05T12:34:57+00:00
URL https://senetic.co.uk/robots.txt
Redirect https://www.senetic.co.uk/robots.txt
Redirect Domain www.senetic.co.uk
Redirect Base senetic.co.uk
Domain IPs 104.18.2.251, 104.18.3.251, 2606:4700::6812:2fb, 2606:4700::6812:3fb
Redirect IPs 104.18.2.251, 104.18.3.251, 2606:4700::6812:2fb, 2606:4700::6812:3fb
Response IP 104.18.2.251
Found Yes
Hash ef83fb4a2786c45c55008ba4f3cfb2a105f8595a262d7bfb95f7ad1c2cf4b49c
SimHash c70a42f2db95

Groups

*

Rule Path
Allow /
Disallow /account/
Disallow /notify/password/
Disallow /GoogleSitemapProduct.php
Disallow /ic_product_ajax_description.php
Disallow /ic_product_ajax_description.php?
Disallow */new_order_ajax.php
Disallow */new_cart_ajax.php
Disallow */feed/
Disallow *?*sortBy=
Disallow *?*sortDirection=
Disallow *?*PageSpeed=
Disallow *?*ModPagespeed=
Disallow *?*wordfence_lh=

mauibot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

adidxbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0

yandex

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.senetic.co.uk/sitemap_files/co_uk-MainSiteMap.xml