Log In Sign Up

nitecore.co.uk
robots.txt

Robots Exclusion Standard data for nitecore.co.uk

Resource Scan

Scan Details

Site Domain nitecore.co.uk
Base Domain nitecore.co.uk
Scan Status Ok
Last Scan2025-12-31T06:35:51+00:00
Next Scan 2026-01-30T06:35:51+00:00

Last Scan

Scanned2025-12-31T06:35:51+00:00
URL https://nitecore.co.uk/robots.txt
Redirect https://www.nitecore.co.uk/robots.txt
Redirect Domain www.nitecore.co.uk
Redirect Base nitecore.co.uk
Domain IPs 104.21.30.75, 172.67.172.124, 2606:4700:3031::6815:1e4b, 2606:4700:3032::ac43:ac7c
Redirect IPs 104.21.30.75, 172.67.172.124, 2606:4700:3031::6815:1e4b, 2606:4700:3032::ac43:ac7c
Response IP 172.67.172.124
Found Yes
Hash 4505190982437d4985995122de3fe5cca3201ef3e73f083015e10aec7652bb6d
SimHash 2e1458804c80

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /basket
Disallow /checkout

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider
etaospider
gigabot
grapeshotcrawler
linguee bot
mj12bot
msnbot
nutch
petalbot
robozilla
scrubby
seekport crawler
seznambot
slurp
teoma
yandexbot
yandeximages
asterias
deepcrawl
ia_archiver
istellabot
magpie-crawler
naverbot
psbot
twiceler
yahoo-blogs/v3.9
yahoo-mmcrawler
yeti

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.nitecore.co.uk/sitemap.xml
Back to top