mselectrical.co.uk
robots.txt

Robots Exclusion Standard data for mselectrical.co.uk

Resource Scan

Scan Details

Site Domain mselectrical.co.uk
Base Domain mselectrical.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-27T20:14:07+00:00
Next Scan 2025-11-25T20:14:07+00:00

Last Successful Scan

Scanned2025-04-30T20:12:40+00:00
URL https://mselectrical.co.uk/robots.txt
Redirect https://www.mselectrical.co.uk/robots.txt
Redirect Domain www.mselectrical.co.uk
Redirect Base mselectrical.co.uk
Domain IPs 185.199.221.29, 2a03:2800:500::3ce
Redirect IPs 185.199.221.29, 2a03:2800:500::3ce
Response IP 185.199.221.29
Found Yes
Hash 85e14baccc77430bf0a62f125f1fa33373fbf4e140ec6248eaaa6fe05acd64b1
SimHash 21f8d9e25af8

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin
Disallow /wp-
Disallow /?s=
Disallow *%26s%3D
Disallow /search
Disallow /author/
Disallow *?attachment_id=
Disallow */feed
Disallow */rss
Disallow */embed
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.svg
Allow /wp-*.pdf

etaospider

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /checkouts/
Disallow /checkout
Disallow /carts
Disallow /orders

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

Rule Path
Disallow /*jsessionid%3D*

Other Records

Field Value
crawl-delay 1

sogou spider

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

kraken

Rule Path
Disallow /

kraken0.1

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

screaming frog

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow /wp-admin/
Disallow /checkouts/

bingbot

Rule Path
Disallow /wp-admin/

yandex

Rule Path
Disallow /wp-admin/

googlebot-image

Rule Path
Disallow /checkouts/

mediapartners-google

Rule Path
Disallow /

Warnings

  • 2 invalid lines.