Log In Sign Up

detecting.org.uk
robots.txt

Robots Exclusion Standard data for detecting.org.uk

Resource Scan

Scan Details

Site Domain detecting.org.uk
Base Domain detecting.org.uk
Scan Status Ok
Last Scan2025-06-02T13:52:24+00:00
Next Scan 2025-06-09T13:52:24+00:00

Last Scan

Scanned2025-06-02T13:52:24+00:00
URL https://detecting.org.uk/robots.txt
Domain IPs 2001:8d8:100f:f000::28d, 217.160.0.20
Response IP 217.160.0.20
Found Yes
Hash ae46b47e1ff160e1ddc81d14bfe07b1eb27cbfa7ee73ef2beb6588067192f41c
SimHash 0a44cb02be81

Groups

*

Rule Path
Disallow /forum/*action
Disallow /forum/*PHPSESSID
Disallow /forum/*%3B
Allow /forum/$
Allow /forum/*board%3D*.0$
Allow /forum/*topic%3D*.0$
Allow /forum/*.xml
Allow /*.css$
Allow /*.js$
Allow /*.png$
Allow /*.jpg$
Allow /*.gif$

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot

Rule Path
Disallow /

adsbot/3.1

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

bubing

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baidu

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

gluten free crawler

Rule Path
Disallow /

glutenfreecrawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

adscanner

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.detecting.org.uk/sitemap.xml
sitemap https://www.detecting.org.uk/sitemap.html
sitemap https://www.detecting.org.uk/ror.xml
sitemap https://www.detecting.org.uk/urllist.txt
sitemap https://www.detecting.org.uk/blog/sitemap.xml
sitemap https://www.detecting.org.uk/blog/sitemap.xml.gz
sitemap https://www.detecting.org.uk/blog/sitemap_index.xml
sitemap https://www.detecting.org.uk/sitemap_mobile.xml
sitemap https://www.detecting.org.uk/sitemap_mobile.xml.gz
sitemap https://www.detecting.org.uk/forum/sitemap.xml
Back to top