secularism.org.uk
robots.txt

Robots Exclusion Standard data for secularism.org.uk

Resource Scan

Scan Details

Site Domain secularism.org.uk
Base Domain secularism.org.uk
Scan Status Ok
Last Scan2026-01-25T04:44:19+00:00
Next Scan 2026-02-24T04:44:19+00:00

Last Scan

Scanned2026-01-25T04:44:19+00:00
URL https://secularism.org.uk/robots.txt
Redirect https://www.secularism.org.uk/robots.txt
Redirect Domain www.secularism.org.uk
Redirect Base secularism.org.uk
Domain IPs 104.21.52.91, 172.67.197.143, 2606:4700:3032::ac43:c58f, 2606:4700:3036::6815:345b
Redirect IPs 104.21.52.91, 172.67.197.143, 2606:4700:3032::ac43:c58f, 2606:4700:3036::6815:345b
Response IP 104.21.52.91
Found Yes
Hash 8ddb80a191da087934741474fdad1e0bfd7da31eb1c6c7dabc5da12e5dfe722f
SimHash 5f5366a9eeb2

Groups

*

Rule Path
Disallow /api/
Disallow /sandbox/
Disallow /help/
Disallow /cgi-bin/
Disallow /wastebasket/
Disallow /edit$
Disallow /edit?
Disallow /edit/
Disallow /*.shtml$
Disallow /*/tags
Disallow *?%3B$
Disallow *?%3B*=*
Disallow /*?cookie-notice=accept
Disallow /*?view=map
Disallow *?*query=
Disallow *?*letter=
Disallow *?*keywords=
Disallow *?*min-burial-year=
Disallow *?*max-burial-year=
Disallow *?*section=
Disallow *?*plot=
Disallow *?*category=
Disallow *?*tag=
Disallow *?*tags=
Disallow *?*type=
Disallow *?*user=
Disallow *?*scope=
Disallow *?*utm_source=
Disallow *?*utm_medium=
Disallow *?*utm_campaign=
Disallow *?*cpid=
Disallow *?*mobileoptout=
Disallow *?*parts=
Disallow /login$
Disallow /login?
Disallow /login/
Disallow /31594$
Disallow /31594?
Disallow /31594/
Disallow /search$
Disallow /search?
Disallow /search/
Disallow /uploads/newsline-*.pdf
Disallow /*.shtml$
Disallow /nmfs/

seekport

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

bubing

Rule Path
Disallow /

nibbler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.secularism.org.uk/sitemap.xml