Log In Sign Up

sonsoflibertymuseum.org
robots.txt

Robots Exclusion Standard data for sonsoflibertymuseum.org

Resource Scan

Scan Details

Site Domain sonsoflibertymuseum.org
Base Domain sonsoflibertymuseum.org
Scan Status Ok
Last Scan2025-05-17T08:31:44+00:00
Next Scan 2025-05-24T08:31:44+00:00

Last Scan

Scanned2025-05-17T08:31:44+00:00
URL https://sonsoflibertymuseum.org/robots.txt
Redirect https://www.sonsoflibertymuseum.org/robots.txt
Redirect Domain www.sonsoflibertymuseum.org
Redirect Base sonsoflibertymuseum.org
Domain IPs 104.21.23.116, 172.67.210.211, 2606:4700:3031::ac43:d2d3, 2606:4700:3034::6815:1774
Redirect IPs 104.21.23.116, 172.67.210.211, 2606:4700:3031::ac43:d2d3, 2606:4700:3034::6815:1774
Response IP 172.67.210.211
Found Yes
Hash 4bb6ac077efcb0a6226841e85b022e60ff5b73d35ac30c3abdba94a64c7b740d
SimHash 7b3cc043c680

Groups

*
googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Disallow

bingbot

Rule Path
Allow /

bing

Rule Path
Allow /

sp_auditbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

seznambot
ccbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

antropic-ai

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

gptbot

Rule Path
Allow /

baiduspider

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30
Back to top

Other Records

Field Value
sitemap https://www.sonsoflibertymuseum.org/sitemap.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap1a.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap1b.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap1c.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-2.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-3.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-4.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-5.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-6.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-7.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-a.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-b.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-c.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-d.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-e.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-f.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-g.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-h.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-i.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-j.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-k.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-l.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-m.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-n.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-o.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-p.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-q.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-r.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-s.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-t.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-u.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-v.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-w.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-x.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-y.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-z.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-pows-1.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-pows-2.xml
sitemap https://www.sonsoflibertymuseum.org/sitemap-pows-3.xml
Back to top

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • go away
Back to top

Warnings

  • `request-rate` is not a known field.
Back to top