Log In Sign Up

swissre.com
robots.txt

Robots Exclusion Standard data for swissre.com

Resource Scan

Scan Details

Site Domain swissre.com
Base Domain swissre.com
Scan Status Ok
Last Scan2024-11-13T16:41:00+00:00
Next Scan 2024-11-27T16:41:00+00:00

Last Scan

Scanned2024-11-13T16:41:00+00:00
URL https://swissre.com/robots.txt
Redirect https://www.swissre.com/robots.txt
Redirect Domain www.swissre.com
Redirect Base swissre.com
Domain IPs 104.18.42.120, 172.64.145.136, 2606:4700:4400::6812:2a78, 2606:4700:4400::ac40:9188
Redirect IPs 104.18.41.200, 172.64.146.56, 2606:4700:4400::6812:29c8, 2606:4700:4400::ac40:9238
Response IP 104.18.41.200
Found Yes
Hash d73654490cab2b4756b5a86814ecd623ac07cfe49b692b7a3803aae02c4e9856
SimHash 4202c857b3f2

Groups

*

Rule Path
Allow /*
Disallow /.*
Allow /.resources/*/webresources/*
Allow /.imaging/

Other Records

Field Value Comment
crawl-delay 120 slow down 120s

gptbot
chatgpt-user
ccbot

Rule Path
Disallow /
Allow /investors
Allow /careers
Allow /media
Allow /press-release
Allow /about-us
Allow /about-us
Back to top

Other Records

Field Value
sitemap https://www.swissre.com/sitemap.xml
sitemap https://www.swissre.com/australia_newzealand/sitemap.xml
sitemap https://www.swissre.com/brasil/sitemap.xml
sitemap https://www.swissre.com/mexico/sitemap.xml
sitemap https://www.swissre.com/colombia/sitemap.xml
sitemap https://www.swissre.com/china/sitemap.xml
sitemap https://www.swissre.com/en/china/sitemap.xml
sitemap https://www.swissre.com/japan/sitemap.xml
sitemap https://www.swissre.com/en/japan/sitemap.xml
sitemap https://www.swissre.com/korea/sitemap.xml
Back to top

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • Slow down bots
Back to top