fcstpauli.com
robots.txt

Robots Exclusion Standard data for fcstpauli.com

Resource Scan

Scan Details

Site Domain fcstpauli.com
Base Domain fcstpauli.com
Scan Status Ok
Last Scan2025-12-01T23:53:49+00:00
Next Scan 2025-12-15T23:53:49+00:00

Last Scan

Scanned2025-12-01T23:53:49+00:00
URL https://fcstpauli.com/robots.txt
Redirect https://www.fcstpauli.com/robots.txt
Redirect Domain www.fcstpauli.com
Redirect Base fcstpauli.com
Domain IPs 2001:8d8:100f:f000::228, 217.160.0.226
Redirect IPs 13.107.213.59, 13.107.246.59, 2620:1ec:46::59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 28b203c1e39eb30cb7d24b68833044d95889e1a6ac4c2c8a9ed62b2d41c045e1
SimHash 730869518c46

Groups

gptbot
oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot
google-extended
gptbot
ccbot
mediapartners-google*
amazonbot
anthropic-ai
claudebot
claude-web
applebot
applebot-extended
facebookbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.fcstpauli.com/sitemaps-1-sitemap.xml
sitemap https://www.fcstpauli.com/en/sitemaps-1-sitemap.xml
sitemap https://www.fcstpauli.com/de-ls/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.fcstpauli.com/
  • Disallow AI bots, as there's no benefit to allowing it to index your site