Log In Sign Up

juliaweigl.de
robots.txt

Robots Exclusion Standard data for juliaweigl.de

Resource Scan

Scan Details

Site Domain juliaweigl.de
Base Domain juliaweigl.de
Scan Status Ok
Last Scan2025-10-13T16:04:13+00:00
Next Scan 2025-10-20T16:04:13+00:00

Last Scan

Scanned2025-10-13T16:04:13+00:00
URL https://juliaweigl.de/robots.txt
Domain IPs 185.30.32.119
Response IP 185.30.32.119
Found Yes
Hash ab49bf34dfb1f9524d8725d966d2e9ea40c62640d36a31f6c1393b21453934f7
SimHash c5d4ca50c492

Groups

openai-agent

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

anthropicbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.juliaweigl.de/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Allow OpenAI's bots
  • Allow Perplexity AI's bots
  • Allow Anthropic's bots
  • Allow Google's AI bots for better SEO
  • Allow Bing's AI bots for search engine indexing
  • ---------------------------
  • END YOAST BLOCK
Back to top

Warnings

  • 2 invalid lines.
  • `*allow` is not a known field.
Back to top