Log In Sign Up

ipwiki.de
robots.txt

Robots Exclusion Standard data for ipwiki.de

Resource Scan

Scan Details

Site Domain ipwiki.de
Base Domain ipwiki.de
Scan Status Ok
Last Scan2025-11-02T06:39:48+00:00
Next Scan 2025-11-09T06:39:48+00:00

Last Scan

Scanned2025-11-02T06:39:48+00:00
URL https://ipwiki.de/robots.txt
Redirect https://www.ipwiki.de/robots.txt
Redirect Domain www.ipwiki.de
Redirect Base ipwiki.de
Domain IPs 212.227.150.43
Redirect IPs 212.227.150.43
Response IP 212.227.150.43
Found Yes
Hash 683b1f09113f092b1744753e2ae306314ec7e883258ab5ba77eeaf29f30cb9ec
SimHash 01729a40e7a2

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

perplexitycrawler

Rule Path
Disallow /

*

Rule Path
Disallow
Back to top

Comments

  • Block OpenAI's GPTBot
  • Block Google's AI crawler
  • Block Anthropic's ClaudeBot
  • Block Apple's AI crawler
  • Block Perplexity AI's crawler
  • Allow all other user agents (including traditional search engines)
Back to top