simounet.net
robots.txt

Robots Exclusion Standard data for simounet.net

Resource Scan

Scan Details

Site Domain simounet.net
Base Domain simounet.net
Scan Status Ok
Last Scan2024-11-15T15:52:58+00:00
Next Scan 2024-11-16T15:52:58+00:00

Last Scan

Scanned2024-11-15T15:52:58+00:00
URL https://simounet.net/robots.txt
Domain IPs 2001:41d0:1:1b00:213:186:33:87, 213.186.33.87
Response IP 213.186.33.87
Found Yes
Hash 91e23a72713b4076e88a632a694136961ec63d230ffaef32be430e2b14bcd0b7
SimHash 68291b7905b3

Groups

*

Rule Path
Allow /

bizinformation

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

Comments

  • Dark Visitors robots.txt
  • AI Assistant
  • https://darkvisitors.com/agents/chatgpt-user
  • AI Assistant
  • https://darkvisitors.com/agents/cohere-ai
  • AI Data Scraper
  • https://darkvisitors.com/agents/anthropic-ai
  • AI Data Scraper
  • https://darkvisitors.com/agents/ccbot
  • AI Data Scraper
  • https://darkvisitors.com/agents/facebookbot
  • AI Data Scraper
  • https://darkvisitors.com/agents/google-extended
  • AI Data Scraper
  • https://darkvisitors.com/agents/gptbot
  • AI Data Scraper
  • https://darkvisitors.com/agents/omgilibot