Log In Sign Up

gmem.ca
robots.txt

Robots Exclusion Standard data for gmem.ca

Resource Scan

Scan Details

Site Domain gmem.ca
Base Domain gmem.ca
Scan Status Ok
Last Scan2025-03-18T00:59:56+00:00
Next Scan 2025-04-17T00:59:56+00:00

Last Scan

Scanned2025-03-18T00:59:56+00:00
URL https://gmem.ca/robots.txt
Redirect https://arch.dog/robots.txt
Redirect Domain arch.dog
Redirect Base arch.dog
Domain IPs 104.18.2.62, 104.18.3.62, 2606:4700::6812:23e, 2606:4700::6812:33e
Redirect IPs 104.26.12.195, 104.26.13.195, 172.67.74.250, 2606:4700:20::681a:cc3, 2606:4700:20::681a:dc3, 2606:4700:20::ac43:4afa
Response IP 104.26.13.195
Found Yes
Hash 6b0eb90ef296043287939d711694ba3f9f86143b84004d638bbecc3b7a557bd4
SimHash ea1f194186d7

Groups

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /
Back to top

Comments

  • Dark Visitors robots.txt
  • AI Data Scraper
  • https://darkvisitors.com/agents/anthropic-ai
  • AI Data Scraper
  • https://darkvisitors.com/agents/bytespider
  • AI Data Scraper
  • https://darkvisitors.com/agents/ccbot
  • AI Data Scraper
  • https://darkvisitors.com/agents/diffbot
  • AI Data Scraper
  • https://darkvisitors.com/agents/facebookbot
  • AI Data Scraper
  • https://darkvisitors.com/agents/google-extended
  • AI Data Scraper
  • https://darkvisitors.com/agents/gptbot
  • AI Data Scraper
  • https://darkvisitors.com/agents/omgili
Back to top