Log In Sign Up

artsennet.nl
robots.txt

Robots Exclusion Standard data for artsennet.nl

Resource Scan

Scan Details

Site Domain artsennet.nl
Base Domain artsennet.nl
Scan Status Ok
Last Scan2025-12-09T22:24:53+00:00
Next Scan 2025-12-16T22:24:53+00:00

Last Scan

Scanned2025-12-09T22:24:53+00:00
URL http://artsennet.nl/robots.txt
Redirect https://www.medischcontact.nl/robots.txt
Redirect Domain www.medischcontact.nl
Redirect Base medischcontact.nl
Domain IPs 54.93.191.204
Redirect IPs 18.158.125.23, 52.59.107.139
Response IP 18.158.125.23
Found Yes
Hash 0ae9e4a230cda522272130b977a025ad31919aa1c84e363cc3a822ce2ca4626f
SimHash 707ec6a2a8ba

Groups

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

criteobotv

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

facebookcatalog

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

deepseekbot

Rule Path
Disallow /

deepseek

Rule Path
Disallow /

*

Rule Path
Disallow /rss-feeds-medisch-contact/
Back to top

Comments

  • Disallow AhrefsBot
  • Disallow Amazonbot
  • Disallow DotBot
  • Disallow CriteoBotv
  • Disallow MJ12bot
  • Disallow Claudebot
  • Disallow GPTBot
  • Disallow Google Gemini, Bard
  • Disallow Facebook AI (Meta AI)
  • Disallow Facebook AI (Meta AI)
  • Disallow Facebook AI (Meta AI)
  • Disallow Common Crawl (gebruikt door o.a. OpenAI)
  • Disallow Perplexity AI
  • Disallow SemrushBot
  • Disallow DeepSeek AI
  • Disallow DeepSeek AI
  • Medischcontact specific configuration
Back to top