Log In Sign Up

fagbladet3f.dk
robots.txt

Robots Exclusion Standard data for fagbladet3f.dk

Resource Scan

Scan Details

Site Domain fagbladet3f.dk
Base Domain fagbladet3f.dk
Scan Status Ok
Last Scan2025-12-04T07:06:53+00:00
Next Scan 2026-01-03T07:06:53+00:00

Last Scan

Scanned2025-12-04T07:06:53+00:00
URL https://fagbladet3f.dk/robots.txt
Domain IPs 104.26.0.30, 104.26.1.30, 172.67.72.144, 2606:4700:20::681a:11e, 2606:4700:20::681a:1e, 2606:4700:20::ac43:4890
Response IP 104.26.1.30
Found Yes
Hash 7826163e4fd8fe4243f69276f0cc2705486a6f891f748a36ea9c96530621a790
SimHash 0000d1200336

Groups

*

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php

*

Rule Path
Allow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /
Back to top

Comments

  • Search engines
  • Common crawl
  • OpenAI (ChatGPT)
  • OpenAI (ChatGPT realtime search)
  • Anthropic
  • Marker for disabling Bard and Vertex AI
  • Speech synthesis only?
  • Multi-purpose, commercial uses; including LLMs
Back to top