markedsforing.dk
robots.txt

Robots Exclusion Standard data for markedsforing.dk

Resource Scan

Scan Details

Site Domain markedsforing.dk
Base Domain markedsforing.dk
Scan Status Ok
Last Scan2024-06-24T03:15:14+00:00
Next Scan 2024-07-24T03:15:14+00:00

Last Scan

Scanned2024-06-24T03:15:14+00:00
URL https://markedsforing.dk/robots.txt
Domain IPs 52.215.88.119
Response IP 52.215.88.119
Found Yes
Hash 1c2445e7b8083f966d831adcf93a8c0c4bb7deea0649089aa0f7560167b896a9
SimHash 40044840e533

Groups

*

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://markedsforing.dk/wp-sitemap.xml

Comments

  • Common crawl
  • OpenAI (ChatGPT)
  • OpenAI (ChatGPT realtime search)
  • Anthropic
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK