collabo.dk
robots.txt

Robots Exclusion Standard data for collabo.dk

Resource Scan

Scan Details

Site Domain collabo.dk
Base Domain collabo.dk
Scan Status Ok
Last Scan2025-08-18T01:07:06+00:00
Next Scan 2025-09-17T01:07:06+00:00

Last Scan

Scanned2025-08-18T01:07:06+00:00
URL https://collabo.dk/robots.txt
Redirect https://www.collabo.dk/robots.txt
Redirect Domain www.collabo.dk
Redirect Base collabo.dk
Domain IPs 86.48.72.41
Redirect IPs 86.48.72.41
Response IP 86.48.72.41
Found Yes
Hash 26e2852e14b1e963d3e1357603d9f46add97f9383c7b8ac8f1fa1e677720e780
SimHash 3a5d1e327a11

Groups

fasterfox

Rule Path
Disallow /

chatgptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

claudebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /cart
Disallow /kurv
Disallow /checkout
Disallow /search
Disallow /sog
Disallow /tell
Disallow /tip
Disallow /ask
Disallow /sporg
Disallow /websession