Log In Sign Up

bagetid.dk
robots.txt

Robots Exclusion Standard data for bagetid.dk

Resource Scan

Scan Details

Site Domain bagetid.dk
Base Domain bagetid.dk
Scan Status Ok
Last Scan2025-09-19T14:03:09+00:00
Next Scan 2025-10-19T14:03:09+00:00

Last Scan

Scanned2025-09-19T14:03:09+00:00
URL https://bagetid.dk/robots.txt
Domain IPs 104.21.0.133, 172.67.150.252, 2606:4700:3031::6815:85, 2606:4700:3035::ac43:96fc
Response IP 172.67.150.252
Found Yes
Hash daf228b2ab077b0799b92bc0189e6d6e70f46219c538061eb28733798b01da4e
SimHash 01789212c302

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /
Disallow /*?q=
Disallow /*?s=
Disallow /*?product-page=
Disallow /*page/
Disallow /*?orderby=
Disallow /*?filter_brand*=
Disallow /*?min_price=

googlebot-images

Rule Path
Allow /

adsbot-google

Rule Path
Allow /
Disallow /?blackhole

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /
Back to top

Comments

  • Internal search filters
  • Pagination
  • Sorting
  • Filter
Back to top