Log In Sign Up

bagebixen.dk
robots.txt

Robots Exclusion Standard data for bagebixen.dk

Resource Scan

Scan Details

Site Domain bagebixen.dk
Base Domain bagebixen.dk
Scan Status Ok
Last Scan2025-09-18T11:32:22+00:00
Next Scan 2025-10-18T11:32:22+00:00

Last Scan

Scanned2025-09-18T11:32:22+00:00
URL https://bagebixen.dk/robots.txt
Domain IPs 104.26.12.144, 104.26.13.144, 172.67.68.97, 2606:4700:20::681a:c90, 2606:4700:20::681a:d90, 2606:4700:20::ac43:4461
Response IP 104.26.13.144
Found Yes
Hash daf228b2ab077b0799b92bc0189e6d6e70f46219c538061eb28733798b01da4e
SimHash 01789212c302

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /
Disallow /*?q=
Disallow /*?s=
Disallow /*?product-page=
Disallow /*page/
Disallow /*?orderby=
Disallow /*?filter_brand*=
Disallow /*?min_price=

googlebot-images

Rule Path
Allow /

adsbot-google

Rule Path
Allow /
Disallow /?blackhole

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /
Back to top

Comments

  • Internal search filters
  • Pagination
  • Sorting
  • Filter
Back to top