Log In Sign Up

aalborg.com
robots.txt

Robots Exclusion Standard data for aalborg.com

Resource Scan

Scan Details

Site Domain aalborg.com
Base Domain aalborg.com
Scan Status Ok
Last Scan2025-10-15T12:00:29+00:00
Next Scan 2025-11-14T12:00:29+00:00

Last Scan

Scanned2025-10-15T12:00:29+00:00
URL https://aalborg.com/robots.txt
Redirect https://www.aalborg.com/robots_domains.txt
Redirect Domain www.aalborg.com
Redirect Base aalborg.com
Domain IPs 104.130.11.24
Redirect IPs 104.130.11.24
Response IP 104.130.11.24
Found Yes
Hash a8300b5d33a4f28021c7007caf80e4cdbc310c52bcc1129bfe327e3fa1bf15e5
SimHash 43048253ef82

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

ahrefsbot
semrushbot
mj12bot
dotbot
megaindex

Product Comment
dotbot moz

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

petalbot
exabot
test-bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seekport

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • for non httpS|aalborg.com|aalborginstruments
  • Disallows removed to let crawls redirect to proper domains and be Disallowed there
  • Allow: */sort/20a # default sort
  • Allow: */sort/*/zenid
  • Allow: */sort/*/PHPSESSID
  • Allow: */sort/*/phpsessid
  • Allow: */sort/*/language/
  • Allow: */language/*/sort/
  • Allow: */change_resolution/*/sort/
  • Disallow: */sort/
  • Disallow: */sort_order/ # cal lib
  • Disallow: *main_page/popup_image/
  • Disallow: *main_page/contact_us
  • Disallow: *main_page/login
  • Disallow: *main_page/cookie_usage
  • Disallow: *main_page/unsubscribe
  • Disallow: *main_page*autocomplete
  • Disallow: *main_page/popup_search_help
  • Disallow: /captcha_img.php
  • Allow: *main_page=configurator&conf_id=6*&action=selected&sku=L
  • Allow: *main_page=configurator&conf_id=12&action=selected&sku=PSV
  • Allow: *main_page=configurator&conf_id=13&action=selected&sku=SMV
  • Allow: *main_page=configurator&conf_id=14&action=selected&sku=V
  • Allow: *main_page=configurator&conf_id=15&action=selected&sku=V
  • Allow: *main_page=configurator&conf_id=17&action=selected&sku=F
  • Allow: *main_page=configurator&conf_id=21&action=selected&sku=SDPROC
  • Allow: *main_page=configurator&conf_id=25&action=selected&sku=TIO
  • Allow: *main_page=configurator&conf_id=26&action=selected&sku=PWE
  • Disallow: *main_page=configurator&conf_id=**&action=selected&sku=
  • Disallow: *main_page/configurator*/sku/*
  • Allow: *main_page/configurator_search_tubes_configure/*/zenid
  • Disallow: *main_page*configurator_search_tubes_configure*
  • Allow: *main_page/configurator_tubes_selection/*/zenid
  • Disallow: *main_page*configurator_tubes_selection*
  • Disallow: *main_page/popup_configurator_what_this
  • Disallow: /_*/*
  • Sep-2020
  • User-agent: AhrefsSiteAudit
  • Allow: */sort/20a # default sort
  • Disallow: */sort/
  • Disallow: */sort_order/ # cal lib
  • Disallow: *main_page/popup_image/
  • Disallow: *main_page/contact_us
  • Disallow: *main_page/login
  • Disallow: *main_page/cookie_usage
  • Disallow: *main_page/configurator/sku/*/action/recover/
  • Disallow: *main_page/configurator_search_tubes_configure/
  • Disallow: *main_page/configurator_tubes_selection/
  • Disallow: /*http://www.adobe.com/products/acrobat/readstep2.html/*
  • Disallow: */cPath/
  • Disallow: */products_id/
  • Disallow: */configurator/sku/
  • Disallow: */configurator_*
  • Disallow: */calibrator_flowtubes/*
Back to top