concur.no
robots.txt

Robots Exclusion Standard data for concur.no

Resource Scan

Scan Details

Site Domain concur.no
Base Domain concur.no
Scan Status Ok
Last Scan2025-09-22T05:01:15+00:00
Next Scan 2025-10-06T05:01:15+00:00

Last Scan

Scanned2025-09-22T05:01:15+00:00
URL https://concur.no/robots.txt
Redirect https://www.concur.no/robots.txt
Redirect Domain www.concur.no
Redirect Base concur.no
Domain IPs 184.84.53.133, 2600:1413:5000:680::23bf, 2600:1413:5000:690::23bf
Redirect IPs 23.199.135.140, 2600:1413:5000:680::23bf, 2600:1413:5000:690::23bf
Response IP 23.51.36.121
Found Yes
Hash e9a520b612ad2093ed59f3a343839ddad8940337a622ca5ee39966b76fe9446c
SimHash 2f060d558bf8

Groups

*

Rule Path
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /sites/default/files/lp/pdfs/*
Disallow /sites/all/
Disallow /concur-access/
Disallow /concur-access
Disallow /themes/
Disallow /taxonomy/
Disallow /node/
Disallow /node
Allow /sites/all/modules/custom_concur/concur_tracking/public/js/global_scripts/*
Allow /sites/all/modules/custom_concur/concur_startup/*
Allow /sites/all/themes/concur7/css/font-awesome/font/*
Disallow /core/
Disallow /advisor-platinum-thank-you
Disallow /advisor-registration/thank-you
Disallow /contact/thankyou
Disallow /ap-process-risk-assessment/result
Disallow /node/add/
Disallow /search?sqs=*
Disallow /user/password/
Disallow /user/register
Disallow /user/password
Disallow /user/login
Allow /sites/all/modules/custom_concur/trackingmod/js/*.js
Allow /sites/default/files/*.css
Allow /sites/default/files/*.js
Allow /misc/*.css
Allow /misc/*.png
Allow /misc/*.js
Allow /misc/*.jpg
Allow /misc/*.jpeg
Allow /sites/*.css
Allow /sites/*.png
Allow /sites/*.jpg
Allow /sites/*.jpeg
Allow /sites/all/modules/*.js
Allow /sites/all/themes/*.js
Allow /core/*.css$
Allow /core/*.css?
Allow /core/*.js$
Allow /core/*.js?
Allow /core/*.gif
Allow /core/*.jpg
Allow /core/*.jpeg
Allow /core/*.png
Allow /core/*.svg
Allow /core/*.webp
Allow /sites/all/themes/concur7/favicon.ico
Disallow /*.pdf

Other Records

Field Value
sitemap https://www.concur.no/sitemap.xml
sitemap https://www.concur.no/blog/sitemap.xml

Comments

  • robots.txt
  • Directories
  • D7
  • D10
  • FORMS
  • D7
  • DRUPAL PATHS (CLEAN URLs)
  • D7
  • D10
  • FILES - CSS, JS, IMAGES
  • D7
  • D10
  • FAVICON
  • PDF