concur.co.uk
robots.txt

Robots Exclusion Standard data for concur.co.uk

Resource Scan

Scan Details

Site Domain concur.co.uk
Base Domain concur.co.uk
Scan Status Ok
Last Scan2025-09-24T01:25:15+00:00
Next Scan 2025-10-08T01:25:15+00:00

Last Scan

Scanned2025-09-24T01:25:15+00:00
URL https://concur.co.uk/robots.txt
Redirect https://www.concur.co.uk/robots.txt
Redirect Domain www.concur.co.uk
Redirect Base concur.co.uk
Domain IPs 104.69.148.172, 2600:1413:3800:18c::23bf, 2600:1413:3800:198::23bf
Redirect IPs 104.69.148.172, 2600:1413:5000:680::23bf, 2600:1413:5000:690::23bf
Response IP 104.69.148.172
Found Yes
Hash 0f07dd804377178d69360a424580b1b900bb4b3f40d38a8996e3503eb35fdb3e
SimHash 2f061d158ffa

Groups

*

Rule Path
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /sites/default/files/lp/pdfs/*
Disallow /sites/all/
Disallow /concur-access/
Disallow /concur-access
Disallow /themes/
Disallow /taxonomy/
Disallow /node/
Disallow /node
Allow /sites/all/modules/custom_concur/concur_tracking/public/js/global_scripts/*
Allow /sites/all/modules/custom_concur/concur_startup/*
Allow /sites/all/themes/concur7/css/font-awesome/font/*
Disallow /core/
Disallow /advisor-platinum-thank-you
Disallow /advisor-registration/thank-you
Disallow /contact/thankyou
Disallow /ap-process-risk-assessment/result
Disallow /node/add/
Disallow /search?sqs=*
Disallow /user/password/
Disallow /user/register
Disallow /user/password
Disallow /user/login
Allow /sites/all/modules/custom_concur/trackingmod/js/*.js
Allow /sites/default/files/*.css
Allow /sites/default/files/*.js
Allow /misc/*.css
Allow /misc/*.png
Allow /misc/*.js
Allow /misc/*.jpg
Allow /misc/*.jpeg
Allow /sites/*.css
Allow /sites/*.png
Allow /sites/*.jpg
Allow /sites/*.jpeg
Allow /sites/all/modules/*.js
Allow /sites/all/themes/*.js
Allow /core/*.css$
Allow /core/*.css?
Allow /core/*.js$
Allow /core/*.js?
Allow /core/*.gif
Allow /core/*.jpg
Allow /core/*.jpeg
Allow /core/*.png
Allow /core/*.svg
Allow /core/*.webp
Allow /sites/all/themes/concur7/favicon.ico
Disallow /*.pdf
Disallow /amex-partner-referral
Disallow /breeze/american-express-corporate-card
Disallow /breeze/american-express-corporate-card?channel=amex

Other Records

Field Value
sitemap https://www.concur.co.uk/sitemap.xml
sitemap https://www.concur.co.uk/blog/sitemap.xml

Comments

  • robots.txt
  • Directories
  • D7
  • D10
  • FORMS
  • D7
  • DRUPAL PATHS (CLEAN URLs)
  • D7
  • D10
  • FILES - CSS, JS, IMAGES
  • D7
  • D10
  • FAVICON
  • PDF
  • Partner Pages