support.industry.siemens.com
robots.txt

Robots Exclusion Standard data for support.industry.siemens.com

Resource Scan

Scan Details

Site Domain support.industry.siemens.com
Base Domain siemens.com
Scan Status Ok
Last Scan2024-05-18T03:36:40+00:00
Next Scan 2024-06-01T03:36:40+00:00

Last Scan

Scanned2024-05-18T03:36:40+00:00
URL https://support.industry.siemens.com/robots.txt
Domain IPs 23.52.171.227, 23.59.168.185, 2600:1413:b000:1b::17d7:707, 2600:1413:b000:1b::17d7:718
Response IP 23.52.171.227
Found Yes
Hash 893dcd75eabd9dd2a5ff43489f460315a65887aa40dbfb8c2454941b781f2ebe
SimHash cda00361dfd7

Groups

*

Rule Path
Disallow /*.ico
Disallow /cs/pd/
Disallow /cs/helpcenter/
Disallow /cs/userdetails/
Disallow /cs/userDetails/
Disallow /dokumentation/XmlDownload.aspx
Disallow /dokumentation/PDFTopicDownload.topicPDF.aspx
Disallow /regpublic/
Disallow /cs/sign*
Disallow /cs/print
Disallow /cs/error
Disallow /cs/index.html
Disallow /dl/dl-media/
Disallow /forum/*/*/users/
Disallow /forum/*/*/conference/expertslist/
Disallow /forum/*/*/addthread/
Disallow /forum/*/*/addtofavorites/
Disallow /forum/*/*/ratings/
Disallow /forum/*/*/addpost/
Disallow /forum/*/*/events/
Disallow /forum/*/*/post/addthankyou/
Disallow /forum/*/*/badges/description/
Disallow /forum/*/*/header/
Disallow /forum/*/*/Conversations/Index
Disallow /forum/*/*/Favorites/
Disallow /WW/tf/

Other Records

Field Value
sitemap https://support.industry.siemens.com/cs/sitemap.xml
sitemap https://support.industry.siemens.com/forum/sitemapindex.xml

Comments

  • Disallow general section
  • Disallow: /*.js #JS-Sourcen are allowed for google SPA-indexing
  • Disallow deep links in SIPS-Viewer
  • Disallow sources of statistic
  • Disallow: /wcms3/custom/osspad3/ote/
  • Disallow: /ote/
  • Disallow sources of SSO-Login
  • Disallow dl-media
  • Disallow forum
  • Disallow old style urls
  • User-agent: TechnoSearchCrawler
  • Sitemap: https://support.industry.siemens.com/sc_sitemap.xml
  • Sitemap: https://support.industry.siemens.com/my_sitemap.xml