automation.siemens.com
robots.txt

Robots Exclusion Standard data for automation.siemens.com

Resource Scan

Scan Details

Site Domain automation.siemens.com
Base Domain siemens.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2024-04-24T10:44:58+00:00
Next Scan 2024-07-23T10:44:58+00:00

Last Successful Scan

Scanned2023-06-07T10:25:23+00:00
URL http://automation.siemens.com/robots.txt
Redirect https://www.automation.siemens.com/robots.txt
Redirect Domain www.automation.siemens.com
Redirect Base siemens.com
Domain IPs 195.27.237.106
Redirect IPs 23.52.112.71, 2600:1413:b000:388::adb, 2600:1413:b000:38f::adb
Response IP 23.195.108.73
Found Yes
Hash de6b907e9f2a22dbd65ba1b79ed8ea0dfa334cd15fe4477281f5353e6511ad2a
SimHash 819156c85912

Groups

*

Rule Path
Disallow /bilddb/interfaces/
Disallow /print/
Disallow /printPreview/
Disallow /cgi-extern/
Disallow /cgi-bin/
Disallow /cgi-extern-ssl/
Disallow /cgi-intern-ssl/
Disallow /wcms3/custom/OSSPAD3/ote/
Disallow /mdm/PdfTopicDownload.aspx
Disallow /mdm/XmlDownload.aspx
Disallow /mdm/Image.aspx
Disallow /WW/forum/members/
Disallow /WW/forum/moderators/
Disallow /WW/forum/experts/
Disallow /WW/forum/editors/
Disallow /WW/forum/members/ConferenceMembers.aspx
Disallow /WW/forum/guests/UserProfile.aspx
Disallow /WW/forum/guests/CompetitionRewardList.aspx
Disallow /WW/forum/guests/CompetitionScoreboard.aspx

technosearchcrawler

Rule Path
Disallow /WW/forum/
Disallow /*.ico
Disallow /ote
Disallow /webresource.axd
Disallow /scriptresource.axd
Disallow /search2009
Disallow /redirects
Disallow /config
Disallow /sitecollectionimages
Disallow /apple-touch-icon-precomposed.png
Disallow /apple-touch-icon.png
Disallow /admin
Disallow /asindex/
Allow /

Comments

  • default robots.txt for sharepoint sites
  • 42