www.automation.siemens.com
robots.txt

Robots Exclusion Standard data for www.automation.siemens.com

Resource Scan

Scan Details

Site Domain www.automation.siemens.com
Base Domain siemens.com
Scan Status Ok
Last Scan2024-04-25T18:03:58+00:00
Next Scan 2024-05-25T18:03:58+00:00

Last Scan

Scanned2024-04-25T18:03:58+00:00
URL https://www.automation.siemens.com/robots.txt
Domain IPs 23.215.7.24, 23.215.7.7, 2600:1413:b000:1b::17d7:707, 2600:1413:b000:1b::17d7:718
Response IP 23.52.171.227
Found Yes
Hash de6b907e9f2a22dbd65ba1b79ed8ea0dfa334cd15fe4477281f5353e6511ad2a
SimHash 819156c85912

Groups

*

Rule Path
Disallow /bilddb/interfaces/
Disallow /print/
Disallow /printPreview/
Disallow /cgi-extern/
Disallow /cgi-bin/
Disallow /cgi-extern-ssl/
Disallow /cgi-intern-ssl/
Disallow /wcms3/custom/OSSPAD3/ote/
Disallow /mdm/PdfTopicDownload.aspx
Disallow /mdm/XmlDownload.aspx
Disallow /mdm/Image.aspx
Disallow /WW/forum/members/
Disallow /WW/forum/moderators/
Disallow /WW/forum/experts/
Disallow /WW/forum/editors/
Disallow /WW/forum/members/ConferenceMembers.aspx
Disallow /WW/forum/guests/UserProfile.aspx
Disallow /WW/forum/guests/CompetitionRewardList.aspx
Disallow /WW/forum/guests/CompetitionScoreboard.aspx

technosearchcrawler

Rule Path
Disallow /WW/forum/
Disallow /*.ico
Disallow /ote
Disallow /webresource.axd
Disallow /scriptresource.axd
Disallow /search2009
Disallow /redirects
Disallow /config
Disallow /sitecollectionimages
Disallow /apple-touch-icon-precomposed.png
Disallow /apple-touch-icon.png
Disallow /admin
Disallow /asindex/
Allow /

Comments

  • default robots.txt for sharepoint sites
  • 42