www.automation.siemens.com
robots.txt
Robots Exclusion Standard data for www.automation.siemens.com
Resource Scan
Scan Details
Site Domain | www.automation.siemens.com |
Base Domain | siemens.com |
Scan Status | Ok |
Last Scan | 2024-04-25T18:03:58+00:00 |
Next Scan | 2024-05-25T18:03:58+00:00 |
Last Scan
Scanned | 2024-04-25T18:03:58+00:00 |
URL | https://www.automation.siemens.com/robots.txt |
Domain IPs | 23.215.7.24, 23.215.7.7, 2600:1413:b000:1b::17d7:707, 2600:1413:b000:1b::17d7:718 |
Response IP | 23.52.171.227 |
Found | Yes |
Hash | de6b907e9f2a22dbd65ba1b79ed8ea0dfa334cd15fe4477281f5353e6511ad2a |
SimHash | 819156c85912 |
Groups
*
Rule | Path |
---|---|
Disallow | /bilddb/interfaces/ |
Disallow | /print/ |
Disallow | /printPreview/ |
Disallow | /cgi-extern/ |
Disallow | /cgi-bin/ |
Disallow | /cgi-extern-ssl/ |
Disallow | /cgi-intern-ssl/ |
Disallow | /wcms3/custom/OSSPAD3/ote/ |
Disallow | /mdm/PdfTopicDownload.aspx |
Disallow | /mdm/XmlDownload.aspx |
Disallow | /mdm/Image.aspx |
Disallow | /WW/forum/members/ |
Disallow | /WW/forum/moderators/ |
Disallow | /WW/forum/experts/ |
Disallow | /WW/forum/editors/ |
Disallow | /WW/forum/members/ConferenceMembers.aspx |
Disallow | /WW/forum/guests/UserProfile.aspx |
Disallow | /WW/forum/guests/CompetitionRewardList.aspx |
Disallow | /WW/forum/guests/CompetitionScoreboard.aspx |
technosearchcrawler
Rule | Path |
---|---|
Disallow | /WW/forum/ |
Disallow | /*.ico |
Disallow | /ote |
Disallow | /webresource.axd |
Disallow | /scriptresource.axd |
Disallow | /search2009 |
Disallow | /redirects |
Disallow | /config |
Disallow | /sitecollectionimages |
Disallow | /apple-touch-icon-precomposed.png |
Disallow | /apple-touch-icon.png |
Disallow | /admin |
Disallow | /asindex/ |
Allow | / |
Comments