sem-it.my.site.com
robots.txt
Robots Exclusion Standard data for sem-it.my.site.com
Resource Scan
Scan Details
| Site Domain | sem-it.my.site.com |
| Base Domain | site.com |
| Scan Status | Ok |
| Last Scan | 2025-09-24T17:11:33+00:00 |
| Next Scan | 2025-10-08T17:11:33+00:00 |
Last Scan
| Scanned | 2025-09-24T17:11:33+00:00 |
| URL | https://sem-it.my.site.com/robots.txt |
| Domain IPs | 23.58.144.147, 23.58.144.151, 2600:1413:5000:34::173d:ca6b, 2600:1413:5000:34::173d:ca6d |
| Response IP | 96.17.96.21 |
| Found | Yes |
| Hash | 28c846ae943948fb86c29f6b78bfcf4f350836fc98fc28a36c57fca8afd112dc |
| SimHash | 6324db44cf93 |
Groups
*
| Product | Comment |
|---|---|
| * | applies to all robots |
| Rule | Path | Comment |
|---|---|---|
| Allow | / | allow all |
| Disallow | */secur/forgotpassword.jsp?* | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://sem-it.my.site.com/ESWAudiMessaginAgents21738166916051/sitemap.xml |
| sitemap | https://sem-it.my.site.com/ESWAudiMessaginPreTest1741769863450/sitemap.xml |
| sitemap | https://sem-it.my.site.com/ESWAudiMessagingAgents1736248251928/sitemap.xml |
| sitemap | https://sem-it.my.site.com/ESWSKODAMessagingAgents1733139647960/sitemap.xml |
Comments