cleardigitalmedia.my.site.com
robots.txt
Robots Exclusion Standard data for cleardigitalmedia.my.site.com
Resource Scan
Scan Details
Site Domain | cleardigitalmedia.my.site.com |
Base Domain | site.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-09-29T16:56:19+00:00 |
Next Scan | 2024-12-28T16:56:19+00:00 |
Last Successful Scan
Scanned | 2023-08-28T23:05:13+00:00 |
URL | https://cleardigitalmedia.my.site.com/robots.txt |
Domain IPs | 23.215.7.21, 23.215.7.27, 2600:1413:b000:1b::17d7:715, 2600:1413:b000:1b::17d7:71b |
Response IP | 23.59.168.154 |
Found | Yes |
Hash | 003a7b24e8bfbb84e52c2a822c91fcc208bdcef26673c8c563c71560f2495fd9 |
SimHash | 6360db65cf91 |
Groups
*
Product | Comment |
---|---|
* | applies to all robots |
Rule | Path | Comment |
---|---|---|
Allow | / | allow all |
Disallow | */secur/forgotpassword.jsp?* | - |
Other Records
Field | Value |
---|---|
sitemap | https://cleardigitalmedia.my.site.com/1/s/sitemap.xml |
sitemap | https://cleardigitalmedia.my.site.com/2/s/sitemap.xml |
Comments