robots.txt.sium.co
robots.txt
Robots Exclusion Standard data for robots.txt.sium.co
Resource Scan
Scan Details
Site Domain | robots.txt.sium.co |
Base Domain | sium.co |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't establish SSL connection. |
Last Scan | 2024-09-22T11:39:08+00:00 |
Next Scan | 2024-12-21T11:39:08+00:00 |
Last Successful Scan
Scanned | 2023-11-04T21:07:07+00:00 |
URL | http://robots.txt.sium.co/robots.txt |
Domain IPs | 142.132.137.12 |
Response IP | 142.132.137.12 |
Found | Yes |
Hash | 3864cb5cebd95e816712c61a36587ff27a0ff8289111a7e7f445e6baa8cc485d |
SimHash | 703c8122c553 |
Groups
*
Rule | Path |
---|---|
Disallow | /config/* |
Disallow | /includes/* |
Disallow | /page/ |
Allow | /recent/ |
Other Records
Field | Value |
---|---|
sitemap | http://sium.co/cleaned_sitemap/sitemap.xml |