magicpages.co
robots.txt
Robots Exclusion Standard data for magicpages.co
Resource Scan
Scan Details
Site Domain | magicpages.co |
Base Domain | magicpages.co |
Scan Status | Ok |
Last Scan | 2025-10-07T03:08:44+00:00 |
Next Scan | 2025-10-08T03:08:44+00:00 |
Last Scan
Scanned | 2025-10-07T03:08:44+00:00 |
URL | https://magicpages.co/robots.txt |
Redirect | https://www.magicpages.co/robots.txt |
Redirect Domain | www.magicpages.co |
Redirect Base | magicpages.co |
Domain IPs | 49.13.201.194 |
Redirect IPs | 138.199.24.219, 2400:52e0:1500::1274:1 |
Response IP | 138.199.46.68 |
Found | Yes |
Hash | 4ebd7c76b7f2bd5effe31cbad446f0eb60d7a83c5021bfe8c7c33a2ea9a5e869 |
SimHash | e0045585ef53 |
Groups
*
Rule | Path |
---|---|
Disallow | /ghost/ |
Disallow | /email/ |
Disallow | /members/api/comments/counts/ |
Disallow | /r/ |
Disallow | /webmentions/receive/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.magicpages.co/sitemap.xml |