minecraft.net
robots.txt
Robots Exclusion Standard data for minecraft.net
Resource Scan
Scan Details
Site Domain | minecraft.net |
Base Domain | minecraft.net |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-09-12T04:11:36+00:00 |
Next Scan | 2024-12-11T04:11:36+00:00 |
Last Successful Scan
Scanned | 2022-04-19T16:09:39+00:00 |
URL | https://minecraft.net/robots.txt |
Redirect | https://www.minecraft.net/robots.txt |
Redirect Domain | www.minecraft.net |
Redirect Base | minecraft.net |
Response IP | 23.44.5.200 |
Found | Yes |
Hash | f2fee44e7aed26463d1f80a0dc31229ef237252c6cd64e8c0f418ad685dbb646 |
SimHash | 2b087c008987 |
Groups
*
Rule | Path |
---|---|
Disallow | /en-us/terms/R1 |
Disallow | /event/ |
Disallow | /events/ |
Disallow | /tweet/ |
Disallow | /video/ |
Disallow | /merch/ |
Disallow | /error/ |
Disallow | /creator-details/ |
Disallow | /earth/ |
Disallow | /earth/faq/ |
Disallow | /earth/buildplateshare |
Other Records
Field | Value |
---|---|
sitemap | https://www.minecraft.net/en-us/sitemap.xml |