howtohypixel.com
robots.txt

Robots Exclusion Standard data for howtohypixel.com

Resource Scan

Scan Details

Site Domain howtohypixel.com
Base Domain howtohypixel.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-08-08T14:59:32+00:00
Next Scan 2024-10-07T14:59:32+00:00

Last Successful Scan

Scanned2024-06-10T13:43:25+00:00
URL https://howtohypixel.com/robots.txt
Redirect https://www.howtohypixel.com/robots.txt
Redirect Domain www.howtohypixel.com
Redirect Base howtohypixel.com
Domain IPs 13.250.129.152, 2406:da18:9d0:143e:8e74:1b1a:98b9:2813, 2406:da18:9d0:143f:29e7:ae24:cfea:e9bb, 54.151.156.30
Redirect IPs 104.21.83.145, 172.67.177.113, 2606:4700:3030::6815:5391, 2606:4700:3030::ac43:b171
Response IP 104.21.83.145
Found Yes
Hash 5e1cf4f6e604fa8532af868e7d71354f63a907ccb1678ff41720c07f1ef8da33
SimHash 4854dc542f93

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap https://www.howtohypixel.com/sitemap.xml