megamillions.com
robots.txt

Robots Exclusion Standard data for megamillions.com

Resource Scan

Scan Details

Site Domain megamillions.com
Base Domain megamillions.com
Scan Status Ok
Last Scan2024-06-14T13:30:06+00:00
Next Scan 2024-06-21T13:30:06+00:00

Last Scan

Scanned2024-06-14T13:30:06+00:00
URL https://megamillions.com/robots.txt
Redirect https://www.megamillions.com/robots.txt
Redirect Domain www.megamillions.com
Redirect Base megamillions.com
Domain IPs 104.22.6.157, 104.22.7.157, 172.67.24.141, 2606:4700:10::6816:69d, 2606:4700:10::6816:79d, 2606:4700:10::ac43:188d
Redirect IPs 104.22.6.157, 104.22.7.157, 172.67.24.141, 2606:4700:10::6816:69d, 2606:4700:10::6816:79d, 2606:4700:10::ac43:188d
Response IP 104.22.7.157
Found Yes
Hash dd4c5433f3e0cbe1b2e280650c1355a45bd496f06e3aabae2c6923c5b34fe926
SimHash 4c46d2b1e970

Groups

*

Rule Path
Allow /

test certificate info

Rule Path
Disallow /

Comments

  • Attempt to block noisy test crawler that accesses malformed URLs