lifehacker.com
robots.txt

Robots Exclusion Standard data for lifehacker.com

Resource Scan

Scan Details

Site Domain lifehacker.com
Base Domain lifehacker.com
Scan Status Ok
Last Scan2024-05-04T02:45:17+00:00
Next Scan 2024-05-11T02:45:17+00:00

Last Scan

Scanned2024-05-04T02:45:17+00:00
URL https://lifehacker.com/robots.txt
Domain IPs 104.18.42.209, 172.64.145.47, 2606:4700:4400::6812:2ad1, 2606:4700:4400::ac40:912f
Response IP 104.18.42.209
Found Yes
Hash 4b2a1653a754c1cc2d30c17bea66f7fa85583cf8bfd5c625abd1eff5698f1aec
SimHash 200c8a42c7b3

Groups

*

Rule Path
Disallow /index.xml
Allow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://lifehacker.com/sitemap-index.xml
sitemap https://lifehacker.com/sitemap-google-news-0.xml