lifehacker.jp
robots.txt

Robots Exclusion Standard data for lifehacker.jp

Resource Scan

Scan Details

Site Domain lifehacker.jp
Base Domain lifehacker.jp
Scan Status Ok
Last Scan2024-06-19T07:15:50+00:00
Next Scan 2024-06-26T07:15:50+00:00

Last Scan

Scanned2024-06-19T07:15:50+00:00
URL https://lifehacker.jp/robots.txt
Redirect https://www.lifehacker.jp/robots.txt
Redirect Domain www.lifehacker.jp
Redirect Base lifehacker.jp
Domain IPs 13.33.88.100, 13.33.88.113, 13.33.88.47, 13.33.88.49
Redirect IPs 2600:9000:271a:1600:19:8082:66c0:93a1, 2600:9000:271a:2e00:19:8082:66c0:93a1, 2600:9000:271a:3e00:19:8082:66c0:93a1, 2600:9000:271a:5e00:19:8082:66c0:93a1, 2600:9000:271a:8000:19:8082:66c0:93a1, 2600:9000:271a:9600:19:8082:66c0:93a1, 2600:9000:271a:b000:19:8082:66c0:93a1, 2600:9000:271a:ee00:19:8082:66c0:93a1, 3.165.82.100, 3.165.82.106, 3.165.82.109, 3.165.82.78
Response IP 3.165.82.106
Found Yes
Hash 99d36077f96d96d8af6ae799daf94c0da5f50ee7e36a26569088a81edfaecabf
SimHash da0d9b549502

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /2019/12/mastercard-cashpassport.html
Disallow /2019/09/199168.html
Disallow /2019/09/198032_basefood.html
Disallow /2019/09/198034_basefood.html
Disallow /2018/11/line_music_running.html
Disallow /2018/11/cleaning-washing-detergent.html
Disallow /2018/11/bizreach-hamamatsu.html
Disallow /2017/06/34543.html
Disallow /2014/04/140418kimihatsu.html
Disallow /2014/06/140604kimihatsu_matome.html
Disallow /2014/07/140723kimihatsu_matome.html
Disallow /2015/03/150317nikkei_globalenglish.html

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.lifehacker.jp/sitemap/index.xml
sitemap https://www.lifehacker.jp/feed/google_news_sitemap.xml