gizmodo.jp
robots.txt

Robots Exclusion Standard data for gizmodo.jp

Resource Scan

Scan Details

Site Domain gizmodo.jp
Base Domain gizmodo.jp
Scan Status Ok
Last Scan2024-09-28T08:27:19+00:00
Next Scan 2024-10-05T08:27:19+00:00

Last Scan

Scanned2024-09-28T08:27:19+00:00
URL https://gizmodo.jp/robots.txt
Redirect https://www.gizmodo.jp/robots.txt
Redirect Domain www.gizmodo.jp
Redirect Base gizmodo.jp
Domain IPs 13.224.163.111, 13.224.163.32, 13.224.163.34, 13.224.163.47
Redirect IPs 13.35.238.127, 13.35.238.128, 13.35.238.42, 13.35.238.99
Response IP 13.35.238.128
Found Yes
Hash e7c4d57af20f5dacaa958501ac9d059adca1d0a78de286a92ed90774f4f2fb3f
SimHash e8f949378df3

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

slurp

Rule Path
Disallow /2018/11/citizen-attesa-darkmode.html
Disallow /2018/11/audio-technica-ath-ckr7tw.html
Disallow /2018/08/audio-technica-ath-cks7tw.html
Disallow /2018/07/samsung-ssd-t5-1.html
Disallow /2018/03/163441.html
Disallow /2018/01/society5-japan.html
Disallow /2017/12/contact-lens-acuvue.html
Disallow /2017/09/104536.html
Disallow /2010/12/jihanki.html
Disallow /2011/02/_af15_b008.html
Disallow /2010/09/epson_printer.html
Disallow /2011/11/prphotoshop_cs5.html
Disallow /2011/12/ipadnifty_wimax3.html
Disallow /2012/01/sms3.html
Disallow /2012/01/jkwillcom.html
Disallow /2012/03/atermwm3600rideapad_tablet_a19.html
Disallow /2012/02/verprau.html
Disallow /2012/03/adobe_lightroom_4.html
Disallow /2012/05/niftyemobilelte.html
Disallow /2012/06/national_geographic_50photographs.html
Disallow /2012/08/kirin_genki_project.html
Disallow /2012/10/pr_5.html
Disallow /2013/02/wm3800r_kakakucom.html
Disallow /2013/06/auperfect_sync.html
Disallow /2012/06/post_12411.html
Disallow /2013/10/nttwest_flets_hikari_mobile_pack_lte.html
Disallow /2014/05/pr.html
Disallow /2014/08/rakuten_showtime_drama.html
Disallow /2014/07/agf_kaori_letter.html
Disallow /2014/10/prb65powershot_sx60_sh.html
Disallow /2014/12/canon_powershot_g7_x.html
Disallow /2014/12/newspicks.html
Disallow /2015/01/plala_data_unlimited_add_talk.html
Disallow /2015/03/pr_v_preca.html
Disallow /2015/04/nikon_1_j5_girl.html
Disallow /2015/05/galaxy_s6_and_s6_edge_cpu.html
Disallow /2015/11/sharp_emopa.html
Disallow /2016/05/iphone_6ssim.html
Disallow /2016/07/test_redirect.html
Disallow /2016/09/ntt_hikari_cloud_pbx.html
Disallow /2027/10/post_665075.html
Disallow /2016/12/nb_hanzo.html
Disallow /2017/01/jcom_mobile_interview.html
Disallow /2017/01/psvr_stg_check.html
Disallow /2016/08/softbank-gakuwarimonster-u18.html
Disallow /2017/04/sportsnavi_01.html
Disallow /2017/04/sportsnavi_02.html
Disallow /2017/04/sportsnavi_03.html

*

Rule Path
Disallow /index.xml*?d=
Disallow /index.xml*?a=
Disallow /api/increment-pv
Disallow /api/SurveyCount
Disallow /api/tag-cloud
Disallow /api/taxonomies
Disallow /api/feature-posts

Other Records

Field Value
sitemap https://www.gizmodo.jp/sitemap_index.xml
sitemap https://www.gizmodo.jp/google_news_sitemap.xml