nikkeibp.co.jp
robots.txt

Robots Exclusion Standard data for nikkeibp.co.jp

Resource Scan

Scan Details

Site Domain nikkeibp.co.jp
Base Domain nikkeibp.co.jp
Scan Status Ok
Last Scan2024-06-26T07:02:41+00:00
Next Scan 2024-07-03T07:02:41+00:00

Last Scan

Scanned2024-06-26T07:02:41+00:00
URL https://nikkeibp.co.jp/robots.txt
Redirect https://www.nikkeibp.co.jp/robots.txt
Redirect Domain www.nikkeibp.co.jp
Redirect Base nikkeibp.co.jp
Domain IPs 52.199.47.133, 54.248.113.252
Redirect IPs 35.73.234.147, 35.75.226.193
Response IP 35.75.226.193
Found Yes
Hash 7c8e9f2c606295778f2e25d718b3a066a015d2c1f8cb2b80970083da95053a76
SimHash ca046b71a0b7

Groups

*

Rule Path
Allow /atcl/corporate/
Allow /atcl/information/
Allow /atcl/newsrelease/
Disallow /corporate/
Disallow /article/
Disallow /atcl/

google-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

omgili

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.nikkeibp.co.jp/sitemap.xml