nishinippon.co.jp
robots.txt

Robots Exclusion Standard data for nishinippon.co.jp

Resource Scan

Scan Details

Site Domain nishinippon.co.jp
Base Domain nishinippon.co.jp
Scan Status Ok
Last Scan2024-04-30T23:16:10+00:00
Next Scan 2024-05-07T23:16:10+00:00

Last Scan

Scanned2024-04-30T23:16:10+00:00
URL https://nishinippon.co.jp/robots.txt
Redirect https://www.nishinippon.co.jp/robots.txt
Redirect Domain www.nishinippon.co.jp
Redirect Base nishinippon.co.jp
Domain IPs 13.225.4.126, 13.225.4.23, 13.225.4.35, 13.225.4.91
Redirect IPs 13.225.4.126, 13.225.4.23, 13.225.4.35, 13.225.4.91
Response IP 13.225.4.126
Found Yes
Hash 989af70a96411b0f5a2d143621d1d3208fa5200596017034f36d3d8d2504e556
SimHash 7804c961a1b3

Groups

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

*

Rule Path
Disallow /*.pdf$
Allow /

Other Records

Field Value
sitemap https://www.nishinippon.co.jp/sitemap/sitemap.xml.gz