sankeibiz.jp
robots.txt

Robots Exclusion Standard data for sankeibiz.jp

Resource Scan

Scan Details

Site Domain sankeibiz.jp
Base Domain sankeibiz.jp
Scan Status Ok
Last Scan2024-09-17T00:58:51+00:00
Next Scan 2024-09-24T00:58:51+00:00

Last Scan

Scanned2024-09-17T00:58:51+00:00
URL https://sankeibiz.jp/robots.txt
Redirect https://www.sankeibiz.jp/robots.txt
Redirect Domain www.sankeibiz.jp
Redirect Base sankeibiz.jp
Domain IPs 3.113.67.136, 54.238.1.28
Redirect IPs 23.45.207.170, 23.45.207.175, 2600:1413:b000:13::b857:c18c, 2600:1413:b000:13::b857:c18f
Response IP 23.49.60.42
Found Yes
Hash be0c2d1a7ede42da8c66417e543a646c1f39ff2690b3dd0fc4cb0c9ef677ce9c
SimHash a00c5451f733

Groups

*

Rule Path
Disallow /_test/
Disallow /smp/_test/
Disallow /pdf/
Disallow */print/
Disallow /module/
Disallow /parts/
Disallow /preview/

Other Records

Field Value
sitemap https://www.sankeibiz.jp/feeds/sitemapindex/?outputType=xml
sitemap https://www.sankeibiz.jp/feeds/sitemapindex-category/?outputType=xml
sitemap https://www.sankeibiz.jp/feeds/google-sitemapindex/?outputType=xml

Comments

  • sitemap
  • Sitemap: https://www.sankeibiz.jp/sitemap.xml
  • not contents