pen-online.jp
robots.txt

Robots Exclusion Standard data for pen-online.jp

Resource Scan

Scan Details

Site Domain pen-online.jp
Base Domain pen-online.jp
Scan Status Ok
Last Scan2024-11-16T15:15:54+00:00
Next Scan 2024-11-23T15:15:54+00:00

Last Scan

Scanned2024-11-16T15:15:54+00:00
URL https://pen-online.jp/robots.txt
Redirect https://www.pen-online.jp:443/robots.txt
Redirect Domain www.pen-online.jp
Redirect Base pen-online.jp
Domain IPs 3.113.48.151, 52.192.253.50, 52.198.101.6
Redirect IPs 3.113.48.151, 52.192.253.50, 52.198.101.6
Response IP 52.198.101.6
Found Yes
Hash c97109ea2627f6e20716982caa2cfd3459874ae68c9c296c2673c84e391cfacd
SimHash 294858dae99b

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.pen-online.jp/sitemap.xml
sitemap https://www.pen-online.jp/sitemap_xml/article_2022.xml
sitemap https://www.pen-online.jp/sitemap_xml/article_2023.xml
sitemap https://www.pen-online.jp/sitemap_xml/magazine_penbooks.xml
sitemap https://www.pen-online.jp/sitemap_xml/magazine_pen.xml
sitemap https://www.pen-online.jp/sitemap_xml/magazine_penplus.xml