internshipguide.jp
robots.txt

Robots Exclusion Standard data for internshipguide.jp

Resource Scan

Scan Details

Site Domain internshipguide.jp
Base Domain internshipguide.jp
Scan Status Ok
Last Scan2025-11-27T00:32:16+00:00
Next Scan 2025-12-27T00:32:16+00:00

Last Scan

Scanned2025-11-27T00:32:16+00:00
URL https://internshipguide.jp/robots.txt
Domain IPs 104.26.10.128, 104.26.11.128, 172.67.69.169, 2606:4700:20::681a:a80, 2606:4700:20::681a:b80, 2606:4700:20::ac43:45a9
Response IP 172.67.69.169
Found Yes
Hash 3238554f8ab71a752be3e42d743a1e4eaa48a6aa139d0128b0467f0b44e07022
SimHash 68048a368191

Groups

*

Rule Path
Allow /
Disallow /UserErrors/
Disallow /Users/input
Disallow /EmailVerifies/
Disallow /*.pdf$

Other Records

Field Value
sitemap https://internshipguide.jp/sitemap.xml