twpro.jp
robots.txt

Robots Exclusion Standard data for twpro.jp

Resource Scan

Scan Details

Site Domain twpro.jp
Base Domain twpro.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-17T15:54:24+00:00
Next Scan 2024-10-15T15:54:24+00:00

Last Successful Scan

Scanned2023-12-21T14:49:05+00:00
URL https://twpro.jp/robots.txt
Domain IPs 2600:1901:0:610b::, 35.190.47.174
Response IP 35.190.47.174
Found Yes
Hash 912cb9c0732c26749c7819ec9521dbd3f2b4ea14acc01a72f50f892b975d938d
SimHash 6312c0c44731

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /home/
Allow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30