breeder-navi.jp
robots.txt

Robots Exclusion Standard data for breeder-navi.jp

Resource Scan

Scan Details

Site Domain breeder-navi.jp
Base Domain breeder-navi.jp
Scan Status Ok
Last Scan2024-06-26T14:14:12+00:00
Next Scan 2024-07-03T14:14:12+00:00

Last Scan

Scanned2024-06-26T14:14:12+00:00
URL https://breeder-navi.jp/robots.txt
Redirect https://www.breeder-navi.jp/robots.txt
Redirect Domain www.breeder-navi.jp
Redirect Base breeder-navi.jp
Domain IPs 13.33.30.24, 13.33.30.44, 13.33.30.67, 13.33.30.7
Redirect IPs 54.192.18.126, 54.192.18.48, 54.192.18.72, 54.192.18.98
Response IP 13.33.30.7
Found Yes
Hash 138458d47eb8cddcd0cfba2fab4e15bf279c9ac0cd0216ae8ddeee93fb36c716
SimHash 5a0cce22ce13

Groups

*

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.breeder-navi.jp/sitemap.xml