basebase.ti-da.net
robots.txt

Robots Exclusion Standard data for basebase.ti-da.net

Resource Scan

Scan Details

Site Domain basebase.ti-da.net
Base Domain ti-da.net
Scan Status Ok
Last Scan2025-09-07T23:17:06+00:00
Next Scan 2025-10-07T23:17:06+00:00

Last Scan

Scanned2025-09-07T23:17:06+00:00
URL https://basebase.ti-da.net/robots.txt
Domain IPs 106.184.98.198
Response IP 106.184.98.198
Found Yes
Hash 9e29080fee28a171069f3fb9c4fa9ff61a773a8a24c385b6bffe787683eaeeae
SimHash 4a60d04143e3

Groups

mediapartners-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

*

Rule Path
Disallow /

Comments

  • Google系はAllow
  • BingbotにはCrawl-delay指定
  • Facebookクローラーを許可
  • Twitter (旧X) クローラーを許可
  • それ以外のBotはクロール禁止