Log In Sign Up

asktoyami.com
robots.txt

Robots Exclusion Standard data for asktoyami.com

Resource Scan

Scan Details

Site Domain asktoyami.com
Base Domain asktoyami.com
Scan Status Ok
Last Scan2025-10-19T10:59:55+00:00
Next Scan 2025-11-18T10:59:55+00:00

Last Scan

Scanned2025-10-19T10:59:55+00:00
URL https://asktoyami.com/robots.txt
Domain IPs 104.21.70.170, 172.67.138.5, 2606:4700:3036::6815:46aa, 2606:4700:3037::ac43:8a05
Response IP 172.67.138.5
Found Yes
Hash 027ca1ec9c36c06f64010f3f382e1eeb6a71836af14042d5bd721bea4f8510cd
SimHash 1932c841c778

Groups

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandexbot

Rule Path
Disallow

applebot

Rule Path
Disallow

twitterbot

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

linkedinbot

Rule Path
Disallow

pinterestbot

Rule Path
Disallow

slackbot

Rule Path
Disallow

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • Allow Googlebot (Google)
  • Allow Bingbot (Microsoft)
  • Allow DuckDuckBot (DuckDuckGo)
  • Allow Baiduspider (Baidu)
  • Allow YandexBot (Yandex)
  • Allow Applebot (Apple)
  • Allow Twitterbot (Twitter)
  • Allow FacebookExternalHit (Facebook)
  • Allow LinkedInBot (LinkedIn)
  • Allow Pinterestbot (Pinterest)
  • Allow Slackbot (Slack)
  • Block Wayback Machine (Internet Archive)
  • Block all other bots (default)
Back to top

Warnings

  • 8 invalid lines.
Back to top