Log In Sign Up

balaptoto.top
robots.txt

Robots Exclusion Standard data for balaptoto.top

Resource Scan

Scan Details

Site Domain balaptoto.top
Base Domain balaptoto.top
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-10T00:08:26+00:00
Next Scan 2026-04-11T00:08:26+00:00

Last Successful Scan

Scanned2025-11-18T15:39:30+00:00
URL https://balaptoto.top/robots.txt
Domain IPs 104.21.5.11, 172.67.132.183, 2606:4700:3032::6815:50b, 2606:4700:3033::ac43:84b7
Response IP 172.67.132.183
Found Yes
Hash a4c768afb4099b433fc4fabb7ad5ea67550b5366f41b2c74dbaffc4eb2f7d6e8
SimHash 401cdcb0e79b

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap http://balaptoto.top/api/sitemap-index
Back to top

Comments

  • Allow major search engines
  • Block AI scrapers
  • Block bad bots
Back to top