toodoo.in
robots.txt
Robots Exclusion Standard data for toodoo.in
Resource Scan
Scan Details
| Site Domain | toodoo.in |
| Base Domain | toodoo.in |
| Scan Status | Ok |
| Last Scan | 2025-10-19T23:37:50+00:00 |
| Next Scan | 2025-11-18T23:37:50+00:00 |
Last Scan
| Scanned | 2025-10-19T23:37:50+00:00 |
| URL | https://toodoo.in/robots.txt |
| Domain IPs | 13.226.69.111, 13.226.69.36, 13.226.69.39, 13.226.69.49 |
| Response IP | 18.155.68.34 |
| Found | Yes |
| Hash | d3e46d232c87cd46c883eaa123756408f5857d5a293d2bb6c638b0b8f06cc663 |
| SimHash | 771a8153c082 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /static/js |
| Disallow | /redirect-partner |
| Disallow | /partner-reservation |
| Disallow | /refine |
| Disallow | /bookmark |
google-extended
gptbot
oai-searchbot
chatgpt-user
chatgpt-user/2.0
anthropic-ai
claudebot
claude-user
claudebot-searchbot
claude-web
cohere-ai
applebot
applebot-extended
amazonbot
perplexitybot
perplexity-user
facebookbot
meta-externalagent
linkedinbot
bytespider
duckassistbot
ai2bot
ccbot
diffbot
omgili
timpibot
youbot
mistralai-user
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /redirect-partner |
| Disallow | /partner-reservation |
| Disallow | /refine |
| Disallow | /bookmark |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://toodoo.in/sitemap.xml |
| sitemap | https://toodoo.in/gz/site-map-all.xml |