talentaq.org
robots.txt
Robots Exclusion Standard data for talentaq.org
Resource Scan
Scan Details
| Site Domain | talentaq.org |
| Base Domain | talentaq.org |
| Scan Status | Ok |
| Last Scan | 2026-03-09T00:58:59+00:00 |
| Next Scan | 2026-04-08T00:58:59+00:00 |
Last Scan
| Scanned | 2026-03-09T00:58:59+00:00 |
| URL | https://talentaq.org/robots.txt |
| Domain IPs | 104.21.40.199, 172.67.138.143, 2606:4700:3032::6815:28c7, 2606:4700:3034::ac43:8a8f |
| Response IP | 104.21.40.199 |
| Found | Yes |
| Hash | 70ef105e173e3be1eb2f70bef5615cca6cd5e7b08119e8d08928b3da1a670f07 |
| SimHash | 44174313cc95 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
seranking-backlinks
dotbot
petalbot
tiktokspider
barkrowler
ahrefsbot
ahrefsbot
mj12bot
| Rule | Path |
|---|---|
| Disallow | / |
googlebot
bingbot
slurp
duckduckbot
baiduspider
yandexbot
facebookexternalhit
twitterbot
linkedinbot
whatsapp
telegrambot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | /_next/ |
| Disallow | /_vercel/ |
| Disallow | /reel-quiz/job/ |
| Disallow | /reel-quiz/skill/ |
claudebot
claude-searchbot
gptbot
chatgpt-user
ccbot
anthropic-ai
claude-web
perplexitybot
youbot
bytespider
bytespider
awario-bot
awariobot
amazonbot
amazonbot
meta-externalagent
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | /_next/ |
| Disallow | /_vercel/ |
| Disallow | /reel-quiz/job/ |
| Disallow | /reel-quiz/skill/ |
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | /_next/ |
| Disallow | /_vercel/ |
| Disallow | /reel-quiz/job/ |
| Disallow | /reel-quiz/skill/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://talentaq.org/sitemap.xml |
Warnings
- `content-signal` is not a known field.
Comments