turbotbird.com
robots.txt

Robots Exclusion Standard data for turbotbird.com

Resource Scan

Scan Details

Site Domain turbotbird.com
Base Domain turbotbird.com
Scan Status Ok
Last Scan2025-11-20T20:27:44+00:00
Next Scan 2025-12-20T20:27:44+00:00

Last Scan

Scanned2025-11-20T20:27:44+00:00
URL https://turbotbird.com/robots.txt
Domain IPs 104.21.24.77, 172.67.217.201, 2606:4700:3035::6815:184d, 2606:4700:3037::ac43:d9c9
Response IP 172.67.217.201
Found Yes
Hash e913c6790517d1a0c416884fd39800d62383474ca96e103812c7383636300f4e
SimHash 3ccd4848a0c7

Groups

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

kangaroo bot

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

cohere-training-data-crawler

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

youbot

Rule Path
Disallow /

*

Rule Path
Disallow /captcha.php
Disallow /editpost.php
Disallow /misc.php
Disallow /modcp.php
Disallow /moderation.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /online.php
Disallow /printthread.php
Disallow /private.php
Disallow /ratethread.php
Disallow /report.php
Disallow /reputation.php
Disallow /search.php
Disallow /sendthread.php
Disallow /task.php
Disallow /usercp.php
Disallow /usercp2.php
Disallow /calendar.php
Disallow /*action%3Demailuser*
Disallow /*action%3Dnextnewest*
Disallow /*action%3Dnextoldest*
Disallow /*year%3D*
Disallow /*action%3Dweekview*
Disallow /*action%3Dnextnewest*
Disallow /*action%3Dnextoldest*
Disallow /*sort%3D*
Disallow /*order%3D*
Disallow /*mode%3D*
Disallow /*datecut%3D*

Other Records

Field Value
sitemap http://turbotbird.com/sitemap-index.xml