Log In Sign Up

translationdirectory.com
robots.txt

Robots Exclusion Standard data for translationdirectory.com

Resource Scan

Scan Details

Site Domain translationdirectory.com
Base Domain translationdirectory.com
Scan Status Ok
Last Scan2025-03-08T16:12:19+00:00
Next Scan 2025-03-15T16:12:19+00:00

Last Scan

Scanned2025-03-08T16:12:19+00:00
URL https://translationdirectory.com/robots.txt
Domain IPs 46.248.185.66
Response IP 46.248.185.66
Found Yes
Hash cafe73238eb79d275dbc6c774e37c6041cd596af0a9050dd67391242d9059298
SimHash 70145140a013

Groups

ahrefsbot/7.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot/1.0

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

youbot

Rule Path
Disallow /
Back to top