Log In Sign Up

tfy.io
robots.txt

Robots Exclusion Standard data for tfy.io

Resource Scan

Scan Details

Site Domain tfy.io
Base Domain tfy.io
Scan Status Ok
Last Scan2026-01-30T13:28:33+00:00
Next Scan 2026-02-06T13:28:33+00:00

Last Scan

Scanned2026-01-30T13:28:33+00:00
URL https://tfy.io/robots.txt
Domain IPs 104.21.91.49, 172.67.166.188, 2606:4700:3035::6815:5b31, 2606:4700:3036::ac43:a6bc
Response IP 104.21.91.49
Found Yes
Hash fd95ee87a196236a0856e62939caab0466327f8ca4cf065638a3dc5d39166e77
SimHash d89ed7d4fc00

Groups

mj12bot
petalbot
aspiegelbot
dotbot
mauibot
blexbot
semrushbot
semrushbot-sa
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
semrushbot-seoab
amazonbot
applebot
grapeshotcrawler
neevabot
bytespider
serpstatbot
dataforseobot
imagesiftbot
proximic
barkrowler

Rule Path
Disallow /

googlebot
mediapartners-google
bingbot
ahrefsbot
siteauditbot
siteauditbot-mobile

Rule Path
Allow /
Disallow /cdn-cgi/
Disallow /js/tck
Disallow /client
Disallow /ca/job-wrapping/tck
Disallow /ca/job-opening
Disallow /job-opening
Back to top

Other Records

Field Value
sitemap https://www.talentify.io/sitemap.xml
Back to top

Warnings

  • 1 invalid line.
Back to top