talentify.io
robots.txt

Robots Exclusion Standard data for talentify.io

Resource Scan

Scan Details

Site Domain talentify.io
Base Domain talentify.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-04T03:33:41+00:00
Next Scan 2025-08-02T03:33:41+00:00

Last Successful Scan

Scanned2025-01-05T03:30:41+00:00
URL https://talentify.io/robots.txt
Redirect https://www.talentify.io/robots.txt
Redirect Domain www.talentify.io
Redirect Base talentify.io
Domain IPs 104.26.12.182, 104.26.13.182, 172.67.73.37, 2606:4700:20::681a:cb6, 2606:4700:20::681a:db6, 2606:4700:20::ac43:4925
Redirect IPs 104.26.12.182, 104.26.13.182, 172.67.73.37, 2606:4700:20::681a:cb6, 2606:4700:20::681a:db6, 2606:4700:20::ac43:4925
Response IP 172.67.73.37
Found Yes
Hash fd95ee87a196236a0856e62939caab0466327f8ca4cf065638a3dc5d39166e77
SimHash d89ed7d4fc00

Groups

mj12bot
petalbot
aspiegelbot
dotbot
mauibot
blexbot
semrushbot
semrushbot-sa
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
semrushbot-seoab
amazonbot
applebot
grapeshotcrawler
neevabot
bytespider
serpstatbot
dataforseobot
imagesiftbot
proximic
barkrowler

Rule Path
Disallow /

googlebot
mediapartners-google
bingbot
ahrefsbot
siteauditbot
siteauditbot-mobile

Rule Path
Allow /
Disallow /cdn-cgi/
Disallow /js/tck
Disallow /client
Disallow /ca/job-wrapping/tck
Disallow /ca/job-opening
Disallow /job-opening

Other Records

Field Value
sitemap https://www.talentify.io/sitemap.xml

Warnings

  • 1 invalid line.