efinancialcareers.co.za
robots.txt

Robots Exclusion Standard data for efinancialcareers.co.za

Resource Scan

Scan Details

Site Domain efinancialcareers.co.za
Base Domain efinancialcareers.co.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-19T22:54:23+00:00
Next Scan 2024-10-03T22:54:23+00:00

Last Successful Scan

Scanned2024-09-03T21:04:07+00:00
URL https://www.efinancialcareers.co.za/robots.txt
Domain IPs 13.35.18.102, 13.35.18.112, 13.35.18.123, 13.35.18.78, 2600:9000:20c7:1800:19:b8d1:c000:93a1, 2600:9000:20c7:4800:19:b8d1:c000:93a1, 2600:9000:20c7:5400:19:b8d1:c000:93a1, 2600:9000:20c7:6c00:19:b8d1:c000:93a1, 2600:9000:20c7:7200:19:b8d1:c000:93a1, 2600:9000:20c7:9600:19:b8d1:c000:93a1, 2600:9000:20c7:ce00:19:b8d1:c000:93a1, 2600:9000:20c7:e00:19:b8d1:c000:93a1
Response IP 13.35.18.123
Found Yes
Hash ea8dbc7a4e63df2467ad370d6358b50b2d3c82415534708a83ae71339ae22575
SimHash 49049716c473

Groups

*

Rule Path
Disallow /secure
Disallow /myefc
Disallow /login
Disallow /rememberMobilePreference
Disallow /remote
Disallow /profile
Allow /ideal-employer

Other Records

Field Value
crawl-delay 10

googlebot-news

Rule Path
Allow /news/
Allow /feed/

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.efinancialcareers.co.za/sitemap-secure/latestjobs/xml
sitemap https://www.efinancialcareers.co.za/za-en-jobs-sitemap.xml