efinancialcareers.co.uk
robots.txt

Robots Exclusion Standard data for efinancialcareers.co.uk

Resource Scan

Scan Details

Site Domain efinancialcareers.co.uk
Base Domain efinancialcareers.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-21T05:11:42+00:00
Next Scan 2024-10-05T05:11:42+00:00

Last Successful Scan

Scanned2024-09-05T06:44:38+00:00
URL https://www.efinancialcareers.co.uk/robots.txt
Domain IPs 13.35.18.102, 13.35.18.112, 13.35.18.123, 13.35.18.78, 2600:9000:20c7:3e00:19:b8d1:c000:93a1, 2600:9000:20c7:7a00:19:b8d1:c000:93a1, 2600:9000:20c7:8e00:19:b8d1:c000:93a1, 2600:9000:20c7:9400:19:b8d1:c000:93a1, 2600:9000:20c7:9e00:19:b8d1:c000:93a1, 2600:9000:20c7:be00:19:b8d1:c000:93a1, 2600:9000:20c7:dc00:19:b8d1:c000:93a1, 2600:9000:20c7:fa00:19:b8d1:c000:93a1
Response IP 13.35.18.78
Found Yes
Hash a92131369a87c4d18dd09a46bd93efa2479380e58c786d11a730a15bd5dd6e33
SimHash 49009702cc73

Groups

*

Rule Path
Disallow /secure
Disallow /myefc
Disallow /login
Disallow /rememberMobilePreference
Disallow /remote
Disallow /profile
Allow /ideal-employer

Other Records

Field Value
crawl-delay 10

googlebot-news

Rule Path
Allow /news/
Allow /feed/
Allow /recent-news-sitemap.xml
Allow /news-sitemaps/

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.efinancialcareers.co.uk/sitemap-secure/latestjobs/xml
sitemap https://www.efinancialcareers.co.uk/gb-en-jobs-sitemap.xml
sitemap https://www.efinancialcareers.co.uk/news-sitemaps/sitemap-index.xml