efinancialcareers.com.au
robots.txt

Robots Exclusion Standard data for efinancialcareers.com.au

Resource Scan

Scan Details

Site Domain efinancialcareers.com.au
Base Domain efinancialcareers.com.au
Scan Status Ok
Last Scan2024-06-03T15:24:04+00:00
Next Scan 2024-06-10T15:24:04+00:00

Last Scan

Scanned2024-06-03T15:24:04+00:00
URL https://www.efinancialcareers.com.au/robots.txt
Domain IPs 18.161.180.112, 18.161.180.118, 18.161.180.14, 18.161.180.32, 2600:9000:2135:1000:19:b8d1:c000:93a1, 2600:9000:2135:3e00:19:b8d1:c000:93a1, 2600:9000:2135:5200:19:b8d1:c000:93a1, 2600:9000:2135:8200:19:b8d1:c000:93a1, 2600:9000:2135:8600:19:b8d1:c000:93a1, 2600:9000:2135:aa00:19:b8d1:c000:93a1, 2600:9000:2135:e000:19:b8d1:c000:93a1, 2600:9000:2135:e00:19:b8d1:c000:93a1
Response IP 13.33.30.57
Found Yes
Hash b2a7dd7a3f8c4675d6aa653781af421e80d60f638e11173b6a5bb52c9d1e7486
SimHash 4d109502c873

Groups

*

Rule Path
Disallow /secure
Disallow /myefc
Disallow /login
Disallow /rememberMobilePreference
Disallow /remote
Disallow /profile
Allow /ideal-employer

Other Records

Field Value
crawl-delay 10

googlebot-news

Rule Path
Allow /news/
Allow /news-sitemap.xml
Allow /feed/
Allow /recent-news-sitemap.xml

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.efinancialcareers.com.au/sitemap-secure/latestjobs/xml
sitemap https://www.efinancialcareers.com.au/news-sitemap.xml
sitemap https://www.efinancialcareers.com.au/recent-news-sitemap.xml
sitemap https://www.efinancialcareers.com.au/au-en-jobs-sitemap.xml