efinancialcareers-gulf.com
robots.txt

Robots Exclusion Standard data for efinancialcareers-gulf.com

Resource Scan

Scan Details

Site Domain efinancialcareers-gulf.com
Base Domain efinancialcareers-gulf.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-18T17:57:18+00:00
Next Scan 2024-10-02T17:57:18+00:00

Last Successful Scan

Scanned2024-09-02T11:49:42+00:00
URL https://www.efinancialcareers-gulf.com/robots.txt
Domain IPs 13.35.18.102, 13.35.18.112, 13.35.18.123, 13.35.18.78, 2600:9000:20c7:1200:19:b8d1:c000:93a1, 2600:9000:20c7:2a00:19:b8d1:c000:93a1, 2600:9000:20c7:5000:19:b8d1:c000:93a1, 2600:9000:20c7:5600:19:b8d1:c000:93a1, 2600:9000:20c7:9000:19:b8d1:c000:93a1, 2600:9000:20c7:9c00:19:b8d1:c000:93a1, 2600:9000:20c7:ae00:19:b8d1:c000:93a1, 2600:9000:20c7:f400:19:b8d1:c000:93a1
Response IP 13.35.18.78
Found Yes
Hash a5615b243ae01f363809c4072c1b2c69ae1319c9372ab5cc0f492af36cce1be3
SimHash 4d14d712cc73

Groups

*

Rule Path
Disallow /secure
Disallow /myefc
Disallow /login
Disallow /rememberMobilePreference
Disallow /remote
Disallow /profile
Allow /ideal-employer

Other Records

Field Value
crawl-delay 10

googlebot-news

Rule Path
Allow /news/
Allow /feed/

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.efinancialcareers-gulf.com/sitemap-secure/latestjobs/xml
sitemap https://www.efinancialcareers-gulf.com/ae-en-jobs-sitemap.xml