Log In Sign Up

efinancialcareers-gulf.com
robots.txt

Robots Exclusion Standard data for efinancialcareers-gulf.com

Resource Scan

Scan Details

Site Domain efinancialcareers-gulf.com
Base Domain efinancialcareers-gulf.com
Scan Status Ok
Last Scan2024-06-10T11:41:29+00:00
Next Scan 2024-06-17T11:41:29+00:00

Last Scan

Scanned2024-06-10T11:41:29+00:00
URL https://www.efinancialcareers-gulf.com/robots.txt
Domain IPs 13.33.30.17, 13.33.30.4, 13.33.30.42, 13.33.30.57, 2600:9000:229f:1400:19:b8d1:c000:93a1, 2600:9000:229f:2a00:19:b8d1:c000:93a1, 2600:9000:229f:6600:19:b8d1:c000:93a1, 2600:9000:229f:a800:19:b8d1:c000:93a1, 2600:9000:229f:ba00:19:b8d1:c000:93a1, 2600:9000:229f:be00:19:b8d1:c000:93a1, 2600:9000:229f:ca00:19:b8d1:c000:93a1, 2600:9000:229f:dc00:19:b8d1:c000:93a1
Response IP 13.33.30.57
Found Yes
Hash 0c726655e7fa76eb8eb94590366fd030a605ad3eb54798451094d04e30ec468e
SimHash 4d14d502c063

Groups

*

Rule Path
Disallow /secure
Disallow /myefc
Disallow /login
Disallow /rememberMobilePreference
Disallow /remote
Disallow /profile
Allow /ideal-employer

Other Records

Field Value
crawl-delay 10

googlebot-news

Rule Path
Allow /news/
Allow /news-sitemap.xml
Allow /feed/
Allow /recent-news-sitemap.xml

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.efinancialcareers-gulf.com/sitemap-secure/latestjobs/xml
sitemap https://www.efinancialcareers-gulf.com/news-sitemap.xml
sitemap https://www.efinancialcareers-gulf.com/recent-news-sitemap.xml
sitemap https://www.efinancialcareers-gulf.com/ae-en-jobs-sitemap.xml
Back to top