Log In Sign Up

endava.com
robots.txt

Robots Exclusion Standard data for endava.com

Resource Scan

Scan Details

Site Domain endava.com
Base Domain endava.com
Scan Status Ok
Last Scan2024-08-26T06:09:19+00:00
Next Scan 2024-09-25T06:09:19+00:00

Last Scan

Scanned2024-08-26T06:09:19+00:00
URL https://endava.com/robots.txt
Redirect https://www.endava.com/robots.txt
Redirect Domain www.endava.com
Redirect Base endava.com
Domain IPs 199.60.103.44
Redirect IPs 141.101.90.96, 141.101.90.97, 141.101.90.98, 141.101.90.99, 2a06:98c1:3200::90:0, 2a06:98c1:3200::90:1, 2a06:98c1:3200::90:2, 2a06:98c1:3200::90:3
Response IP 141.101.90.97
Found Yes
Hash 6fbdf9343c53060978f8848c4245cc6cb248624e2128de4d23b395f5a063df6d
SimHash 7b54d6f1f490

Groups

blexbot

Rule Path
Disallow /
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/

mj12bot

Rule Path
Disallow /
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/

twengabot

Rule Path
Disallow /
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/

ahrefsbot

Rule Path
Disallow /
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/

wotbox

Rule Path
Disallow /
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/

megaindex.ru/2.0

Rule Path
Disallow /
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/

googlebot-image

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/

*

Rule Path
Disallow /*/tag/
Disallow /*/author/
Disallow /en/
Disallow /de-de/
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Back to top

Other Records

Field Value
sitemap https://www.endava.com/sitemap.xml
Back to top

Comments

  • Sitemaps
  • Image Crawler Setup
  • Directories
Back to top

Warnings

  • 5 invalid lines.
Back to top