Log In Sign Up

exasol.com
robots.txt

Robots Exclusion Standard data for exasol.com

Resource Scan

Scan Details

Site Domain exasol.com
Base Domain exasol.com
Scan Status Ok
Last Scan2025-12-28T10:05:54+00:00
Next Scan 2026-01-11T10:05:54+00:00

Last Scan

Scanned2025-12-28T10:05:54+00:00
URL https://exasol.com/robots.txt
Redirect https://www.exasol.com/robots.txt
Redirect Domain www.exasol.com
Redirect Base exasol.com
Domain IPs 162.159.134.42
Redirect IPs 162.159.134.42
Response IP 162.159.134.42
Found Yes
Hash a5bbc8bfbce9095bcfb2b5bb0f1b4636d1a366eacece5b3491fe6400b8b70ee0
SimHash 490f8852e6b3

Groups

*

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php

*

Rule Path
Disallow

adsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

matchorysearch

Rule Path
Disallow /

datadog

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rss-parser

Rule Path
Disallow /

dow jones searchbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

bot/linkchecker

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

spacecowboys android rss reader

Rule Path
Disallow /

aiohttp

Rule Path
Disallow /

mail[.]ru_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.exasol.com/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top

Warnings

  • 2 invalid lines.
Back to top