maxapro.hu
robots.txt

Robots Exclusion Standard data for maxapro.hu

Resource Scan

Scan Details

Site Domain maxapro.hu
Base Domain maxapro.hu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-27T16:35:20+00:00
Next Scan 2026-03-27T16:35:20+00:00

Last Successful Scan

Scanned2025-03-02T21:31:17+00:00
URL https://maxapro.hu/robots.txt
Domain IPs 13.35.202.12, 13.35.202.30, 13.35.202.52, 13.35.202.82
Response IP 13.35.202.30
Found Yes
Hash ae1b19fb5f5b3df86a367c2a37aadfbde88cc856774afbbf358f0dee56491e9a
SimHash 0256d0306a4b

Groups

*

Rule Path
Disallow /en/
Disallow /hu/

yadirectbot

Rule Path
Disallow

voilabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Disallow /

foobar

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

baidu

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /