data.aosz.hu
robots.txt

Robots Exclusion Standard data for data.aosz.hu

Resource Scan

Scan Details

Site Domain data.aosz.hu
Base Domain aosz.hu
Scan Status Ok
Last Scan2026-01-28T08:03:28+00:00
Next Scan 2026-02-27T08:03:28+00:00

Last Scan

Scanned2026-01-28T08:03:28+00:00
URL https://data.aosz.hu/robots.txt
Domain IPs 178.238.222.77
Response IP 178.238.222.77
Found Yes
Hash 534a4fbeb2e3373d40f1d89f1f5bae5adb9e4da75853c2011d64309ac828432b
SimHash 606cccb2aa83

Groups

dmca

Rule Path
Disallow /

copyright

Rule Path
Disallow /

lumenapi

Rule Path
Disallow /

lumen

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image
googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://data.aosz.hu/sitemap.xml