astratex.cz
robots.txt

Robots Exclusion Standard data for astratex.cz

Resource Scan

Scan Details

Site Domain astratex.cz
Base Domain astratex.cz
Scan Status Ok
Last Scan2024-09-26T23:33:32+00:00
Next Scan 2024-10-26T23:33:32+00:00

Last Scan

Scanned2024-09-26T23:33:32+00:00
URL https://astratex.cz/robots.txt
Redirect https://www.astratex.cz/robots.txt
Redirect Domain www.astratex.cz
Redirect Base astratex.cz
Domain IPs 89.185.252.236
Redirect IPs 89.185.252.236
Response IP 89.185.252.236
Found Yes
Hash be26a86cce2295a0ba5794433dac33aa2785f7e052b02545aa546adbb709fa5d
SimHash 6f0c1875a39a

Groups

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

*

Rule Path
Disallow /*sort%3Dlow
Disallow /*sort%3Dhigh
Disallow /*sort%3Ddate
Disallow /*sort%3Dtopsale
Disallow /*sort%3Ddefault
Disallow /*last%3D
Disallow /nejcastejsi-dotazy-test/
Disallow /vdp/
Disallow /ajax/
Disallow /services/
Disallow /api/1/
Disallow /pages/

Other Records

Field Value
sitemap https://www.astratex.cz/sitemap_wwwastratexcz.xml