Log In Sign Up

ceno.lv
robots.txt

Robots Exclusion Standard data for ceno.lv

Resource Scan

Scan Details

Site Domain ceno.lv
Base Domain ceno.lv
Scan Status Ok
Last Scan2024-09-25T11:37:11+00:00
Next Scan 2024-10-02T11:37:11+00:00

Last Scan

Scanned2024-09-25T11:37:11+00:00
URL https://ceno.lv/robots.txt
Domain IPs 104.21.45.130, 172.67.214.162, 2606:4700:3032::ac43:d6a2, 2606:4700:3037::6815:2d82
Response IP 104.21.45.130
Found Yes
Hash ffcf9a40fe8e4e4beb790829b4bf93d364e1d4f9f1d42e64aadf758055e3a502
SimHash 4e1d5c12c210

Groups

*

Rule Path
Disallow /out/

Other Records

Field Value
crawl-delay 2

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://ceno.lv/sitemap.xml
Back to top