dobraknjiga.rs
robots.txt

Robots Exclusion Standard data for dobraknjiga.rs

Resource Scan

Scan Details

Site Domain dobraknjiga.rs
Base Domain dobraknjiga.rs
Scan Status Ok
Last Scan2024-09-14T14:00:54+00:00
Next Scan 2024-10-14T14:00:54+00:00

Last Scan

Scanned2024-09-14T14:00:54+00:00
URL https://www.dobraknjiga.rs/robots.txt
Domain IPs 104.21.40.19, 172.67.174.131, 2606:4700:3031::ac43:ae83, 2606:4700:3037::6815:2813
Response IP 172.67.174.131
Found Yes
Hash 221dffc6d919aad6b82f2c7e83a232014365df30bb6a4b2d0e3ff1e30f26c799
SimHash 9a9e5d485eb0

Groups

*

Rule Path
Disallow /admin/
Disallow /*?filter=*
Disallow /*?view=*
Disallow /home.asp
Disallow /Home.asp
Disallow /sr/pretraga/

Other Records

Field Value
crawl-delay 120

mj12bot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

worldwebheritage.org

Rule Path
Disallow /

worldwebheritage.org/1.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

Comments

  • robots.txt file - contact webmaster@kabi.si for information