klikdooglasa.com
robots.txt

Robots Exclusion Standard data for klikdooglasa.com

Resource Scan

Scan Details

Site Domain klikdooglasa.com
Base Domain klikdooglasa.com
Scan Status Ok
Last Scan2024-11-14T18:36:25+00:00
Next Scan 2024-11-21T18:36:25+00:00

Last Scan

Scanned2024-11-14T18:36:25+00:00
URL https://klikdooglasa.com/robots.txt
Domain IPs 194.146.59.76
Response IP 194.146.59.76
Found Yes
Hash dc01c3898e16fa86653418a9026cb79512680ab5ebe9da3743a668d988a6f27c
SimHash 89cf5c0ade90

Groups

*

Rule Path
Disallow /moje/
Disallow /calendar/
Disallow /test/
Disallow /oglasi-srbija/olivera-lekovic-15533.html

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

g-i-g-a-b-o-t

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

panscient

Rule Path
Disallow /

coccocbot-web/1.0

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.klikdooglasa.com/sitemap.xml