24skelbimai.lt
robots.txt

Robots Exclusion Standard data for 24skelbimai.lt

Resource Scan

Scan Details

Site Domain 24skelbimai.lt
Base Domain 24skelbimai.lt
Scan Status Ok
Last Scan2024-11-14T12:27:51+00:00
Next Scan 2024-11-21T12:27:51+00:00

Last Scan

Scanned2024-11-14T12:27:51+00:00
URL https://24skelbimai.lt/robots.txt
Domain IPs 178.33.220.207
Response IP 178.33.220.207
Found Yes
Hash efb2cceecd8dea373a0f1aebeef4335dabf3b11961cc97abba2b5ff10429a54b
SimHash 482803f2dab1

Groups

*

Rule Path
Allow /
Disallow
Disallow /cgi-bin/
Disallow /requirements/
Disallow /assets/
Disallow /demos/
Disallow /dev/
Disallow /framework/
Disallow /paieska/

megaindex.ru/2.0

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

ttd-content

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.24skelbimai.lt/sitemap.xml