gruzoviki.com
robots.txt

Robots Exclusion Standard data for gruzoviki.com

Resource Scan

Scan Details

Site Domain gruzoviki.com
Base Domain gruzoviki.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-04-08T20:01:30+00:00
Next Scan 2024-07-07T20:01:30+00:00

Last Successful Scan

Scanned2022-06-22T16:36:08+00:00
URL http://gruzoviki.com/robots.txt
Response IP 148.251.232.242
Found Yes
Hash 9d2237c6f5ad71f0cb8fa769c610e38a525687f236736878311abb0b454597f3
SimHash ebae96726799

Groups

*

Rule Path
Disallow /go.asp
Disallow /log.asp
Disallow /forum/forum_members.asp
Disallow /forum/pop_up_profile.asp
Disallow /forum/search_form.asp
Disallow /forum/search.asp
Disallow /forum/pm_buddy_list.asp
Disallow /forum/pm_welcome.asp
Disallow /forum/pm_inbox.asp
Disallow /forum/pm_new_message_form.asp
Disallow /forum/profile_edit.asp
Disallow /forum/pm_welcome.asp
Disallow /ad_01.html
Disallow /rd/

sputnikbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

halebot

Rule Path
Disallow /