Log In Sign Up

catfishes.ru
robots.txt

Robots Exclusion Standard data for catfishes.ru

Resource Scan

Scan Details

Site Domain catfishes.ru
Base Domain catfishes.ru
Scan Status Ok
Last Scan2024-11-08T05:07:27+00:00
Next Scan 2024-11-15T05:07:27+00:00

Last Scan

Scanned2024-11-08T05:07:27+00:00
URL https://catfishes.ru/robots.txt
Domain IPs 91.201.52.251
Response IP 91.201.52.251
Found Yes
Hash c6f0487b5bb6312cbea867d72983d2625992bb8e340b09494766291f5392b2d2
SimHash 1b1cfc40cc1b

Groups

yandex

Rule Path
Disallow /*captcha*

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://catfishes.ru/sitemap_index.xml
Back to top