tuthobby.ru
robots.txt

Robots Exclusion Standard data for tuthobby.ru

Resource Scan

Scan Details

Site Domain tuthobby.ru
Base Domain tuthobby.ru
Scan Status Ok
Last Scan2024-06-16T12:01:04+00:00
Next Scan 2024-06-23T12:01:04+00:00

Last Scan

Scanned2024-06-16T12:01:04+00:00
URL https://tuthobby.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:7:d2f3, 2a00:15f8:a000:5:1:12:7:d2f3, 2a00:15f8:a000:5:1:13:7:d2f3, 2a00:15f8:a000:5:1:14:7:d2f3, 90.156.201.108, 90.156.201.12, 90.156.201.48, 90.156.201.93
Response IP 90.156.201.12
Found Yes
Hash deafbd666f004f70a34e2bae2f69015844e4a1b9eff3ee29f1d895ae19822857
SimHash 6c2882621793

Groups

*

Rule Path
Disallow /recovery/*
Disallow /activation/*
Disallow /update_email/*
Disallow /update_pass/*
Disallow /profile/*
Disallow /img/sx/big/*
Disallow /img/max/*
Disallow /img/sx/small/*
Disallow /sx_file/*
Disallow /reset/*
Disallow /doc/*
Disallow /admin
Disallow /search
Disallow /img/thanks.jpg
Disallow /sx_file/*
Allow /*.jpg
Allow /*.png
Allow /*.gif

Other Records

Field Value
crawl-delay 1

yandex

Rule Path
Disallow /recovery/*
Disallow /activation/*
Disallow /update_email/*
Disallow /update_pass/*
Disallow /profile/*
Disallow /img/sx/big/*
Disallow /img/sx/small/*
Disallow /doc/*
Disallow /admin
Disallow /search
Disallow /img/thanks.jpg
Disallow /img/max/*
Disallow /sx_file/*
Disallow /reset/*
Disallow /unsubscribe/*
Allow /*.jpg
Allow /*.png
Allow /*.gif

Other Records

Field Value
crawl-delay 1

Warnings

  • `host` is not a known field.