alexsf.ru
robots.txt

Robots Exclusion Standard data for alexsf.ru

Resource Scan

Scan Details

Site Domain alexsf.ru
Base Domain alexsf.ru
Scan Status Ok
Last Scan2024-09-20T03:50:21+00:00
Next Scan 2024-10-20T03:50:21+00:00

Last Scan

Scanned2024-09-20T03:50:21+00:00
URL https://alexsf.ru/robots.txt
Domain IPs 45.130.41.121
Response IP 45.130.41.121
Found Yes
Hash 4c9f809f669492a4cac4471ff8c27acb2eeabc994e9b84dd249c4858dc0e3d3c
SimHash 21626af25712

Groups

*

Rule Path
Allow /*sitemap
Allow /*media
Allow /*forum
Allow /*arcade
Allow /*rss
Allow /Themes/*png
Allow /Themes/*gif
Allow /*action%3Dforum
Allow /Themes/*.css
Allow /Themes/*.js
Disallow /attachments/
Disallow /avatars/
Disallow /Packages/
Disallow /Smileys/
Disallow /Sources/
Disallow /Games/
Disallow /*.msg
Disallow /*.new
Disallow /*sort
Disallow /*topicseen
Disallow /*wap
Disallow /*imode
Disallow /*action
Disallow /*action%3Dgo
Disallow /*prev_next
Disallow /*all

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

mediapartners-google

Rule Path
Allow /*

googlebot-mobile
yandeximageresizer

Rule Path
Allow /*wap
Allow /*imode
Disallow /

yandeximageresizer

Rule Path
Allow /*wap
Allow /*imode
Disallow /

yadirectbot

Rule Path
Disallow

yandexdirect

Rule Path
Disallow

Other Records

Field Value
sitemap https://alexsf.ru/sitemap.xml

Warnings

  • `host` is not a known field.