fx5.ru
robots.txt

Robots Exclusion Standard data for fx5.ru

Resource Scan

Scan Details

Site Domain fx5.ru
Base Domain fx5.ru
Scan Status Ok
Last Scan2024-10-21T15:16:58+00:00
Next Scan 2024-11-20T15:16:58+00:00

Last Scan

Scanned2024-10-21T15:16:58+00:00
URL https://fx5.ru/robots.txt
Domain IPs 198.23.223.142
Response IP 198.23.223.142
Found Yes
Hash f204af2b8765dd80ec3d4eb4b1fb89fe79108d2d645c787498dcdc158a218cc9
SimHash 4e44d8229282

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/
Disallow /away/
Disallow /tag/
Disallow /pic/
Disallow /go.php
Disallow /go.php?*
Disallow /img/
Disallow /fx/img/
Disallow *.JPG
Disallow *.jpg
Disallow *.jpeg
Disallow *.png
Disallow *.gif
Disallow *.webp

yandex/1.01.001 (compatible; win16; p)

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

Comments

  • NL

Warnings

  • `host` is not a known field.