f1report.ru
robots.txt

Robots Exclusion Standard data for f1report.ru

Resource Scan

Scan Details

Site Domain f1report.ru
Base Domain f1report.ru
Scan Status Ok
Last Scan2024-09-19T04:43:34+00:00
Next Scan 2024-09-26T04:43:34+00:00

Last Scan

Scanned2024-09-19T04:43:34+00:00
URL https://f1report.ru/robots.txt
Domain IPs 77.222.54.151
Response IP 77.222.54.151
Found Yes
Hash ee2bad5e8ae3ad79a38a697a3a19937d1b032941192d508ba8362ebb95cab0fd
SimHash 6b10cc7243b5

Groups

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

msnbot/bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

bingbot/2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /subscribe/
Disallow /admin/
Disallow /index.php?id=mybase_gr&*

Other Records

Field Value
sitemap https://f1report/sitemaps/sitemap-main.xml
sitemap https://f1report/sitemaps/sitemap-news.xml
sitemap https://f1report/sitemaps/sitemap-drivers.xml
sitemap https://f1report/sitemaps/sitemap-teams.xml
sitemap https://f1report/sitemaps/sitemap-granpri.xml
sitemap https://f1report.ru/sitemaps/sitemap-stat.xml

Warnings

  • `host` is not a known field.