ferra.expert
robots.txt

Robots Exclusion Standard data for ferra.expert

Resource Scan

Scan Details

Site Domain ferra.expert
Base Domain ferra.expert
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-29T15:43:14+00:00
Next Scan 2024-12-28T15:43:14+00:00

Last Successful Scan

Scanned2024-03-04T11:03:32+00:00
URL https://ferra.expert/robots.txt
Domain IPs 92.63.181.64, 92.63.181.65, 92.63.181.66, 92.63.181.67
Response IP 92.63.181.67
Found Yes
Hash 5d83506b1adbd80ee3b6b4adabffa1e6f1a21086ce39242164f5c8b5e50dcf81
SimHash 694128c1f5b1

Groups

yandex

Rule Path
Disallow /amp/
Disallow /search
Disallow /preview/*
Disallow */comments
Disallow /?
Disallow /*%26
Disallow /sentry/*
Disallow /for_story_topic/*

googlebot

Rule Path
Disallow /search
Disallow /preview/*
Disallow /sentry/*
Disallow */comments
Disallow /for_story_topic/*

*

Rule Path
Disallow /search
Disallow /preview/*
Disallow /sentry/*
Disallow */comments
Disallow /for_story_topic/*

Other Records

Field Value
sitemap https://ferra.expert/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.