ferra.expert
robots.txt
Robots Exclusion Standard data for ferra.expert
Resource Scan
Scan Details
Site Domain | ferra.expert |
Base Domain | ferra.expert |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-09-29T15:43:14+00:00 |
Next Scan | 2024-12-28T15:43:14+00:00 |
Last Successful Scan
Scanned | 2024-03-04T11:03:32+00:00 |
URL | https://ferra.expert/robots.txt |
Domain IPs | 92.63.181.64, 92.63.181.65, 92.63.181.66, 92.63.181.67 |
Response IP | 92.63.181.67 |
Found | Yes |
Hash | 5d83506b1adbd80ee3b6b4adabffa1e6f1a21086ce39242164f5c8b5e50dcf81 |
SimHash | 694128c1f5b1 |
Groups
yandex
Rule | Path |
---|---|
Disallow | /amp/ |
Disallow | /search |
Disallow | /preview/* |
Disallow | */comments |
Disallow | /? |
Disallow | /*%26 |
Disallow | /sentry/* |
Disallow | /for_story_topic/* |
googlebot
Rule | Path |
---|---|
Disallow | /search |
Disallow | /preview/* |
Disallow | /sentry/* |
Disallow | */comments |
Disallow | /for_story_topic/* |
*
Rule | Path |
---|---|
Disallow | /search |
Disallow | /preview/* |
Disallow | /sentry/* |
Disallow | */comments |
Disallow | /for_story_topic/* |
Other Records
Field | Value |
---|---|
sitemap | https://ferra.expert/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.