brandpedia.ru
robots.txt

Robots Exclusion Standard data for brandpedia.ru

Resource Scan

Scan Details

Site Domain brandpedia.ru
Base Domain brandpedia.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-12T00:30:23+00:00
Next Scan 2024-07-11T00:30:23+00:00

Last Successful Scan

Scanned2023-09-11T13:32:22+00:00
URL https://brandpedia.ru/robots.txt
Redirect https://www.brandpedia.ru/robots.txt
Redirect Domain www.brandpedia.ru
Redirect Base brandpedia.ru
Domain IPs 77.37.138.248
Redirect IPs 77.37.138.248
Response IP 77.37.138.248
Found Yes
Hash 130e0f49d8529aca89d726ebce748a21350372b8430fa9f6ee364d23ecd2d540
SimHash 4b5dcd10ce33

Groups

*

Rule Path
Disallow /admin/
Disallow /blocks/
Disallow /config/
Disallow /function/
Disallow /language/
Disallow /modules/
Disallow /sound/
Disallow /sound/
Disallow *uploads*
Disallow *index.php*
Disallow /*?C=*
Disallow *filter*
Disallow *fact*

psbot

Rule Path
Disallow /

pigafetta

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.brandpedia.ru/sitemap.xml

Warnings

  • `host` is not a known field.