auto.drom.ru
robots.txt

Robots Exclusion Standard data for auto.drom.ru

Resource Scan

Scan Details

Site Domain auto.drom.ru
Base Domain drom.ru
Scan Status Ok
Last Scan2024-05-23T20:27:57+00:00
Next Scan 2024-06-06T20:27:57+00:00

Last Scan

Scanned2024-05-23T20:27:57+00:00
URL https://auto.drom.ru/robots.txt
Domain IPs 109.238.90.80
Response IP 109.238.90.80
Found Yes
Hash 041f69b4bf871fe1e9f6eb9137802e0ab27c67a1b11b580ba8363d1a2175090b
SimHash 18128cd39f90

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

*

Rule Path
Disallow /*_openstat
Disallow /*utm_source
Disallow */used/page*
Disallow */new/page*
Disallow */bez-probega/page*
Disallow */used/all/page*
Disallow */new/all/page*
Disallow */bez-probega/all/page*
Disallow /profile.php
Disallow /search.php
Disallow /search/
Disallow /search_extended/
Disallow /clever/
Disallow /credit/
Disallow /yummy/
Disallow /redirect.php
Disallow /redir.php
Disallow /complains.php
Disallow /mybull.php
Disallow /promote/
Disallow /adaperio_report.php
Disallow /statistic/
Disallow /*cid*cid*
Disallow /*rid*rid*
Disallow /*rid*cid*
Disallow /*cid*rid*

Other Records

Field Value
sitemap https://auto.drom.ru/sitemap/generated/sales_auto_index.xml
sitemap https://auto.drom.ru/sitemap/generated/sales_regions_index.xml
sitemap https://auto.drom.ru/sitemap/spec/generated/sales_regions_index.xml
sitemap https://auto.drom.ru/sitemap/spec/generated/sales_index.xml

Warnings

  • `host` is not a known field.