drom.ru
robots.txt

Robots Exclusion Standard data for drom.ru

Resource Scan

Scan Details

Site Domain drom.ru
Base Domain drom.ru
Scan Status Ok
Last Scan2024-09-13T19:31:50+00:00
Next Scan 2024-09-27T19:31:50+00:00

Last Scan

Scanned2024-09-13T19:31:50+00:00
URL https://drom.ru/robots.txt
Redirect https://www.drom.ru/robots.txt
Redirect Domain www.drom.ru
Redirect Base drom.ru
Domain IPs 185.65.149.115
Redirect IPs 185.65.149.115
Response IP 185.65.149.115
Found Yes
Hash 6f93e1f430fa6a167b3a9e11cc9b6f0adecc6c35151208fa7e65910cd9e00221
SimHash 037efcc08131

Groups

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

semrushbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

*

Rule Path
Disallow /*_openstat
Disallow /*utm_source
Disallow /profile.php
Disallow /search.php
Disallow /search/
Disallow /clever/
Disallow /yummy/
Disallow /redirect.php
Disallow /mypersonal.php
Disallow /captcha/
Disallow /banned.php
Disallow /invoice/*
Disallow /adbanner.php
Disallow /adbannerstat.php
Disallow /myreg.php
Disallow /misc/million/
Disallow /reviews/draft/
Disallow /reviews/ajax_io.php
Disallow /shina/ajax_io.php
Disallow /report/
Disallow /credit/
Disallow /s/
Disallow /*comment_id%3D
Disallow /poll_details.php
Disallow /faq/*page
Disallow /misc/comments/webview/

Other Records

Field Value
sitemap https://www.drom.ru/sitemaps/catalog/generated/catalog_firms_index.xml
sitemap https://www.drom.ru/sitemaps/catalog/generated/catalog_models_index.xml
sitemap https://www.drom.ru/sitemaps/catalog/generated/catalog_generations_index.xml
sitemap https://www.drom.ru/sitemaps/catalog/generated/catalog_complectations_index.xml
sitemap https://www.drom.ru/sitemaps/catalog/generated/catalog_model_summary_specs_index.xml
sitemap https://www.drom.ru/sitemaps/catalog/generated/catalog_firm_engines_index.xml
sitemap https://www.drom.ru/sitemaps/catalog/generated/catalog_firm_engine_index.xml
sitemap https://www.drom.ru/sitemaps/catalog/generated/catalog_models_years_index.xml
sitemap https://www.drom.ru/sitemaps/reviews/generated/reviews_index.xml
sitemap https://www.drom.ru/sitemaps/reviews/generated/reviews_updates_index.xml
sitemap https://www.drom.ru/sitemaps/reviews/generated/reviews_years_index.xml
sitemap https://www.drom.ru/sitemaps/reviews/generated/reviews_firms_index.xml
sitemap https://www.drom.ru/sitemaps/reviews/generated/reviews_models_index.xml
sitemap https://www.drom.ru/sitemaps/shina/generated/shina_firms_index.xml
sitemap https://www.drom.ru/sitemaps/shina/generated/shina_firms_seasons_index.xml
sitemap https://www.drom.ru/sitemaps/shina/generated/shina_firms_sizes_seasons_index.xml
sitemap https://www.drom.ru/sitemaps/shina/generated/shina_model_photos_index.xml
sitemap https://www.drom.ru/sitemaps/shina/generated/shina_models_index.xml
sitemap https://www.drom.ru/sitemaps/shina/generated/shina_sizes_seasons_index.xml
sitemap https://www.drom.ru/sitemaps/compare/generated/compare_index.xml
sitemap https://www.drom.ru/sitemaps/info/generated/info_firms_index.xml
sitemap https://www.drom.ru/sitemaps/info/generated/info_models_index.xml

Warnings

  • `host` is not a known field.