travel.drom.ru
robots.txt

Robots Exclusion Standard data for travel.drom.ru

Resource Scan

Scan Details

Site Domain travel.drom.ru
Base Domain drom.ru
Scan Status Ok
Last Scan2024-09-20T11:01:10+00:00
Next Scan 2024-10-04T11:01:10+00:00

Last Scan

Scanned2024-09-20T11:01:10+00:00
URL https://travel.drom.ru/robots.txt
Domain IPs 185.65.149.115
Response IP 185.65.149.115
Found Yes
Hash 01c6c13904a038098e2d6a90a43e937a98d83f2c1909459ea0bf6bad27e2d537
SimHash 031ecce2d708

Groups

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

semrushbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

*

Rule Path
Disallow /*_openstat
Disallow /*utm_source
Disallow /profile.php
Disallow /search.php
Disallow /search/
Disallow /clever/
Disallow /yummy/
Disallow /redirect.php
Disallow /myreg.php
Disallow /mypersonal.php
Disallow /captcha/
Disallow /banned.php
Disallow /invoice/*
Disallow /adbanner.php
Disallow /adbannerstat.php

Warnings

  • `host` is not a known field.