alvads.com
robots.txt

Robots Exclusion Standard data for alvads.com

Resource Scan

Scan Details

Site Domain alvads.com
Base Domain alvads.com
Scan Status Ok
Last Scan2024-10-28T06:45:09+00:00
Next Scan 2024-11-27T06:45:09+00:00

Last Scan

Scanned2024-10-28T06:45:09+00:00
URL https://alvads.com/robots.txt
Domain IPs 81.90.182.209
Response IP 81.90.182.209
Found Yes
Hash d31f9fc9d2d1c2e71484886039c5fc3e82bef48f7150e42f2224fea5d00b2705
SimHash 6d809de345a1

Groups

*

Rule Path
Disallow /bitrix/
Disallow /obraztsy-kukhni/
Disallow /cgi-bin/
Disallow /belgro/
Disallow /service/
Disallow *.pdf
Disallow *region*
Disallow /*print*
Disallow /fonts/
Disallow /*first%3D*
Disallow /*month
Disallow /*year
Disallow *PAGEN*

yandex

Rule Path
Disallow /bitrix/
Disallow /obraztsy-kukhni/
Disallow *region*
Disallow /service/
Disallow /*print*
Disallow /fonts/
Disallow /*first%3D*
Disallow /*month
Disallow /*year
Disallow *PAGEN*
Disallow *ORDER_ID%3D*

yandexmedia

Rule Path
Allow /upload/medialibrary/308/308c1adea1d496e86d276c662cb16cfe.mp4

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yandexblogs

Rule Path
Allow /news/

Other Records

Field Value
crawl-delay 100

yandexnews

Rule Path
Allow /news/

Other Records

Field Value
crawl-delay 200

googlebot

Rule Path
Disallow /bitrix/
Disallow /obraztsy-kukhni/
Disallow /service/
Disallow *region*
Disallow /*print*
Disallow /fonts/
Disallow /*first%3D*
Disallow /*month
Disallow /*year
Disallow *PAGEN*

ia_archiver

Rule Path
Disallow /bitrix/
Disallow /obraztsy-kukhni/
Disallow /belgro/
Disallow /service/
Disallow *region*
Disallow /*print*
Disallow /fonts/
Disallow /*first%3D*
Disallow /*month
Disallow /*year
Disallow *PAGEN*
Disallow *.mp4
Disallow *.pdf

Other Records

Field Value
sitemap https://alvads.com/sitemap.xml
sitemap https://alvads.com/sitemap.xml
sitemap https://alvaline.com/sitemap.xml
sitemap https://alvads.com/sitemap.xml
sitemap https://alvads.com/sitemap.xml

Warnings

  • `host` is not a known field.