Log In Sign Up

exist.group
robots.txt

Robots Exclusion Standard data for exist.group

Resource Scan

Scan Details

Site Domain exist.group
Base Domain exist.group
Scan Status Ok
Last Scan2024-09-10T18:55:18+00:00
Next Scan 2024-10-10T18:55:18+00:00

Last Scan

Scanned2024-09-10T18:55:18+00:00
URL http://exist.group/robots.txt
Domain IPs 82.202.190.53
Response IP 82.202.190.53
Found Yes
Hash 595faf71a92c95da67a47c08f4ebe5a2b4d25849e4080577da868a6a6bb6f268
SimHash a1019f63cf93

Groups

*

Rule Path
Allow /Catalog/Accessory/Cars/
Allow /Catalog/Wheels/
Allow /Catalog/Goods/
Allow /Price/
Allow /Api/*
Disallow /Catalog/Goods/*/popup/*
Disallow /catalog/goods/*/popup/*
Disallow /AutoPoints
Disallow /Autopoints
Disallow /autopoints
Disallow /errors/
Disallow /job/
Disallow /Profile/
Disallow /*?SubType*
Disallow /*?MethodType*
Disallow /*?ReturnUrl*
Disallow /*?Year=*
Disallow /tests/
Disallow /?_openstat=
Disallow /WebResource.axd
Disallow /ScriptResource.axd
Disallow /*utm_source
Disallow /*utm_campaign
Disallow /resultr.asp
Disallow /*%26all%3D*
Disallow /*login.php*

yandex

Rule Path
Allow /Catalog/Accessory/Cars/
Allow /Catalog/Wheels/
Allow /Catalog/Goods/
Allow /Price/
Allow /Api/*
Disallow /Catalog/Goods/*/popup/*
Disallow /catalog/goods/*/popup/*
Disallow /AutoPoints
Disallow /Autopoints
Disallow /autopoints
Disallow /errors/
Disallow /job/
Disallow /profile/
Disallow /Profile/
Disallow /*?SubType*
Disallow /*?MethodType*
Disallow /*?ReturnUrl*
Disallow /*?Year=*
Disallow /tests/
Disallow /?_openstat=
Disallow /WebResource.axd
Disallow /ScriptResource.axd
Disallow /resultr.asp
Disallow /*?MethodType
Disallow /*%26all%3D*
Disallow /*login.php*
Back to top

Other Records

Field Value
sitemap https://www.exist.ru/sitemap.axd
sitemap https://www.exist.ru/sitemap.axd
Back to top

Comments

  • https://www.exist.ru
  • Crawl-delay: 1
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top