avs-part.com
robots.txt

Robots Exclusion Standard data for avs-part.com

Resource Scan

Scan Details

Site Domain avs-part.com
Base Domain avs-part.com
Scan Status Ok
Last Scan2026-01-07T20:54:52+00:00
Next Scan 2026-01-21T20:54:52+00:00

Last Scan

Scanned2026-01-07T20:54:52+00:00
URL https://avs-part.com/robots.txt
Domain IPs 142.44.160.72
Response IP 142.44.160.72
Found Yes
Hash 1db5c7cfff30aeb97e405ea2d8af24c36e3f8270d81815b95ea511021afeb2eb
SimHash 611cca62c3b0

Groups

*

Rule Path
Disallow /api/
Disallow /baza/
Disallow /my/
Disallow /search/
Disallow /s/
Allow /static/js/
Allow /static/css/
Allow /static/templates/
Disallow *?
Allow /sites/*?
Allow /static/*?

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 500

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Warnings

  • `host` is not a known field.