avifoodsystems.com
robots.txt

Robots Exclusion Standard data for avifoodsystems.com

Resource Scan

Scan Details

Site Domain avifoodsystems.com
Base Domain avifoodsystems.com
Scan Status Ok
Last Scan2025-12-23T10:18:09+00:00
Next Scan 2026-01-22T10:18:09+00:00

Last Scan

Scanned2025-12-23T10:18:09+00:00
URL https://avifoodsystems.com/robots.txt
Domain IPs 67.225.198.62
Response IP 67.225.198.62
Found Yes
Hash d4cfb3bdfa26b7db6d3e450fa6e7039414d0de745998b3a2e7e703f7f4e4bee1
SimHash 80585791c3b7

Groups

*

Rule Path
Allow /
Disallow /.php$
Disallow /?*
Disallow /403.html
Disallow /404.html
Disallow /load.php
Disallow /article.php
Disallow /cart/
Disallow /article/

Other Records

Field Value
crawl-delay 60

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

cloudbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60