apet.by
robots.txt

Robots Exclusion Standard data for apet.by

Resource Scan

Scan Details

Site Domain apet.by
Base Domain apet.by
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2026-02-11T06:49:38+00:00
Next Scan 2026-04-12T06:49:38+00:00

Last Successful Scan

Scanned2025-12-13T02:03:37+00:00
URL https://apet.by/robots.txt
Domain IPs 178.159.240.31
Response IP 178.159.240.31
Found Yes
Hash 3d5ee0a1b7529031b34f7364757d8adc8cd19e7bbac154e7d92c0760a1dc11c1
SimHash 2b1d45e1aa11

Groups

*

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Disallow */*?
Disallow *%26*
Disallow /login
Disallow /post-an-ad
Disallow /register
Disallow */profile/*
Disallow */uslugi/tag/*
Disallow */uslugi/8
Disallow /cat/407
Disallow /cat/418
Disallow */wp/*
Disallow */admin/*
Disallow */cat/cat/*
Disallow */feed/*
Disallow /cat/232
Disallow /cat/552
Disallow /cat/882
Disallow /cat/979
Disallow /cat/ad/623/1451
Disallow /cat/ad/623/1730
Disallow */goto/*
Disallow */page/*
Disallow /component/users/

seekportbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://apet.by/sitemap.xml