minima.pet
robots.txt

Robots Exclusion Standard data for minima.pet

Resource Scan

Scan Details

Site Domain minima.pet
Base Domain minima.pet
Scan Status Ok
Last Scan2025-11-28T01:25:35+00:00
Next Scan 2025-12-05T01:25:35+00:00

Last Scan

Scanned2025-11-28T01:25:35+00:00
URL https://minima.pet/robots.txt
Domain IPs 13.215.239.219, 52.74.6.109
Response IP 52.74.6.109
Found Yes
Hash 7f791bae77ce2b3d2cd75f12feaef3c55edb045455aeda07bd4b5aecc24b6c5f
SimHash 43085c72e333

Groups

*

Rule Path
Allow /
Allow /articles/
Allow /categories/
Allow /writers/
Allow /about/
Disallow /private/
Disallow /api/
Disallow /*.json$
Disallow /error
Disallow /*?*
Disallow /draft

Other Records

Field Value
crawl-delay 1

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://minima.pet/sitemap.xml

Warnings

  • `host` is not a known field.