andreicerbu.com
robots.txt

Robots Exclusion Standard data for andreicerbu.com

Resource Scan

Scan Details

Site Domain andreicerbu.com
Base Domain andreicerbu.com
Scan Status Ok
Last Scan2025-06-20T15:39:53+00:00
Next Scan 2025-06-27T15:39:53+00:00

Last Scan

Scanned2025-06-20T15:39:53+00:00
URL https://andreicerbu.com/robots.txt
Domain IPs 104.21.47.10, 172.67.169.174, 2606:4700:3035::ac43:a9ae, 2606:4700:3037::6815:2f0a
Response IP 104.21.47.10
Found Yes
Hash 8d648b7566424150e3fc250315db36c3191841d71f1cf7cc332cec5b1c84b0bd
SimHash 482dcd0e9517

Groups

*

Rule Path
Disallow /api/
Allow /
Allow /collections
Allow /product/
Allow /cart
Allow /contact
Allow /terms-of-service
Allow /success

Other Records

Field Value
sitemap https://andreicerbu.com/sitemap.xml

Comments

  • Disallow API and any private backend paths
  • Allow public-facing pages
  • Sitemap helps bots find all valid pages