Log In Sign Up

webami.aent.com
robots.txt

Robots Exclusion Standard data for webami.aent.com

Resource Scan

Scan Details

Site Domain webami.aent.com
Base Domain aent.com
Scan Status Ok
Last Scan2025-08-30T13:07:01+00:00
Next Scan 2025-09-29T13:07:01+00:00

Last Scan

Scanned2025-08-30T13:07:01+00:00
URL https://webami.aent.com/robots.txt
Domain IPs 192.12.55.47
Response IP 192.12.55.47
Found Yes
Hash 1ae3142f33cfee1701550318cda7224028c4a1f0a011620d504812fddad1ca7e
SimHash 2a1dc9038ff5

Groups

*

Rule Path
Disallow /search?
Disallow /
Back to top

Comments

  • Robots are not welcome here (Robots.default.txt - disallow all bots)
  • This is a file retrieved by webwalkers a.k.a. spiders that
  • conform to a defacto standard.
  • See <URL:http://www.robotstxt.org/wc/exclusion.html#robotstxt>
  • Format is:
  • User-agent: <name of spider>
  • Disallow: <nothing> | <path>
  • -----------------------------------------------------------------------------
  • Allow none
Back to top