agg.com
robots.txt

Robots Exclusion Standard data for agg.com

Resource Scan

Scan Details

Site Domain agg.com
Base Domain agg.com
Scan Status Ok
Last Scan2025-09-17T14:29:27+00:00
Next Scan 2025-10-17T14:29:27+00:00

Last Scan

Scanned2025-09-17T14:29:27+00:00
URL https://agg.com/robots.txt
Redirect https://www.agg.com/robots.txt
Redirect Domain www.agg.com
Redirect Base agg.com
Domain IPs 68.220.41.122
Redirect IPs 104.18.32.2, 172.64.155.254
Response IP 172.64.155.254
Found Yes
Hash b5814a7865b9bec8552b1640b63f65d9604e4423c85a6850903f0eff387b5870
SimHash a9095c048e92

Groups

*

Rule Path
Disallow /api/
Disallow /pdf/

Other Records

Field Value
sitemap https://www.agg.com/sitemap.xml