agl.com
robots.txt
Robots Exclusion Standard data for agl.com
Resource Scan
Scan Details
Site Domain | agl.com |
Base Domain | agl.com |
Scan Status | Ok |
Last Scan | 2024-09-10T12:34:37+00:00 |
Next Scan | 2024-10-10T12:34:37+00:00 |
Last Scan
Scanned | 2024-09-10T12:34:37+00:00 |
URL | https://agl.com/robots.txt |
Redirect | https://www.agl.com:443/robots.txt |
Redirect Domain | www.agl.com |
Redirect Base | agl.com |
Domain IPs | 75.2.67.61, 99.83.232.129 |
Redirect IPs | 15.161.160.219, 18.102.233.248 |
Response IP | 18.102.233.248 |
Found | Yes |
Hash | 0f497a9e1a75989c4c8d1ddcfb5bcc05b68e9b1943016523cbaff6ea463de915 |
SimHash | 224c1441cc72 |
Groups
*
Rule | Path |
---|---|
Disallow | /lib/ |
Disallow | /*.php$ |
Disallow | /pkginfo/ |
Disallow | /report/ |
Disallow | /var/ |
Disallow | /catalog/ |
Disallow | /customer/ |
Disallow | /sendfriend/ |
Disallow | /review/ |
Disallow | /*SID%3D |
Other Records
Field | Value |
---|---|
sitemap | https://www.agl.com/sitemap/de.xml |
sitemap | https://www.agl.com/sitemap/blt.xml |
sitemap | https://www.agl.com/sitemap/eur.xml |
sitemap | https://www.agl.com/sitemap/blc.xml |
sitemap | https://www.agl.com/sitemap/eur_other.xml |
sitemap | https://www.agl.com/sitemap/eur_nord.xml |
sitemap | https://www.agl.com/sitemap/blx.xml |
sitemap | https://www.agl.com/sitemap/row.xml |
sitemap | https://www.agl.com/sitemap/fr.xml |
sitemap | https://www.agl.com/sitemap/csi.xml |
sitemap | https://www.agl.com/sitemap/es.xml |
sitemap | https://www.agl.com/sitemap/ch.xml |
sitemap | https://www.agl.com/sitemap/es.xml |
sitemap | https://www.agl.com/sitemap/ch.xml |
sitemap | https://www.agl.com/sitemap/gbp.xml |
sitemap | https://www.agl.com/sitemap/us.xml |
sitemap | https://www.agl.com/sitemap/hl.xml |
sitemap | https://www.agl.com/sitemap/it.xml |
Warnings
- 2 invalid lines.
Comments