shortlinkscan.com
robots.txt
Robots Exclusion Standard data for shortlinkscan.com
Resource Scan
Scan Details
| Site Domain | shortlinkscan.com |
| Base Domain | shortlinkscan.com |
| Scan Status | Ok |
| Last Scan | 2026-01-20T11:38:55+00:00 |
| Next Scan | 2026-01-27T11:38:55+00:00 |
Last Scan
| Scanned | 2026-01-20T11:38:55+00:00 |
| URL | https://shortlinkscan.com/robots.txt |
| Domain IPs | 104.21.56.58, 172.67.178.196, 2606:4700:3031::6815:383a, 2606:4700:3032::ac43:b2c4 |
| Response IP | 104.21.56.58 |
| Found | Yes |
| Hash | b35f128e799bd4e53350667ed4f73d61a322033f79702b4caba21d4d252c14a8 |
| SimHash | 29181666a120 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /blog/ |
| Allow | /about |
| Allow | /contact |
| Allow | /privacy-policy |
| Allow | /terms |
| Disallow | /admin/ |
| Disallow | /includes/ |
| Disallow | /config/ |
| Disallow | /migrations/ |
| Disallow | /vendor/ |
| Disallow | /assets/css/ |
| Disallow | /assets/js/ |
| Disallow | /.git/ |
| Disallow | /.env |
| Disallow | /composer.json |
| Disallow | /composer.lock |
| Disallow | /README.md |
| Disallow | /blog?page= |
| Disallow | /*?* |
| Allow | /uploads/ |
| Allow | /*.jpg$ |
| Allow | /*.jpeg$ |
| Allow | /*.png$ |
| Allow | /*.gif$ |
| Allow | /*.svg$ |
| Allow | /*.webp$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://shortlinkscan.com/sitemap.xml |
Comments