generator-online.com
robots.txt
Robots Exclusion Standard data for generator-online.com
Resource Scan
Scan Details
| Site Domain | generator-online.com |
| Base Domain | generator-online.com |
| Scan Status | Ok |
| Last Scan | 2025-11-26T01:22:57+00:00 |
| Next Scan | 2025-12-03T01:22:57+00:00 |
Last Scan
| Scanned | 2025-11-26T01:22:57+00:00 |
| URL | https://generator-online.com/robots.txt |
| Domain IPs | 104.21.83.35, 172.67.211.36, 2606:4700:3031::6815:5323, 2606:4700:3035::ac43:d324 |
| Response IP | 172.67.211.36 |
| Found | Yes |
| Hash | c2552a4e0074fc89bf307260ab3168345f3429ac7164a8eafc7520b53f3f546b |
| SimHash | 0d111c762fb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dashboard/ |
| Disallow | /connectors/ |
| Disallow | /api/ |
| Allow | /assets/css/*? |
| Allow | /assets/js/*? |
| Allow | /?page= |
| Disallow | */?fbclid=* |
| Disallow | */*utm%3D* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://generator-online.com/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments