flexdog.com
robots.txt
Robots Exclusion Standard data for flexdog.com
Resource Scan
Scan Details
| Site Domain | flexdog.com |
| Base Domain | flexdog.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-03-19T12:35:53+00:00 |
| Next Scan | 2025-06-17T12:35:53+00:00 |
Last Successful Scan
| Scanned | 2024-05-01T03:42:12+00:00 |
| URL | https://flexdog.com/robots.txt |
| Redirect | https://www.flexdog.com/robots.txt |
| Redirect Domain | www.flexdog.com |
| Redirect Base | flexdog.com |
| Domain IPs | 104.21.91.192, 172.67.178.94, 2606:4700:3034::6815:5bc0, 2606:4700:3036::ac43:b25e |
| Redirect IPs | 104.21.91.192, 172.67.178.94, 2606:4700:3034::6815:5bc0, 2606:4700:3036::ac43:b25e |
| Response IP | 172.67.178.94 |
| Found | Yes |
| Hash | 8d5b20a69e608b1bb9cc135576fdf772b410d9b154946432695f64f46d27f8fd |
| SimHash | 6d99dd4420d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?search_form* |
| Disallow | /*/*/*/*/* |
| Disallow | /*?sort |
| Disallow | /lan-* |
| Disallow | /collection/*/* |
| Disallow | /releases/*/* |
| Disallow | /all-products/* |
| Disallow | /test-next-js |
| Disallow | /login |
| Disallow | /login-social |
| Disallow | /register |
| Disallow | /lost-password |
| Disallow | /reset-password/* |
| Disallow | /js/* |
| Disallow | /giveaway/product |
| Disallow | /giveaway/product/* |
| Disallow | /click?* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.flexdog.com/sitemap/main_sitemap.xml |