webpagefx.com
robots.txt
Robots Exclusion Standard data for webpagefx.com
Resource Scan
Scan Details
| Site Domain | webpagefx.com |
| Base Domain | webpagefx.com |
| Scan Status | Ok |
| Last Scan | 2025-07-29T08:34:42+00:00 |
| Next Scan | 2025-08-28T08:34:42+00:00 |
Last Scan
| Scanned | 2025-07-29T08:34:42+00:00 |
| URL | https://webpagefx.com/robots.txt |
| Redirect | https://www.webfx.com/robots.txt |
| Redirect Domain | www.webfx.com |
| Redirect Base | webfx.com |
| Domain IPs | 104.18.4.142, 104.18.5.142, 2606:4700::6812:48e, 2606:4700::6812:58e |
| Redirect IPs | 104.18.24.124, 104.18.25.124, 2606:4700::6812:187c, 2606:4700::6812:197c |
| Response IP | 104.18.24.124 |
| Found | Yes |
| Hash | 8b1c5af442b101723273fc607faac7c42d14187d1d66a23ba9ad9583c9322131 |
| SimHash | 822cf8704f22 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /referral/ |
| Disallow | /old/ |
| Disallow | /PDF/ |
| Disallow | /PPT/ |
| Disallow | /mobile/ |
| Disallow | /jobs/ |
| Disallow | /tools/read-able/check.php* |
| Disallow | /lp/ |
| Disallow | /new-templates/ |
| Disallow | /fx-testimonials/ |
| Disallow | /clientpoint/ |
| Disallow | /wp-admin/ |
| Disallow | /testimonial/ |
| Disallow | /case-studies/ |
| Disallow | /stats/ |
| Disallow | /style/ |
| Disallow | /*?action=fx_tracking_data |
| Disallow | /wp-list-pages-by-q-schema.php |
| Disallow | /wp-list-pages-by-q.php |
| Disallow | /wp-list-pages-by-cta-id.php |
| Allow | /wp-admin/admin-ajax.php |
Warnings
- `noindex` is not a known field.