flexsalary.com
robots.txt
Robots Exclusion Standard data for flexsalary.com
Resource Scan
Scan Details
| Site Domain | flexsalary.com |
| Base Domain | flexsalary.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-28T18:23:23+00:00 |
| Next Scan | 2024-11-26T18:23:23+00:00 |
Last Successful Scan
| Scanned | 2023-07-29T17:43:22+00:00 |
| URL | https://flexsalary.com/robots.txt |
| Redirect | https://www.flexsalary.com/robots.txt |
| Redirect Domain | www.flexsalary.com |
| Redirect Base | flexsalary.com |
| Domain IPs | 104.26.10.250, 104.26.11.250, 172.67.68.105, 2606:4700:20::681a:afa, 2606:4700:20::681a:bfa, 2606:4700:20::ac43:4469 |
| Redirect IPs | 104.26.10.250, 104.26.11.250, 172.67.68.105, 2606:4700:20::681a:afa, 2606:4700:20::681a:bfa, 2606:4700:20::ac43:4469 |
| Response IP | 104.26.10.250 |
| Found | Yes |
| Hash | 75e100547b8e931d4c5d058de805d2e17efb160cd6e91ef88ff4488cf2b93d80 |
| SimHash | 612cb9644ff3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /blog/wp-admin/* |
| Disallow | /blog/wp-content/* |
| Disallow | /PPC/* |
| Disallow | /qa/* |
| Disallow | /mobileapp.php |
| Disallow | /thank-you.php |
| Disallow | /bootstrap/* |
| Disallow | /FS_files/* |
| Disallow | /bootstrap/ |
| Disallow | /FS_files/ |
| Disallow | *cash.flexsalary.com/* |
| Disallow | /?CampaignID=* |
| Disallow | /*/?* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.flexsalary.com/sitemap.xml |