payscale.com
robots.txt
Robots Exclusion Standard data for payscale.com
Resource Scan
Scan Details
| Site Domain | payscale.com |
| Base Domain | payscale.com |
| Scan Status | Ok |
| Last Scan | 2025-11-28T03:52:17+00:00 |
| Next Scan | 2025-12-05T03:52:17+00:00 |
Last Scan
| Scanned | 2025-11-28T03:52:17+00:00 |
| URL | https://payscale.com/robots.txt |
| Redirect | https://www.payscale.com/robots.txt |
| Redirect Domain | www.payscale.com |
| Redirect Base | payscale.com |
| Domain IPs | 192.5.11.10 |
| Redirect IPs | 13.35.37.123, 13.35.37.39, 13.35.37.56, 13.35.37.79 |
| Response IP | 13.35.37.56 |
| Found | Yes |
| Hash | e0fee490f3db0d33e01c30027b1b763792240d82b8b13e6677bbd72c2e61cab3 |
| SimHash | 6d34ff52c575 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /research/IN | - |
| Disallow | /wizards/ | - |
| Disallow | /services/ | - |
| Disallow | /embed/ | - |
| Disallow | /cmClearEventCookies.aspx | - |
| Disallow | /af/ | - |
| Disallow | /edu.aspx | - |
| Disallow | /embedchart.aspx | - |
| Disallow | /rcsearch.aspx | - |
| Disallow | /OAuth.aspx | - |
| Disallow | /1063747/* | google crawler misinterprets ad codes in script as urls. |
| Disallow | /privacy.aspx | - |
| Disallow | /license | - |
| Disallow | /PSPV2_Privacy | - |
| Disallow | /PSPV2_License_Agreement_Text | - |
| Disallow | /redir.aspx | - |
| Disallow | /hr/startwizard | - |
| Disallow | /startwizard.asp | - |
| Disallow | /startwizard.aspx | - |
| Disallow | /*/Job-Listings | - |
| Disallow | /Job-Listings | - |
| Disallow | /by_Job | - |
| Disallow | /content/ebook/* | - |
| Disallow | /content/report/* | - |
| Disallow | /content/whitepaper/* | - |
| Disallow | /content/crew/* | - |
| Disallow | /content/compference/* | - |
| Disallow | /content/customer-resources/* | - |
| Disallow | /content/data-product/* | - |
| Disallow | /content/legal/* | - |
| Disallow | /content/cab/* | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.payscale.com/sitemap-webflow.xml |
| sitemap | https://www.payscale.com/sitemap-research-index.xml |