soapboxie.com
robots.txt
Robots Exclusion Standard data for soapboxie.com
Resource Scan
Scan Details
| Site Domain | soapboxie.com |
| Base Domain | soapboxie.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-09T17:37:42+00:00 |
| Next Scan | 2025-01-08T17:37:42+00:00 |
Last Successful Scan
| Scanned | 2024-07-13T17:36:22+00:00 |
| URL | https://soapboxie.com/robots.txt |
| Domain IPs | 151.101.130.98, 151.101.194.98, 151.101.2.98, 151.101.66.98 |
| Response IP | 151.101.130.98 |
| Found | Yes |
| Hash | e5486b905054198b87973cdabab28347af953ece81cbf0404b72c5933b6912af |
| SimHash | 4804141d8b92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /.preview/ |
| Disallow | /.context-results |
| Disallow | /.applenews/ |
| Disallow | /*/gdprStatus |
| Disallow | /*/js/sourcepoint |
| Disallow | /*/88059007 |
| Disallow | /nfl/ |
| Disallow | /1027454/ |
| Disallow | /.config.js* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://soapboxie.com/sitemaps.xml |
Comments