fastcompany.com
robots.txt
Robots Exclusion Standard data for fastcompany.com
Resource Scan
Scan Details
| Site Domain | fastcompany.com |
| Base Domain | fastcompany.com |
| Scan Status | Ok |
| Last Scan | 2024-04-30T23:01:40+00:00 |
| Next Scan | 2024-05-07T23:01:40+00:00 |
Last Scan
| Scanned | 2024-04-30T23:01:40+00:00 |
| URL | https://fastcompany.com/robots.txt |
| Redirect | https://www.fastcompany.com/robots.txt |
| Redirect Domain | www.fastcompany.com |
| Redirect Base | fastcompany.com |
| Domain IPs | 151.101.1.54, 151.101.129.54, 151.101.193.54, 151.101.65.54 |
| Redirect IPs | 151.101.1.54, 151.101.129.54, 151.101.193.54, 151.101.65.54 |
| Response IP | 199.232.45.54 |
| Found | Yes |
| Hash | 5d50b1abc886c46497fae7a3c59883321d53f172a0be13553b6a0630bdbf3b4f |
| SimHash | e9bd81e6c7ff |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /multisite_files/fastcompany/imagecache/ |
| Disallow | /admin/ |
| Disallow | /4160/ |
| Disallow | /bookclub/ |
| Disallow | /search/ |
| Disallow | /search* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.fastcompany.com/sitemap.xml |
| sitemap | https://www.fastcompany.com/sitemap-video.xml |
| sitemap | https://www.fastcompany.com/googlenews.xml |
Comments