freshcodeit.com
robots.txt
Robots Exclusion Standard data for freshcodeit.com
Resource Scan
Scan Details
| Site Domain | freshcodeit.com |
| Base Domain | freshcodeit.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-06T15:05:14+00:00 |
| Next Scan | 2024-11-20T15:05:14+00:00 |
Last Successful Scan
| Scanned | 2024-09-29T14:57:44+00:00 |
| URL | https://freshcodeit.com/robots.txt |
| Redirect | https://www.freshcodeit.com/robots.txt |
| Redirect Domain | www.freshcodeit.com |
| Redirect Base | freshcodeit.com |
| Domain IPs | 75.2.70.75, 99.83.190.102 |
| Redirect IPs | 52.197.0.54, 52.199.221.217, 54.178.223.218 |
| Response IP | 54.178.223.218 |
| Found | Yes |
| Hash | 4ca5b923f4535086868a7243d6525894e57f64a86a91fd620c4e710e17cb26a1 |
| SimHash | e938df73c93c |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /material |
| Disallow | /material/documentation-to-blog |
| Disallow | /material/static-element |
| Disallow | /custom-block-to-blog |
| Disallow | /custom-block-to-blog/one-page |
| Disallow | /custom-block-to-blog/two-page |
| Disallow | /custom-block-to-blog/three-page |
| Disallow | /custom-block-to-blog/news-page |
| Disallow | /custom-block-to-blog/four-page |
| Disallow | /guide-to-blog-2 |
| Disallow | /guide-to-blog-2/guide-to-blog |
| Disallow | /guide-to-blog-2/facts-tips |
| Disallow | /guide-to-blog-2/lists |
| Disallow | /guide-to-blog-2/lead-magnit |
| Disallow | /guide-to-blog-2/quotes |
| Disallow | /test-page |
| Disallow | /test-page/testform |
| Disallow | /test-page/dashboard |
| Disallow | /vacancies |
| Disallow | /contacts2 |
| Disallow | /clojure2 |
| Disallow | /pop-up-phi |
| Disallow | /pop-up-p-l |
| Disallow | /pop-up-mvp-estimation |
| Disallow | /pop-up-health-mvp-estimation |
| Disallow | /pop-up-cross-platform-benefits |
| Disallow | /one-page |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.freshcodeit.com/sitemap.xml |