constructionbusinessreview.com
robots.txt
Robots Exclusion Standard data for constructionbusinessreview.com
Resource Scan
Scan Details
| Site Domain | constructionbusinessreview.com |
| Base Domain | constructionbusinessreview.com |
| Scan Status | Ok |
| Last Scan | 2024-11-05T13:38:00+00:00 |
| Next Scan | 2024-11-12T13:38:00+00:00 |
Last Scan
| Scanned | 2024-11-05T13:38:00+00:00 |
| URL | https://constructionbusinessreview.com/robots.txt |
| Redirect | https://www.constructionbusinessreview.com/robots.txt |
| Redirect Domain | www.constructionbusinessreview.com |
| Redirect Base | constructionbusinessreview.com |
| Domain IPs | 52.43.81.61 |
| Redirect IPs | 52.43.81.61 |
| Response IP | 52.43.81.61 |
| Found | Yes |
| Hash | 4192b35de49683c23868103bead01e3affc53d866b5c05555cc3ac9f3aa6cd53 |
| SimHash | 7904fed3c799 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | / | Disallow all bots by default |
| Disallow | /scripts/ | - |
| Disallow | /*.php$ | - |
| Disallow | /zlib/ | - |
| Disallow | /lib/ | - |
| Disallow | /utils/ | - |
| Disallow | /magazine/ | - |
| Disallow | /admin/ | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.constructionbusinessreview.com/constructionbusinessreview_news_sitemap.xml |
| sitemap | https://www.constructionbusinessreview.com/constructionbusinessreview_newsnew_sitemap.xml |
| sitemap | https://www.constructionbusinessreview.com/all_in_one_sitemap_main.xml |
| sitemap | https://www.constructionbusinessreview.com/contributors_sitemap.xml |
Comments