constructiontechreview.com
robots.txt
Robots Exclusion Standard data for constructiontechreview.com
Resource Scan
Scan Details
| Site Domain | constructiontechreview.com |
| Base Domain | constructiontechreview.com |
| Scan Status | Ok |
| Last Scan | 2024-11-02T23:49:17+00:00 |
| Next Scan | 2024-11-09T23:49:17+00:00 |
Last Scan
| Scanned | 2024-11-02T23:49:17+00:00 |
| URL | https://constructiontechreview.com/robots.txt |
| Redirect | https://www.constructiontechreview.com/robots.txt |
| Redirect Domain | www.constructiontechreview.com |
| Redirect Base | constructiontechreview.com |
| Domain IPs | 54.71.35.46 |
| Redirect IPs | 54.71.35.46 |
| Response IP | 54.71.35.46 |
| Found | Yes |
| Hash | de70828fb19a7fd21aa1fa76cbf1859bbf41ab096cadb6377cfb82042a980657 |
| SimHash | 2914dc13c611 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | / | Disallow all bots by default |
| Disallow | /scripts/ | - |
| Disallow | /*.php$ | - |
| Disallow | /zlib/ | - |
| Disallow | /lib/ | - |
| Disallow | /utils/ | - |
| Disallow | /magazine/ | - |
| Disallow | /admin/ | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.constructiontechreview.com/construction_news_sitemap.xml |
| sitemap | https://www.constructiontechreview.com/constructiontechreviewnewnews_sitemap.xml |
| sitemap | https://www.constructiontechreview.com/vendorviewpoint_sitemap.xml |
| sitemap | https://www.constructiontechreview.com/all_in_one_sitemap_main.xml |
| sitemap | https://www.constructiontechreview.com/contributors_sitemap.xml |
Comments